(repeating an earlier comment). The team behind Outlines has repeatedly provided evaluations that show constrained decoding improves the outputs:

- https://blog.dottxt.ai/performance-gsm8k.html

- https://blog.dottxt.ai/oss-v-gpt4.html

- https://blog.dottxt.ai/say-what-you-mean.html