How constrained decoding works for JSON
Let's see how a JSON schema, or a plain JSON mode, changes what a model is able to write.
Let's see how a JSON schema, or a plain JSON mode, changes what a model is able to write.
我們用 xgrammar 看看給了 JSON schema 之後,模型會受到甚麼影響。
A look at the input_json_delta events that carry a tool call's arguments in a streamed Claude API response, and what changes when a tool streams them eagerly.