How to use JSON mode with OpenAI

[khiconit]

Open AI and Ollama now support output format. Please support it soon

Documentation: https://platform.openai.com/docs/guides/structured-outputs?context=without_parse#json-mode

[marcusschiesser]

JSON mode is already supported via:

const llm = new OpenAI({
    model: "gpt-4o",
    additionalChatOptions: { response_format: { type: "json_object" } },
  });

but we should generally support structured output

[marcusschiesser]

just saw we have an issue for structured output already: #1249 - converting this to a discussion