Support for tool calls

[calvinlfer]

Is it possible to expose tool calls similar to what Vercel’s AI SDK exposes which allows the LLM to call the functions exposed by your application (https://sdk.vercel.ai/cookbook/next/call-tools). This would need schema input and output definitions for the function being exposed but would be extremely useful in enabling workflows.

Thank you for this great library

[adamw]

Does Structured Outputs/JSON Schema support cover the use-case you are describing?

[calvinlfer]

I think this is additional to structured outputs. It's about providing the LLM the ability to call your user defined functions and feed it back the output to the LLM to enable more agentic workflows.

[adamw]

Ah true, might probably build upon structured outputs. Would be great to have, but sounds a bit complicated - which makes it even more attractive ;)

[calvinlfer]

but sounds a bit complicated - which makes it even more attractive ;)

for sure! I saw the implementation that Vercel used and how they tied it into Zod and I thought - hey we have something similar via Tapir Schema 😸