memgraph-lab: Add feature for users to specify OpenAI base URL #99
Labels
community
community
feature
feature
Frequency - Monthly
Frequency - Monthly
Reach - VeryFew
Reach - VeryFew
Severity - S3
Severity - S3
This feature would allow users who are hosting their own LLMs using OpenAI API compatible services such as vllm, aphrodite-engine, and others to use them with the memgraph-lab AI chat.
Broadly, users would just need a way to override the baseURL for the OpenAI connection type, no other changes would be needed.
The text was updated successfully, but these errors were encountered: