You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Groq has an OpenAI-compatible API that allows you to call Mixtral LLM generation on their specialized hardware known as LPUs (Language Processing Units) to get high quality output at 4x the speed of GPT 3.5.
Suggested Implementation
Create a new LLM
The text was updated successfully, but these errors were encountered:
Brief Description
Add support for using Groq as an LLM
Rationale
Groq has an OpenAI-compatible API that allows you to call Mixtral LLM generation on their specialized hardware known as LPUs (Language Processing Units) to get high quality output at 4x the speed of GPT 3.5.
Suggested Implementation
Create a new LLM
The text was updated successfully, but these errors were encountered: