New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

feat(dev ux): add the the mock or local LLM backend to allow developing Minerva without needing the OpenAI API key #31

Open

yurijmikhalevich opened this issue Sep 30, 2024 · 0 comments

Labels

enhancement hacktoberfest

Member

yurijmikhalevich commented Sep 30, 2024

We should add an optional mock or local LLM backend to allow the development of Minerva without needing the OpenAI API key.

To solve this, we need to:

abstract the OpenAI API behind a generic abstraction that we need to build
implement LLaMa 7b support or even an echo/mock LLM that the rest of the app can interact with using exactly the same abstraction
allow switching between the local/mock and OpenAI API using an env var

yurijmikhalevich added enhancement hacktoberfest labels

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment