You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Sorry for asking for a sanity check, but I have downloaded a model (Wizard-Vicuna-30B-Uncensored.ggmlv3.q5_0.bin) and dropped it in the /models folder which LocalAI appears to work with. I see that there is now an Auto-gpt example in the code base which I would like to try but use the mentioned model (the file has been renamed to gpt-3.5-turbo)
In the autogpt examples it states to use the below in the env file (I'm not using docker): PRELOAD_MODELS=[{"url": "github:go-skynet/model-gallery/gpt4all-j.yaml", "name": "gpt-3.5-turbo"}, { "url": "github:go-skynet/model-gallery/bert-embeddings.yaml", "name": "text-embedding-ada-002"}]
Would just using the below load the bert-embeddings or do I need to state both in my env file for it to work, -- I ask as on start up I dont see any differences in the output upon loading so unsure if it has done anything...and running cpu only so things take time: PRELOAD_MODELS=[{ "url": "github:go-skynet/model-gallery/bert-embeddings.yaml", "name": "text-embedding-ada-002"}]
reacted with thumbs up emoji reacted with thumbs down emoji reacted with laugh emoji reacted with hooray emoji reacted with confused emoji reacted with heart emoji reacted with rocket emoji reacted with eyes emoji
-
Sorry for asking for a sanity check, but I have downloaded a model (Wizard-Vicuna-30B-Uncensored.ggmlv3.q5_0.bin) and dropped it in the /models folder which LocalAI appears to work with. I see that there is now an Auto-gpt example in the code base which I would like to try but use the mentioned model (the file has been renamed to gpt-3.5-turbo)
In the autogpt examples it states to use the below in the env file (I'm not using docker):
PRELOAD_MODELS=[{"url": "github:go-skynet/model-gallery/gpt4all-j.yaml", "name": "gpt-3.5-turbo"}, { "url": "github:go-skynet/model-gallery/bert-embeddings.yaml", "name": "text-embedding-ada-002"}]
Would just using the below load the bert-embeddings or do I need to state both in my env file for it to work, -- I ask as on start up I dont see any differences in the output upon loading so unsure if it has done anything...and running cpu only so things take time:
PRELOAD_MODELS=[{ "url": "github:go-skynet/model-gallery/bert-embeddings.yaml", "name": "text-embedding-ada-002"}]
Beta Was this translation helpful? Give feedback.
All reactions