We read every piece of feedback, and take your input very seriously.
To see all available qualifiers, see our documentation.
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Describe the bug
From 3.1.0, ollama endpoint seems to be set to [OLLAMA_BASE_URL]/chat/completions instead of /api/chat or /api/generate, resulting in a 404 error.
/chat/completions
/api/chat
/api/generate
Rolling back to 3.0.8 with the same .env file restores the correct behavior (connecting to /api/chat).
Doesn't seem related to dd94598.
To Reproduce
git clone https://github.com/assafelovic/gpt-researcher cd gpt-researcher pip -r install requirements.txt python -m uvicorn main:app --reload
Ollama logs
3.1.0 [GIN] 2024/10/19 - 13:55:00 | 404 | 22.452µs | 127.0.0.1 | POST "/chat/completions"
[GIN] 2024/10/19 - 13:55:00 | 404 | 22.452µs | 127.0.0.1 | POST "/chat/completions"
3.0.8 [GIN] 2024/10/19 - 14:11:28 | 200 | 1.322965182s | 127.0.0.1 | POST "/api/chat"
[GIN] 2024/10/19 - 14:11:28 | 200 | 1.322965182s | 127.0.0.1 | POST "/api/chat"
.env
RETRIEVER=tavily TAVILY_API_KEY="tvly-xxxxxxxxxxx" LLM_PROVIDER=ollama EMBEDDING_PROVIDER=ollama OLLAMA_BASE_URL=http://localhost:11434 FAST_LLM_MODEL=qwen2.5:32b-instruct-q4_K_M_11k SMART_LLM_MODEL=qwen2.5:32b-instruct-q4_K_M_11k TEMPERATURE=0.55 OLLAMA_EMBEDDING_MODEL=bge-m3_gpu
The text was updated successfully, but these errors were encountered:
No branches or pull requests
Describe the bug
From 3.1.0, ollama endpoint seems to be set to [OLLAMA_BASE_URL]
/chat/completions
instead of/api/chat
or/api/generate
, resulting in a 404 error.Rolling back to 3.0.8 with the same .env file restores the correct behavior (connecting to /api/chat).
Doesn't seem related to dd94598.
To Reproduce
Ollama logs
3.1.0
[GIN] 2024/10/19 - 13:55:00 | 404 | 22.452µs | 127.0.0.1 | POST "/chat/completions"
3.0.8
[GIN] 2024/10/19 - 14:11:28 | 200 | 1.322965182s | 127.0.0.1 | POST "/api/chat"
.env
The text was updated successfully, but these errors were encountered: