Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Pick up rates from the core listing #18

Closed
adubovik opened this issue Nov 28, 2023 · 2 comments
Closed

Pick up rates from the core listing #18

adubovik opened this issue Nov 28, 2023 · 2 comments
Assignees
@adubovik
Labels
enhancement New feature or request

Comments

@adubovik
Copy link
Collaborator

Currently the rates (per-model prompt and completion prices) are read from MODEL_RATES env var.

We need to pick the rates instead from the listing served by the core.

Note, that this issue must be resolved first: epam/ai-dial-core#53
@adubovik adubovik added the enhancement New feature or request label Nov 28, 2023
@adubovik adubovik self-assigned this Dec 4, 2023
@nepalevov
Copy link
Contributor

Please remove the "MODEL_RATES" env variable from the Dockerfile as well. It confuses when the variable is declared empty by default in docs but actually being defined on container level.

@adubovik
Copy link
Collaborator Author

Closed in favour of a different solution described in #101

@github-project-automation github-project-automation bot moved this to Done in AI DIAL Jan 15, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@adubovik adubovik

Labels
enhancement New feature or request
Projects
AI DIAL
Status: Done
Milestone
No milestone
Development

No branches or pull requests
2 participants
@adubovik @nepalevov