Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Pick up rates from the core listing #18

Open
adubovik opened this issue Nov 28, 2023 · 1 comment
Open

Pick up rates from the core listing #18

adubovik opened this issue Nov 28, 2023 · 1 comment
Assignees
Labels
enhancement New feature or request

Comments

@adubovik
Copy link

Currently the rates (per-model prompt and completion prices) are read from MODEL_RATES env var.

We need to pick the rates instead from the listing served by the core.

Note, that this issue must be resolved first: epam/ai-dial-core#53

@adubovik adubovik added the enhancement New feature or request label Nov 28, 2023
@adubovik adubovik self-assigned this Dec 4, 2023
@nepalevov
Copy link
Contributor

Please remove the "MODEL_RATES" env variable from the Dockerfile as well. It confuses when the variable is declared empty by default in docs but actually being defined on container level.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
Status: No status
Development

No branches or pull requests

2 participants