Litellm dev 11 20 2024 (#6838)

* feat(customer_endpoints.py): support passing budget duration via `/customer/new` endpoint

Closes https://github.com/BerriAI/litellm/issues/5651

* docs: add missing params to swagger + api documentation test

* docs: add documentation for all key endpoints

documents all params on swagger

* docs(internal_user_endpoints.py): document all /user/new params

Ensures all params are documented

* docs(team_endpoints.py): add missing documentation for team endpoints

Ensures 100% param documentation on swagger

* docs(organization_endpoints.py): document all org params

Adds documentation for all params in org endpoint

* docs(customer_endpoints.py): add coverage for all params on /customer endpoints

ensures all /customer/* params are documented

* ci(config.yml): add endpoint doc testing to ci/cd

* fix: fix internal_user_endpoints.py

* fix(internal_user_endpoints.py): support 'duration' param

* fix(partner_models/main.py): fix anthropic re-raise exception on vertex

* fix: fix pydantic obj

* build(model_prices_and_context_window.json): add new vertex claude model names

vertex claude changed model names - causes cost tracking errors
This commit is contained in:
Krish Dholakia 2024-11-21 05:20:37 +05:30 committed by GitHub
parent 0b0253f7ad
commit b11bc0374e
No known key found for this signature in database
GPG key ID: B5690EEEBB952194
6 changed files with 148 additions and 8 deletions

View file

@ -770,7 +770,7 @@ def test_vertex_ai_claude_completion_cost():
)
],
created=1700775391,
model="vertex_ai/claude-3-sonnet@20240229",
model="claude-3-sonnet",
object="chat.completion",
system_fingerprint=None,
usage=Usage(
@ -780,7 +780,7 @@ def test_vertex_ai_claude_completion_cost():
),
)
cost = litellm.completion_cost(
model="vertex_ai/claude-3-sonnet@20240229",
model="vertex_ai/claude-3-sonnet",
completion_response=response,
messages=[{"role": "user", "content": "Hey, how's it going?"}],
)