Commit graph

17509 commits

Author SHA1 Message Date
Jonas Dittrich
f2191ef4cb
fix(_redis.py): allow all supported arguments for redis cluster (#5554) 2024-09-07 12:49:02 -07:00
Krrish Dholakia
4bf893afe1 fix(openai.py): fix error handling 2024-09-07 12:36:25 -07:00
Krrish Dholakia
20be76123b fix(openai.py): fix exception raised 2024-09-07 12:36:25 -07:00
Krrish Dholakia
e2d75a100a fix: fix linting errors 2024-09-07 12:35:22 -07:00
Krrish Dholakia
6e7654fb54 fix: fix linting errors 2024-09-07 12:34:44 -07:00
Krrish Dholakia
67b8043e64 feat(_init_.py): add new 'openai_text_completion_compatible_providers' list
Fixes https://github.com/BerriAI/litellm/issues/5558

Handles correctly routing fireworks ai calls when done via text completions
2024-09-07 12:02:57 -07:00
Krrish Dholakia
be1fe015de fix(litellm_logging.py): set completion_start_time_float to end_time_float if none
Fixes https://github.com/BerriAI/litellm/issues/5500
2024-09-07 09:04:11 -07:00
Peter Laß
72ea6f2ea8
litellm-helm: fix missing resource definitions in initContainer and missing DBname value for envVars in deployment.yaml (#5562)
* fix missing resource definitions in initContainer and missing DBname value in envVars in deployment.yaml

* fix missing resource definitions in initContainer and missing DBname value in envVars in deployment.yaml

---------

Co-authored-by: Peter Laß <peter.lass@maibornwolff.de>
2024-09-07 08:23:05 -07:00
Pradyumna Singh Rathore
a4f5fb3c30
fix missing class object instantiation in custom_llm_server provider documentation's quick start (#5578)
Co-authored-by: Pradyumna Singh Rathore <pradyumna.singhrathore@halliburton.com>
2024-09-07 08:22:18 -07:00
Krish Dholakia
4371aa1995
fix(langsmith.py): support sampling langsmith traces (#5577) 2024-09-06 22:14:44 -07:00
Krish Dholakia
32d0277f03
Allow client-side credentials to be sent to proxy (accept only if complete credentials are given) (#5575)
* feat: initial commit

* fix(proxy/auth/auth_utils.py): Allow client-side credentials to be given to the proxy (accept only if complete credentials are given)
2024-09-06 19:21:54 -07:00
Ishaan Jaff
a1f0169fc1 bump: version 1.44.20 → 1.44.21 2024-09-06 18:15:00 -07:00
Ishaan Jaff
afffd1f461 bump: version 1.44.19 → 1.44.20 2024-09-06 18:14:47 -07:00
Ishaan Jaff
64a828b455
Merge pull request #5573 from BerriAI/litellm_add_rerank_spend_tracking
[Feat] Add cost tracking for cohere rerank
2024-09-06 18:11:30 -07:00
Ishaan Jaff
516a6b63e1 ui new build 2024-09-06 18:10:46 -07:00
Ishaan Jaff
ff9aafe05d
Merge pull request #5566 from BerriAI/litellm_ui_regen_keys
[Feat] Allow setting duration time when regenerating key
2024-09-06 18:05:51 -07:00
Ishaan Jaff
09a4568172
Merge pull request #5574 from BerriAI/litellm_tags_use_views
[Feat-Proxy] Use DB Views to Get spend per Tag (Usage endpoints)
2024-09-06 17:33:06 -07:00
Krish Dholakia
72e961af3c
LiteLLM Minor Fixes and Improvements (08/06/2024) (#5567)
* fix(utils.py): return citations for perplexity streaming

Fixes https://github.com/BerriAI/litellm/issues/5535

* fix(anthropic/chat.py): support fallbacks for anthropic streaming (#5542)

* fix(anthropic/chat.py): support fallbacks for anthropic streaming

Fixes https://github.com/BerriAI/litellm/issues/5512

* fix(anthropic/chat.py): use module level http client if none given (prevents early client closure)

* fix: fix linting errors

* fix(http_handler.py): fix raise_for_status error handling

* test: retry flaky test

* fix otel type

* fix(bedrock/embed): fix error raising

* test(test_openai_batches_and_files.py): skip azure batches test (for now) quota exceeded

* fix(test_router.py): skip azure batch route test (for now) - hit batch quota limits

---------

Co-authored-by: Ishaan Jaff <ishaanjaffer0324@gmail.com>

* All `model_group_alias` should show up in `/models`, `/model/info` , `/model_group/info` (#5539)

* fix(router.py): support returning model_alias model names in `/v1/models`

* fix(proxy_server.py): support returning model alias'es on `/model/info`

* feat(router.py): support returning model group alias for `/model_group/info`

* fix(proxy_server.py): fix linting errors

* fix(proxy_server.py): fix linting errors

* build(model_prices_and_context_window.json): add amazon titan text premier pricing information

Closes https://github.com/BerriAI/litellm/issues/5560

* feat(litellm_logging.py): log standard logging response object for pass through endpoints. Allows bedrock /invoke agent calls to be correctly logged to langfuse + s3

* fix(success_handler.py): fix linting error

* fix(success_handler.py): fix linting errors

* fix(team_endpoints.py): Allows admin to update team member budgets

---------

Co-authored-by: Ishaan Jaff <ishaanjaffer0324@gmail.com>
2024-09-06 17:16:24 -07:00
Krish Dholakia
e4dcd6f745
fix(navbar.tsx): only show 'get enterprise license' if user is not already a premium user (#5568) 2024-09-06 17:14:30 -07:00
Ishaan Jaff
b345db5011 fix ui type 2024-09-06 17:04:03 -07:00
Ishaan Jaff
7f461dbf68 fix linting 2024-09-06 16:54:43 -07:00
Ishaan Jaff
c5aa422847 Merge branch 'main' into litellm_ui_regen_keys 2024-09-06 16:48:18 -07:00
Ishaan Jaff
d5914cf958 Merge branch 'main' into litellm_tags_use_views 2024-09-06 16:46:23 -07:00
Ishaan Jaff
292e87f572 Merge branch 'main' into litellm_add_rerank_spend_tracking 2024-09-06 16:46:07 -07:00
Ishaan Jaff
e0ac27c00c fix azure batches test - don't have more quota 2024-09-06 16:44:16 -07:00
Ishaan Jaff
3c16fcff1b fix linting errors 2024-09-06 16:41:47 -07:00
Ishaan Jaff
42f56e4287
Merge pull request #5570 from BerriAI/litellm_fix_datadog
[Fix-Datdog Logger] Log exceptions when callbacks faces an error
2024-09-06 16:32:16 -07:00
Ishaan Jaff
67751d0ecc fix use view for getting tag usage 2024-09-06 16:28:24 -07:00
Ishaan Jaff
43acf6d08f use view for getting tag usage on ui 2024-09-06 16:28:05 -07:00
Ishaan Jaff
bf1325e898
Merge pull request #5411 from gary149/huggingface-update
Update Hugging Face Doc
2024-09-06 16:18:31 -07:00
Ishaan Jaff
b659095f71 add cost tracking for rerank+ test 2024-09-06 16:06:19 -07:00
Ishaan Jaff
d1342c5991 fix RerankResponse type 2024-09-06 16:05:19 -07:00
Ishaan Jaff
e095daf2e4 add cost tracking for rerank 2024-09-06 16:04:54 -07:00
Ishaan Jaff
1852e1cd9a basic cohere rerank logging 2024-09-06 15:18:16 -07:00
Ishaan Jaff
c2e8f63062 fix datadog log exceptions 2024-09-06 14:36:35 -07:00
Ishaan Jaff
46b5a78c21 fix regen keys 2024-09-06 14:31:20 -07:00
Ishaan Jaff
5d9f2e7115 working regen flow 2024-09-06 14:10:02 -07:00
Ishaan Jaff
5c15e21a05 ui allow rotating keys 2024-09-06 10:34:50 -07:00
Ishaan Jaff
dd6c9df850 use form correctly 2024-09-06 10:27:47 -07:00
Ishaan Jaff
9bdb96ad9c allow correct fields on regenerate key 2024-09-06 10:19:37 -07:00
Ishaan Jaff
4626c5a365
Merge pull request #5548 from BerriAI/litellm_fix_otel_type_hints
[Fix] OTEL - Unsupported | type annotations in python3.9
2024-09-06 08:48:27 -07:00
Ishaan Jaff
aed59abe35 allow passing expiry time to /key/regenerate 2024-09-06 08:36:34 -07:00
Ishaan Jaff
b5349e97c7 run ci/cd again 2024-09-05 19:07:47 -07:00
Ishaan Jaff
b573847dad run ci cd again 2024-09-05 19:07:16 -07:00
Ishaan Jaff
31a5cb1885 fix otel type 2024-09-05 19:04:56 -07:00
Ishaan Jaff
7128c20df3 bump: version 1.44.18 → 1.44.19 2024-09-05 18:46:01 -07:00
Ishaan Jaff
8dbf372c6f
Merge pull request #5534 from BerriAI/litellm_fix_transcription
[Fix] transcription/atranscription file parameter should accept correct types
2024-09-05 18:41:36 -07:00
Ishaan Jaff
b68a9b1957 Merge branch 'main' into litellm_fix_transcription 2024-09-05 18:22:33 -07:00
Krish Dholakia
ce67858ceb LiteLLM Minor Fixes and Improvements (#5537)
* fix(vertex_ai): Fixes issue where multimodal message without text was failing vertex calls

Fixes https://github.com/BerriAI/litellm/issues/5515

* fix(azure.py): move to using httphandler for oidc token calls

Fixes issue where ssl certificates weren't being picked up as expected

Closes https://github.com/BerriAI/litellm/issues/5522

* feat: Allows admin to set a default_max_internal_user_budget in config, and allow setting more specific values as env vars

* fix(proxy_server.py): fix read for max_internal_user_budget

* build(model_prices_and_context_window.json): add regional gpt-4o-2024-08-06 pricing

Closes https://github.com/BerriAI/litellm/issues/5540

* test: skip re-test
2024-09-05 18:21:42 -07:00
Krish Dholakia
bc20879c23 Update lago.py to accomodate API change (#5495) (#5543)
* Update lago.py to accomodate API change (#5495)

external_customer_id is deprecated. 

external_subscription_id is the replacement.

* fix(lago.py): fixes

\

---------

Co-authored-by: Raymond Weitekamp <19483938+rawwerks@users.noreply.github.com>
2024-09-05 18:21:42 -07:00