phoenix/litellm
1
0
Fork 0
forked from phoenix/litellm-mirror
Code Pull requests Activity
15087 commits 1603 branches 645 tags 320 MiB
Commit graph

15087 commits

This branch
This branch
All branches
Author SHA1 Message Date
Krrish Dholakia
66c6992f8a fix(slack_alerting.py): use in-memory cache for checking request status 2024-07-02 13:01:59 -07:00
Ishaan Jaff
ce7fade15e test whisper re-using openai/azure clients 2024-07-02 12:35:15 -07:00
Ishaan Jaff
2b5f3c6105 fix use router level client for OpenAI / Azure transcription calls 2024-07-02 12:33:31 -07:00
Krrish Dholakia
3d3f725ef5 docs(user_keys.md): add langchain js example to docs 2024-07-02 12:06:48 -07:00
Ishaan Jaff
cd6b121642 use deep copy of router for _run_background_health_check 2024-07-02 11:29:24 -07:00
James Braza
2d661a1d2a Added poetry-check to pre-commit 2024-07-02 13:02:26 -04:00
James Braza
a30157d659 Ran 'poetry lock --no-update' 2024-07-02 13:02:07 -04:00
Tiger Yu
26630cd263
Merge branch 'main' into litellm-fix-vertexaibeta 2024-07-02 09:49:44 -07:00
Krrish Dholakia
79670ab82e fix(main.py): get the region name from boto3 client if dynamic var not set 2024-07-02 09:24:07 -07:00
Krrish Dholakia
5aae2313f3 fix(aws_secret_manager.py): fix string replace 2024-07-02 00:42:12 -07:00
Krrish Dholakia
196b94455e fix(dynamic_rate_limiter.py): add rpm allocation, priority + quota reservation to docs 2024-07-01 23:35:42 -07:00
Krish Dholakia
4ab83f0f46
Merge pull request #4497 from BerriAI/litellm_disable_cooldowns 
fix(router.py): disable cooldowns
 2024-07-01 23:10:18 -07:00
Krish Dholakia
011e14eb08
Merge branch 'main' into litellm_disable_cooldowns 2024-07-01 23:10:10 -07:00
Krrish Dholakia
6b529d4e0e fix(dynamic_rate_limiter.py): support setting priority + reserving tpm/rpm 2024-07-01 23:08:54 -07:00
Ishaan Jaff
38770da2f6 docs prometheus tracking x-remaining tokens 2024-07-01 22:45:33 -07:00
Ishaan Jaff
5f04ef14a6 doc prometheus tracking 2024-07-01 22:41:52 -07:00
Ishaan Jaff
e2a2c2bde1 ci/cd run again 2024-07-01 21:36:30 -07:00
Ishaan Jaff
4cb098661a bump: version 1.41.2 → 1.41.3 2024-07-01 21:35:52 -07:00
Ishaan Jaff
4bb418acf3
Merge pull request #4504 from BerriAI/litellm_fix_exception_provider_not_known 
fix exception provider not known
 2024-07-01 21:22:20 -07:00
Ishaan Jaff
665d8fb250 test - test_azure_embedding_exceptions 2024-07-01 21:19:47 -07:00
Ishaan Jaff
402799c8db
Merge pull request #4503 from BerriAI/litellm_log_remaining_rate_limit_prometheus 
[Feat-Enterprise]  log `"x-ratelimit-remaining-tokens"` and `"x-ratelimit-remaining-requests"` on prometheus
 2024-07-01 21:11:42 -07:00
Ishaan Jaff
1c194f0275
Merge pull request #4501 from BerriAI/litellm_return_Response_headers 
[Feat] Return Response headers for OpenAI / Azure OpenAI when `litellm.return_response_headers=True`
 2024-07-01 21:11:10 -07:00
Ishaan Jaff
fcf65d5215 fix exception provider not known 2024-07-01 21:05:37 -07:00
Ishaan Jaff
4033302656 feat - return headers for openai audio transcriptions 2024-07-01 20:27:27 -07:00
Krrish Dholakia
460c33f70f test(test_dynamic_rate_limit_handler.py): add unit tests for dynamic rpm limits 2024-07-01 20:20:24 -07:00
Krrish Dholakia
0781014706 test(test_dynamic_rate_limit_handler.py): refactor tests for rpm suppprt 2024-07-01 20:16:10 -07:00
Ishaan Jaff
568245b5c0 feat - set response headers in azure requests 2024-07-01 20:12:39 -07:00
Ishaan Jaff
c37d45d556 feat - prometheus log remaining headers 2024-07-01 20:00:47 -07:00
Krrish Dholakia
f23b17091d fix(dynamic_rate_limiter.py): support dynamic rate limiting on rpm 2024-07-01 17:45:10 -07:00
Ishaan Jaff
04a975d486 feat - add response_headers in litellm_logging_obj 2024-07-01 17:25:15 -07:00
Krrish Dholakia
b761ce9dd1 fix(s3.py): fix s3 path logging on proxy 2024-07-01 17:22:31 -07:00
Ishaan Jaff
140f7fe254 return azure response headers 2024-07-01 17:09:06 -07:00
Ishaan Jaff
48946f7528 fix config 2024-07-01 17:02:15 -07:00
Ishaan Jaff
4b7feb3261 feat - return response headers for async openai requests 2024-07-01 17:01:42 -07:00
Peter Muller
c6be8326db
Allow calling SageMaker endpoints from different regions 2024-07-01 16:00:42 -07:00
Krrish Dholakia
a5439a621b docs(debugging.md): add docs on debugging common errors 2024-07-01 15:13:19 -07:00
Krrish Dholakia
051dfee421 docs(routing.md): add docs on how to disable cooldowns 2024-07-01 15:05:38 -07:00
Krrish Dholakia
ea74e01813 fix(router.py): disable cooldowns 
allow admin to disable model cooldowns
 2024-07-01 15:03:10 -07:00
Krrish Dholakia
bfab76a810 docs(configs.md): add wildcard model name to docs 2024-07-01 14:11:45 -07:00
Krrish Dholakia
223494a0e0 fix(aws_secret_manager.py): accept 'aws_kms' being in the key name 2024-07-01 13:46:20 -07:00
Krrish Dholakia
a389f6bff4 fix(core_helpers.py): map vertex ai 'RECITATION' finish reason to 'content_filter' 
Fixes https://github.com/BerriAI/litellm/issues/4491
 2024-07-01 12:48:56 -07:00
David Manouchehri
5572494801
feat(vertex_httpx.py): Support cachedContent. 2024-07-01 16:59:35 +00:00
Krrish Dholakia
4c95782f74 fix(utils.py): fix openrouter tool calling params 2024-07-01 08:25:29 -07:00
Krrish Dholakia
5e521bd36e fix(utils.py): fix openrouter params 
Fixes https://github.com/BerriAI/litellm/issues/4488
 2024-07-01 08:24:06 -07:00
Krish Dholakia
49a72ffb51
Merge pull request #4486 from ubirdio/vertex-ai-beta-fix 
Fix usage of parameter-based credentials when using vertex_ai_beta route
 2024-07-01 08:15:49 -07:00
Krrish Dholakia
be3c98bc16 fix(main.py): copy messages - prevent modifying user input 
Fixes https://github.com/BerriAI/litellm/discussions/4489
 2024-07-01 08:14:46 -07:00
Ishaan Jaff
c31156e5e6
Merge pull request #4484 from Manouchehri/add-me-converse-shoes-1 
fix(bedrock_httpx.py): Add anthropic.claude-3-5-sonnet-20240620-v1:0 to converse list
 2024-07-01 07:37:19 -07:00
Ishaan Jaff
19464b2521 fix openai compatible doc quote 2024-07-01 07:36:06 -07:00
David Manouchehri
9a74364baa
fix(bedrock_httpx.py): Add anthropic.claude-3-5-sonnet-20240620-v1:0 to the converse list. 2024-07-01 14:18:23 +00:00
Ishaan Jaff
9be176140d
Merge pull request #4485 from sauravpanda/main 
Update azure_ai.md
 2024-07-01 07:15:59 -07:00