Commit graph

15993 commits

Author SHA1 Message Date
Ishaan Jaff
55feece2b5 fix test_team_update_redis 2024-08-07 15:37:02 -07:00
Ishaan Jaff
d6a552c049 bump: version 1.43.1 → 1.43.2 2024-08-07 15:26:55 -07:00
Ishaan Jaff
ee6477e1ac fix - someone resolved a merge conflict badly 2024-08-07 15:23:15 -07:00
Ishaan Jaff
a0b2c107c4 fix getting provider_specific_deployment 2024-08-07 15:20:59 -07:00
Ishaan Jaff
322258a1fa Merge pull request #5098 from BerriAI/litellm_provider_wildcard_routing
[Feat-Router + Proxy] Add provider wildcard routing
2024-08-07 14:51:42 -07:00
Ishaan Jaff
aa9ad72562 docs provider specific wildcard routing 2024-08-07 14:49:45 -07:00
Krish Dholakia
ab487f0cf9 Merge pull request #5079 from BerriAI/litellm_add_pydantic_model_support
feat(utils.py): support passing response_format as pydantic model
2024-08-07 14:43:05 -07:00
Krish Dholakia
d80f87d1ec Merge pull request #5095 from Mogith-P-N/main
Clarifai : Removed model name casing issue
2024-08-07 14:42:26 -07:00
Ishaan Jaff
31e4fca748 fix use provider specific routing 2024-08-07 14:37:20 -07:00
Krish Dholakia
9c1775f308 Merge pull request #5091 from BerriAI/litellm_anthropic_streaming_tool_call_fix
fix(anthropic.py): handle anthropic returning empty argument string (invalid json str) for tool call while streaming
2024-08-07 14:33:42 -07:00
Krish Dholakia
78d72acc44 Merge branch 'main' into litellm_anthropic_streaming_tool_call_fix 2024-08-07 14:33:30 -07:00
Ishaan Jaff
25e6733da3 support provider wildcard routing 2024-08-07 14:20:22 -07:00
Ishaan Jaff
887d072375 test_router_provider_wildcard_routing 2024-08-07 14:12:40 -07:00
Ishaan Jaff
bb9493e5f7 router use provider specific wildcard routing 2024-08-07 14:12:10 -07:00
Ishaan Jaff
5e0e113b39 test provider wildcard routing 2024-08-07 13:52:00 -07:00
Ishaan Jaff
6a1a4eb822 add + test provider specific routing 2024-08-07 13:49:46 -07:00
Krrish Dholakia
0780433e4c fix(config.yml): fix build and test 2024-08-07 13:23:04 -07:00
Krrish Dholakia
661529beb7 fix(main.py): fix linting error for python3.8 2024-08-07 13:21:35 -07:00
Krrish Dholakia
82eb418c86 fix(utils.py): fix linting error for python3.8 2024-08-07 13:14:29 -07:00
Ishaan Jaff
da7469296a gemini test skip internal server error 2024-08-07 13:12:45 -07:00
Krrish Dholakia
26ad015ccf test: update build requirements 2024-08-07 13:09:49 -07:00
Krish Dholakia
77a33baabb Merge branch 'main' into litellm_add_pydantic_model_support 2024-08-07 13:07:46 -07:00
Krrish Dholakia
0de640700d fix(router.py): add reason for fallback failure to client-side exception string
make it easier to debug why a fallback failed to occur
2024-08-07 13:02:47 -07:00
Ishaan Jaff
1a82a6370d docs prom metrics 2024-08-07 12:50:03 -07:00
Ishaan Jaff
c330afd306 docs prometheus 2024-08-07 12:47:06 -07:00
Ishaan Jaff
fc60bd07b2 show warning about prometheus moving to enterprise 2024-08-07 12:46:26 -07:00
Ishaan Jaff
b7425ee88a Merge pull request #5088 from BerriAI/litellm_init_prom_svc_logger
[Fix] Init Prometheus Service Logger when it's None
2024-08-07 12:40:08 -07:00
Ishaan Jaff
9e1989fbc2 Merge pull request #5092 from BerriAI/litellm_prom_metrics_llms
[Feat] - Prometheus Metrics to monitor a model health
2024-08-07 12:39:38 -07:00
Ishaan Jaff
5dec8c85bb docs link to enteprise pricing 2024-08-07 12:10:47 -07:00
Ishaan Jaff
ad1023682a docs prometheus 2024-08-07 11:37:05 -07:00
Ishaan Jaff
27e8a89077 fix logging cool down deployment 2024-08-07 11:27:05 -07:00
Krrish Dholakia
788b06a33c fix(utils.py): support deepseek tool calling
Fixes https://github.com/BerriAI/litellm/issues/5081
2024-08-07 11:14:05 -07:00
Krrish Dholakia
5dd4493a73 fix(vertex_ai_partner.py): default vertex ai llama3.1 api to use all openai params
Poor vertex docs - not clear what can/can't work

Fixes https://github.com/BerriAI/litellm/issues/5090
2024-08-07 11:08:54 -07:00
Ishaan Jaff
0dd8f50477 use router_cooldown_handler 2024-08-07 10:40:55 -07:00
Ishaan Jaff
92a38b213b allow setting outage metrics 2024-08-07 10:36:18 -07:00
Krrish Dholakia
bac35c9e47 test(test_completion.py): handle internal server error in test 2024-08-07 10:21:37 -07:00
Krrish Dholakia
75b2fd2e7f test: add vertex claude to streaming valid json str test 2024-08-07 10:18:17 -07:00
Mogith P N
92abaaf060 Clarifai : Fixed model name 2024-08-07 16:59:33 +00:00
Ishaan Jaff
426dcc9275 emit deployment_partial_outage on prometheus 2024-08-07 09:56:01 -07:00
Krrish Dholakia
89273722ba fix(bedrock_httpx.py): handle empty arguments returned during tool calling streaming 2024-08-07 09:54:50 -07:00
Ishaan Jaff
7222791210 rename to set_llm_deployment_success_metrics 2024-08-07 09:46:08 -07:00
Ishaan Jaff
786a3f9e95 add set_remaining_tokens_requests_metric 2024-08-07 09:43:35 -07:00
Krrish Dholakia
ec4051592b fix(anthropic.py): handle scenario where anthropic returns invalid json string for tool call while streaming
Fixes https://github.com/BerriAI/litellm/issues/5063
2024-08-07 09:24:11 -07:00
Ishaan Jaff
587b9dce9a prom svc logger init if it's None 2024-08-07 09:02:03 -07:00
Ishaan Jaff
8cb5887077 Merge pull request #5086 from BerriAI/litellm_or_headers
[Fix-Bug]: Using extra_headers removes the OpenRouter HTTP-Referer/X-Title headers
2024-08-07 08:27:07 -07:00
Ishaan Jaff
7d6d7f2bab fix use extra headers for open router 2024-08-07 08:15:05 -07:00
Krrish Dholakia
6880bf2aa3 build(requirements.txt): bump openai version 2024-08-07 08:08:37 -07:00
Ishaan Jaff
9f4cf4f3e8 Merge pull request #5084 from BerriAI/litellm_add_gpt4o
add ft:gpt-4o-mini-2024-07-18 to model prices
2024-08-07 08:05:14 -07:00
Ishaan Jaff
873ddb1f6e Merge pull request #5085 from BerriAI/revert-4640-main
Revert "Fix: Add prisma binary_cache_dir specification to pyproject.toml"
2024-08-07 07:54:15 -07:00
Ishaan Jaff
6a03ad0857 Revert "Fix: Add prisma binary_cache_dir specification to pyproject.toml" 2024-08-07 07:50:05 -07:00