Commit graph

10123 commits

Author SHA1 Message Date
Ishaan Jaff
55feece2b5 fix test_team_update_redis 2024-08-07 15:37:02 -07:00
Ishaan Jaff
ee6477e1ac fix - someone resolved a merge conflict badly 2024-08-07 15:23:15 -07:00
Ishaan Jaff
a0b2c107c4 fix getting provider_specific_deployment 2024-08-07 15:20:59 -07:00
Ishaan Jaff
322258a1fa Merge pull request #5098 from BerriAI/litellm_provider_wildcard_routing
[Feat-Router + Proxy] Add provider wildcard routing
2024-08-07 14:51:42 -07:00
Krish Dholakia
ab487f0cf9 Merge pull request #5079 from BerriAI/litellm_add_pydantic_model_support
feat(utils.py): support passing response_format as pydantic model
2024-08-07 14:43:05 -07:00
Krish Dholakia
d80f87d1ec Merge pull request #5095 from Mogith-P-N/main
Clarifai : Removed model name casing issue
2024-08-07 14:42:26 -07:00
Ishaan Jaff
31e4fca748 fix use provider specific routing 2024-08-07 14:37:20 -07:00
Krish Dholakia
78d72acc44 Merge branch 'main' into litellm_anthropic_streaming_tool_call_fix 2024-08-07 14:33:30 -07:00
Ishaan Jaff
25e6733da3 support provider wildcard routing 2024-08-07 14:20:22 -07:00
Ishaan Jaff
887d072375 test_router_provider_wildcard_routing 2024-08-07 14:12:40 -07:00
Ishaan Jaff
bb9493e5f7 router use provider specific wildcard routing 2024-08-07 14:12:10 -07:00
Ishaan Jaff
5e0e113b39 test provider wildcard routing 2024-08-07 13:52:00 -07:00
Ishaan Jaff
6a1a4eb822 add + test provider specific routing 2024-08-07 13:49:46 -07:00
Krrish Dholakia
661529beb7 fix(main.py): fix linting error for python3.8 2024-08-07 13:21:35 -07:00
Krrish Dholakia
82eb418c86 fix(utils.py): fix linting error for python3.8 2024-08-07 13:14:29 -07:00
Ishaan Jaff
da7469296a gemini test skip internal server error 2024-08-07 13:12:45 -07:00
Krrish Dholakia
26ad015ccf test: update build requirements 2024-08-07 13:09:49 -07:00
Krish Dholakia
77a33baabb Merge branch 'main' into litellm_add_pydantic_model_support 2024-08-07 13:07:46 -07:00
Krrish Dholakia
0de640700d fix(router.py): add reason for fallback failure to client-side exception string
make it easier to debug why a fallback failed to occur
2024-08-07 13:02:47 -07:00
Ishaan Jaff
fc60bd07b2 show warning about prometheus moving to enterprise 2024-08-07 12:46:26 -07:00
Ishaan Jaff
b7425ee88a Merge pull request #5088 from BerriAI/litellm_init_prom_svc_logger
[Fix] Init Prometheus Service Logger when it's None
2024-08-07 12:40:08 -07:00
Ishaan Jaff
9e1989fbc2 Merge pull request #5092 from BerriAI/litellm_prom_metrics_llms
[Feat] - Prometheus Metrics to monitor a model health
2024-08-07 12:39:38 -07:00
Ishaan Jaff
27e8a89077 fix logging cool down deployment 2024-08-07 11:27:05 -07:00
Krrish Dholakia
788b06a33c fix(utils.py): support deepseek tool calling
Fixes https://github.com/BerriAI/litellm/issues/5081
2024-08-07 11:14:05 -07:00
Krrish Dholakia
5dd4493a73 fix(vertex_ai_partner.py): default vertex ai llama3.1 api to use all openai params
Poor vertex docs - not clear what can/can't work

Fixes https://github.com/BerriAI/litellm/issues/5090
2024-08-07 11:08:54 -07:00
Ishaan Jaff
0dd8f50477 use router_cooldown_handler 2024-08-07 10:40:55 -07:00
Ishaan Jaff
92a38b213b allow setting outage metrics 2024-08-07 10:36:18 -07:00
Krrish Dholakia
bac35c9e47 test(test_completion.py): handle internal server error in test 2024-08-07 10:21:37 -07:00
Krrish Dholakia
75b2fd2e7f test: add vertex claude to streaming valid json str test 2024-08-07 10:18:17 -07:00
Mogith P N
92abaaf060 Clarifai : Fixed model name 2024-08-07 16:59:33 +00:00
Ishaan Jaff
426dcc9275 emit deployment_partial_outage on prometheus 2024-08-07 09:56:01 -07:00
Krrish Dholakia
89273722ba fix(bedrock_httpx.py): handle empty arguments returned during tool calling streaming 2024-08-07 09:54:50 -07:00
Ishaan Jaff
7222791210 rename to set_llm_deployment_success_metrics 2024-08-07 09:46:08 -07:00
Ishaan Jaff
786a3f9e95 add set_remaining_tokens_requests_metric 2024-08-07 09:43:35 -07:00
Krrish Dholakia
ec4051592b fix(anthropic.py): handle scenario where anthropic returns invalid json string for tool call while streaming
Fixes https://github.com/BerriAI/litellm/issues/5063
2024-08-07 09:24:11 -07:00
Ishaan Jaff
587b9dce9a prom svc logger init if it's None 2024-08-07 09:02:03 -07:00
Ishaan Jaff
8cb5887077 Merge pull request #5086 from BerriAI/litellm_or_headers
[Fix-Bug]: Using extra_headers removes the OpenRouter HTTP-Referer/X-Title headers
2024-08-07 08:27:07 -07:00
Ishaan Jaff
7d6d7f2bab fix use extra headers for open router 2024-08-07 08:15:05 -07:00
Ishaan Jaff
a7b5ca23d0 feat add ft:gpt-4o-mini-2024-07-18 2024-08-07 07:46:23 -07:00
Krrish Dholakia
584a495eba build(model_prices_and_context_window.json): remove duplicate entries 2024-08-06 22:50:41 -07:00
Krish Dholakia
0044fd0041 Merge branch 'main' into litellm_support_lakera_config_thresholds 2024-08-06 22:47:13 -07:00
Ishaan Jaff
b57efb32d4 run ci / cd again 2024-08-06 21:35:46 -07:00
Ishaan Jaff
dc7eba5f20 ci/cd run again 2024-08-06 21:28:22 -07:00
Ishaan Jaff
5eabef4318 fix pass through endpoint tests 2024-08-06 21:16:07 -07:00
Ishaan Jaff
7bcb088ac0 clean up unused func 2024-08-06 20:58:51 -07:00
Krrish Dholakia
8b028d41aa feat(utils.py): support validating json schema client-side if user opts in 2024-08-06 19:35:33 -07:00
Krrish Dholakia
831dc1b886 feat: Translate openai 'response_format' json_schema to 'response_schema' for vertex ai + google ai studio
Closes https://github.com/BerriAI/litellm/issues/5074
2024-08-06 19:06:14 -07:00
Krrish Dholakia
2b132c6bef feat(utils.py): support passing response_format as pydantic model
Related issue - https://github.com/BerriAI/litellm/issues/5074
2024-08-06 18:16:07 -07:00
Ishaan Jaff
22ca6d6d30 fix forward ui requests when base url set 2024-08-06 18:10:34 -07:00
Ishaan Jaff
e207ac577e add redirect_ui_middleware 2024-08-06 18:01:23 -07:00