phoenix/litellm
1
0
Fork 0
forked from phoenix/litellm-mirror
Code Pull requests Activity
13234 commits 1603 branches 645 tags 320 MiB
Commit graph

1539 commits

Author SHA1 Message Date
Ishaan Jaff
75222d7d4b
Merge branch 'main' into litellm_show_openai_params_model_hub 2024-05-27 09:27:56 -07:00
Krrish Dholakia
f0f853b941 fix(utils.py): support deepinfra optional params 
Fixes https://github.com/BerriAI/litellm/issues/3855
 2024-05-27 09:16:56 -07:00
Ishaan Jaff
245990597e fix - return supported_openai_params from get_model_info 2024-05-27 09:00:12 -07:00
Krrish Dholakia
22b6b99b34 feat(proxy_server.py): expose new /model_group/info endpoint 
returns model-group level info on supported params, max tokens, pricing, etc.
 2024-05-26 14:07:35 -07:00
Nir Gazit
7602c6f436 Revert "Revert "Log errors in Traceloop Integration"" 2024-05-26 12:01:10 +03:00
Ishaan Jaff
0ae6b337a3
Merge pull request #3824 from BerriAI/litellm_include_litellm_exception-in-error 
[Feature]: Attach litellm exception in error string
 2024-05-25 17:09:22 -07:00
Krrish Dholakia
25a2f00db6 fix(proxy_server.py): fix model check for /v1/models endpoint when team has restricted access 2024-05-25 13:02:03 -07:00
Ishaan Jaff
0083776a14
Revert "Log errors in Traceloop Integration" 2024-05-24 21:25:17 -07:00
Krish Dholakia
d25ed9c4d3
Merge pull request #3828 from BerriAI/litellm_outage_alerting 
fix(slack_alerting.py): support region based outage alerting
 2024-05-24 19:13:17 -07:00
Krrish Dholakia
8dec87425e feat(slack_alerting.py): refactor region outage alerting to do model based alerting instead 
Unable to extract azure region from api base, makes sense to start with model alerting and then move to region
 2024-05-24 19:10:33 -07:00
Krrish Dholakia
f8350b9461 fix(slack_alerting.py): support region based outage alerting 2024-05-24 16:59:16 -07:00
Krish Dholakia
bcd7534153
Merge pull request #3780 from nirga/traceloop-failures 
Log errors in Traceloop Integration
 2024-05-24 14:23:26 -07:00
Nir Gazit
7c279e05a7 fix(traceloop): log errors 2024-05-24 22:05:31 +03:00
Ishaan Jaff
33632df4c5 feat - include litellm exception type when raising exception 2024-05-24 10:45:37 -07:00
Krish Dholakia
391a31c0ce
Merge pull request #3812 from afbarbaro/main 
Fix issue with delta being None when Deferred / Async Content Filter is enabled on Azure OpenAI
 2024-05-24 10:05:08 -07:00
Andres Barbaro
b002328c8d Fix issue with delta being None when Deferred / Async Content Filter is enabled on Azure OpenAI 2024-05-23 22:42:42 -05:00
Krrish Dholakia
f04e4b921b feat(ui/model_dashboard.tsx): add databricks models via admin ui 2024-05-23 20:28:54 -07:00
Krish Dholakia
c14584722e
Merge pull request #3808 from BerriAI/litellm_databricks_api 
feat(databricks.py): adds databricks support - completion, async, streaming
 2024-05-23 19:23:19 -07:00
Krrish Dholakia
43353c28b3 feat(databricks.py): add embedding model support 2024-05-23 18:22:03 -07:00
Krrish Dholakia
d2229dcd21 feat(databricks.py): adds databricks support - completion, async, streaming 
Closes https://github.com/BerriAI/litellm/issues/2160
 2024-05-23 16:29:46 -07:00
Ishaan Jaff
e0af091b5e feat - add prixing for vertex_ai image gen 2024-05-23 16:27:08 -07:00
Krish Dholakia
beb61702c3
Merge branch 'main' into litellm_filter_invalid_params 2024-05-21 20:42:21 -07:00
Krrish Dholakia
988970f4c2 feat(router.py): Fixes https://github.com/BerriAI/litellm/issues/3769 2024-05-21 17:24:51 -07:00
Krrish Dholakia
62e5559e0a fix(utils.py): filter out hf eos token 
Closes https://github.com/BerriAI/litellm/issues/3757
 2024-05-21 14:31:54 -07:00
alisalim17
01bb26bbba Revert "Revert "Logfire Integration"" 
This reverts commit b04a8d878a.
 2024-05-21 11:07:40 +04:00
Krish Dholakia
c6bb6e325b
Merge pull request #3740 from BerriAI/litellm_return_rejected_response 
feat(proxy_server.py): allow admin to return rejected response as string to user
 2024-05-20 17:48:21 -07:00
Ishaan Jaff
8413fdf4c7
Merge branch 'main' into litellm_standardize_slack_exception_msg_format 2024-05-20 16:39:41 -07:00
Ishaan Jaff
25fae37efc
Merge pull request #3716 from BerriAI/litellm_set_cooldown_time_based_on_exception_header 
[Feat] Router/ Proxy - set cooldown_time based on Azure exception headers
 2024-05-20 16:34:12 -07:00
Ishaan Jaff
8263d15ca3 fix - standardize slack alerting format 2024-05-20 16:26:11 -07:00
Ishaan Jaff
91a89eb4ed
Merge pull request #3739 from BerriAI/litellm_add_imagen_support 
[FEAT] Async VertexAI Image Generation
 2024-05-20 14:14:43 -07:00
Ishaan Jaff
518db13982 add parameter mapping with vertex ai 2024-05-20 13:28:20 -07:00
Krrish Dholakia
b41f30ca60 fix(proxy_server.py): fixes for making rejected responses work with streaming 2024-05-20 12:32:19 -07:00
Ishaan Jaff
655478e8dc fix python3.8 error 2024-05-20 10:55:10 -07:00
Ishaan Jaff
2519879e67 add ImageObject 2024-05-20 10:45:37 -07:00
Krrish Dholakia
372323c38a feat(proxy_server.py): allow admin to return rejected response as string to user 
Closes https://github.com/BerriAI/litellm/issues/3671
 2024-05-20 10:30:23 -07:00
Krrish Dholakia
12942c39db fix(utils.py): drop response_format if 'drop_params=True' for gpt-4 2024-05-18 13:02:48 -07:00
Krrish Dholakia
1cecdc4690 fix(utils.py): fix replicate completion cost calculation 2024-05-17 22:18:57 -07:00
Ishaan Jaff
f7a1675337 fix - cooldown based on exception header 2024-05-17 18:52:45 -07:00
Krish Dholakia
3a06fe2818
Merge branch 'main' into litellm_bedrock_anthropic_fix 2024-05-17 17:47:32 -07:00
Krrish Dholakia
4682802444 fix(bedrock_httpx.py): raise better timeout exception 2024-05-17 17:16:36 -07:00
Krrish Dholakia
b486bb1f8b fix(utils.py): exception map bedrock error 2024-05-17 16:18:25 -07:00
Krrish Dholakia
c0d62e94ae feat(proxy_server.py): enable custom branding + routes on openapi docs 
Allows user to add their branding + show only openai routes on docs
 2024-05-17 15:21:29 -07:00
Krrish Dholakia
26aefc7cd6 fix(utils.py): support openrouter function calling 2024-05-17 08:02:24 -07:00
Mikkel Gravgaard
80ef0f86d1
Merge branch 'main' into patch-1 2024-05-17 10:26:14 +02:00
Krrish Dholakia
92c2e2af6a fix(bedrock_httpx.py): add async support for bedrock amazon, meta, mistral models 2024-05-16 22:39:25 -07:00
Krrish Dholakia
0293f7766a fix(bedrock_httpx.py): move bedrock ai21 calls to being async 2024-05-16 22:21:30 -07:00
Krrish Dholakia
180bc46ca4 fix(bedrock_httpx.py): move anthropic bedrock calls to httpx 
Fixing https://github.com/BerriAI/litellm/issues/2921
 2024-05-16 21:51:55 -07:00
lj
f3d0f003fb
Removed config dict type definition 2024-05-17 10:39:00 +08:00
Ishaan Jaff
4952e244d9
Merge pull request #3705 from BerriAI/litellm_add_cost_tracking_for_ft_models 
[FEAT] add cost tracking for Fine Tuned OpenAI `ft:davinci-002` and `ft:babbage-002`
 2024-05-16 17:37:35 -07:00
Ishaan Jaff
28ae8284df fix add cost tracking for OpenAI ft models 2024-05-16 17:31:19 -07:00