Commit graph

2999 commits

Author SHA1 Message Date
Krrish Dholakia
e39ff46222 docs(config.md): update wildcard docs 2024-07-26 08:59:53 -07:00
Krrish Dholakia
9d87767639 feat(proxy_server.py): handle pydantic mockselvar error
Fixes https://github.com/BerriAI/litellm/issues/4898#issuecomment-2252105485
2024-07-26 08:38:51 -07:00
Krrish Dholakia
d3ff21181c fix(litellm_cost_calc/google.py): support meta llama vertex ai cost tracking 2024-07-25 22:12:07 -07:00
Ishaan Jaff
1103c614a0 Merge branch 'main' into litellm_proxy_support_all_providers 2024-07-25 20:15:37 -07:00
Ishaan Jaff
f452a6e053 example mistral sdk 2024-07-25 19:48:54 -07:00
Ishaan Jaff
d589d8e4ac fix using pass_through_all_models 2024-07-25 19:32:49 -07:00
Krish Dholakia
473308a6dd Merge branch 'main' into litellm_redis_team_object 2024-07-25 19:31:52 -07:00
Krish Dholakia
9a42d312b5 Merge pull request #4887 from BerriAI/litellm_custom_llm
feat(custom_llm.py): Support Custom LLM Handlers
2024-07-25 19:05:29 -07:00
Ishaan Jaff
422b4d7e0f support using */* 2024-07-25 18:48:56 -07:00
Ishaan Jaff
a46c463dee router support setting pass_through_all_models 2024-07-25 18:34:12 -07:00
Krrish Dholakia
84ef8c11ff feat(proxy_server.py): support custom llm handler on proxy 2024-07-25 17:56:34 -07:00
Ishaan Jaff
591857082b feat - support health check audio_speech 2024-07-25 17:26:14 -07:00
Krrish Dholakia
85dd423de6 fix(proxy_server.py): check if input list > 0 before indexing into it
resolves 'list index out of range' error
2024-07-25 14:23:07 -07:00
Krrish Dholakia
5945da4a66 fix(main.py): fix calling openai gpt-3.5-turbo-instruct via /completions
Fixes https://github.com/BerriAI/litellm/issues/749
2024-07-25 09:57:19 -07:00
Krrish Dholakia
d1622f6c0c fix(internal_user_endpoints.py): support updating budgets for /user/update 2024-07-24 21:51:46 -07:00
Krrish Dholakia
487035c970 feat(auth_check.py): support using redis cache for team objects
Allows team update / check logic to work across instances instantly
2024-07-24 18:14:49 -07:00
Krrish Dholakia
254b6dc630 fix(key_management_endpoints.py): if budget duration set, set budget_reset_at 2024-07-24 15:02:22 -07:00
Krrish Dholakia
b94b9dcdea fix(bedrock_httpx.py): fix async client check 2024-07-24 12:43:52 -07:00
Marc Abramowitz
1a15755cc3 Check existence of multiple views in 1 query
instead of multiple queries. This is more efficient because it lets us check for
all views in one query instead of multiple queries.
2024-07-23 21:55:02 -07:00
Krrish Dholakia
a7779796ef fix(anthropic.py): support openai system message being a list 2024-07-23 21:45:56 -07:00
Ishaan Jaff
150a74345c Merge pull request #4841 from BerriAI/litellm_anthropic_cost_tracking
[Feat] - /v1/messages support usage tracking on spendLogs
2024-07-23 16:37:42 -07:00
Ishaan Jaff
314d9f007d fix DB accept null values for api_base, user, etc 2024-07-23 16:33:04 -07:00
Ishaan Jaff
344010e127 Pass litellm proxy specific metadata 2024-07-23 15:31:30 -07:00
Ishaan Jaff
d3d4124357 fix add better debugging _PROXY_track_cost_callback 2024-07-23 15:25:46 -07:00
Krrish Dholakia
271407400a fix(utils.py): support raw response headers for streaming requests 2024-07-23 11:58:58 -07:00
Krrish Dholakia
d55b516f3c feat(utils.py): support passing openai response headers to client, if enabled
Allows openai/openai-compatible provider response headers to be sent to client, if 'return_response_headers' is enabled
2024-07-23 11:30:52 -07:00
Ishaan Jaff
abc6da3775 doc alert_to_webhook_url 2024-07-23 11:04:15 -07:00
Ishaan Jaff
cd735dd545 feat alert_to_webhook_url 2024-07-23 10:09:24 -07:00
Ishaan Jaff
fed7ad44ae feat - set alert_to_webhook_url 2024-07-23 10:08:21 -07:00
Ishaan Jaff
f2cbdf2336 update alert_to_webhook_url 2024-07-23 10:07:08 -07:00
Ishaan Jaff
6a8787680e feat - add success_Callback per request 2024-07-23 08:43:01 -07:00
Ishaan Jaff
e9f26d4e36 add debug logging for team callback settings 2024-07-23 08:41:05 -07:00
Ishaan Jaff
926e50c50e add endpoint to disable logging for a team 2024-07-23 08:38:23 -07:00
Krish Dholakia
7cf9620b12 Merge branch 'main' into litellm_braintrust_integration 2024-07-22 22:40:39 -07:00
Krish Dholakia
0cb872cbea Merge pull request #4810 from BerriAI/litellm_team_modify_guardrails
feat(auth_checks.py): Allow admin to disable team from turning on/off guardrails
2024-07-22 22:32:24 -07:00
Krrish Dholakia
14c5d6ff03 fix(proxy/utils.py): add stronger typing for litellm params in failure call logging 2024-07-22 21:31:39 -07:00
Ishaan Jaff
e915e78508 Merge pull request #4831 from BerriAI/litellm_api_control_team_logging
[Feat] - API Endpoints to control logging callbacks per Team
2024-07-22 21:22:14 -07:00
Krrish Dholakia
8c005d8134 feat(redact_messages.py): allow remove sensitive key information before passing to logging integration 2024-07-22 20:58:02 -07:00
Ishaan Jaff
0162a382a6 GET endpoint to get team callbacks 2024-07-22 20:46:20 -07:00
Ishaan Jaff
5d591385ff only allow unique callbacks for team callbacks 2024-07-22 20:43:42 -07:00
Ishaan Jaff
25f37abdb4 feat add return types on team/callback 2024-07-22 20:35:27 -07:00
Ishaan Jaff
ac8d008942 control team callbacks using API 2024-07-22 18:29:21 -07:00
Ishaan Jaff
cd2bdfd2fb feat - return team_metadata in user_api_key_auth 2024-07-22 18:21:50 -07:00
Ishaan Jaff
f1e0919446 feat - add endpoint to set team callbacks 2024-07-22 18:18:09 -07:00
Ishaan Jaff
20bf18e97c types - AddTeamCallback 2024-07-22 18:11:59 -07:00
Krrish Dholakia
d4c72f913c feat(braintrust_logging.py): working braintrust logging for successful calls 2024-07-22 17:04:55 -07:00
Ishaan Jaff
3bbb4e8f1d fix checking if _known_custom_logger_compatible_callbacks 2024-07-22 15:43:43 -07:00
Ishaan Jaff
7658981cee update tests 2024-07-22 14:44:47 -07:00
Ishaan Jaff
5f238f2857 check is_llm_api_route 2024-07-22 14:43:30 -07:00
Ishaan Jaff
cd7d4031ee track anthropic_routes 2024-07-22 14:41:12 -07:00