Commit graph

3109 commits

Author SHA1 Message Date
Krish Dholakia
127f08ee67
Merge branch 'main' into litellm_tts_pricing 2024-07-06 14:57:34 -07:00
Krish Dholakia
b3ef1ac18c
Merge branch 'main' into litellm_proxy_tts_pricing 2024-07-06 14:56:16 -07:00
Krrish Dholakia
27e9f96380 fix(main.py): fix stream_chunk_builder usage calc
Closes https://github.com/BerriAI/litellm/issues/4496
2024-07-06 14:52:59 -07:00
Ishaan Jaff
f691ff7005 get spend per internal user / api_key 2024-07-06 14:45:58 -07:00
Ishaan Jaff
3623d49c2f /spend/report view spend for a specific key 2024-07-06 14:24:29 -07:00
Ishaan Jaff
c268ead43f fix links on admin ui 2024-07-06 14:00:49 -07:00
Ishaan Jaff
7f6f85ec3c improve sign up flow - show missing env vars 2024-07-06 13:57:19 -07:00
Ishaan Jaff
bf9e85c8d1 use a salt key for encrypt/decryption 2024-07-06 13:27:44 -07:00
Ishaan Jaff
a5d9a6cebd init litellm router 2024-07-06 13:14:04 -07:00
Ishaan Jaff
2e956f7c01 fix checking store_model_in_deb 2024-07-06 11:35:28 -07:00
Ishaan Jaff
6b2856e064 fix decrypt value logic 2024-07-06 11:26:12 -07:00
Krish Dholakia
ea9718a848
Merge branch 'main' into litellm_proxy_tts_pricing 2024-07-06 11:16:07 -07:00
Krrish Dholakia
71edb28d6a fix(proxy_server.py): fix embedding model exception mapping 2024-07-06 11:14:41 -07:00
Ishaan Jaff
8f0b55879f move encrypt / decrypt to helper 2024-07-06 11:09:47 -07:00
Ishaan Jaff
4e7a99e0f9 fix - make encrypt / decrypt helpers 2024-07-06 11:08:30 -07:00
Krrish Dholakia
6e43cdcb17 feat(litellm_logging.py): support cost tracking for tts calls 2024-07-05 22:09:08 -07:00
Ishaan Jaff
51e7099b13
Merge pull request #4569 from BerriAI/litelm_control_guardrails_api_key
feat - control guardrails per api key
2024-07-05 19:56:15 -07:00
Ishaan Jaff
22e31cb1ed feat - control guardrails per api key 2024-07-05 19:39:07 -07:00
Krrish Dholakia
6090fd37fa fix(test_proxy_reject_logging.py): fix test 2024-07-05 19:09:37 -07:00
Krrish Dholakia
fd11f63f71 fix(utils.py): log failure to sync failure callbacks as well 2024-07-05 14:49:34 -07:00
Krrish Dholakia
b1b21b0340 fix(proxy/utils.py): support logging rejected requests to langfuse, etc. 2024-07-05 14:39:35 -07:00
Krrish Dholakia
d528b66db0 fix(proxy_server.py): fix callback check order 2024-07-05 14:06:33 -07:00
Krrish Dholakia
7618ec43b3 fix(proxy_server.py): support langfuse logging for rejected requests on /v1/chat/completions 2024-07-05 13:07:09 -07:00
Krrish Dholakia
3ece295bf7 fix(litellm_license.py): add better error logs 2024-07-04 21:07:10 -07:00
Krrish Dholakia
ffcf9e695f feat(internal_user_endpoints.py): expose /user/delete endpoint 2024-07-04 17:01:16 -07:00
Krish Dholakia
aebcdc04ff
Merge pull request #4386 from BerriAI/litellm_user_delete_endpoint
feat(internal_user_endpoints.py): expose `/user/delete` endpoint
2024-07-04 16:38:31 -07:00
Krrish Dholakia
f2dabc65be fix(anthropic.py): fix anthropic tool calling + streaming
Fixes https://github.com/BerriAI/litellm/issues/4537
2024-07-04 16:30:24 -07:00
Krrish Dholakia
86632f6da0 fix(types/router.py): add custom pricing info to 'model_info'
Fixes https://github.com/BerriAI/litellm/issues/4542
2024-07-04 16:07:58 -07:00
Ishaan Jaff
3460a96c8a ui new build 2024-07-04 15:58:20 -07:00
Ishaan Jaff
c1c2f9faa4 fix backend invite link sign up 2024-07-04 15:55:04 -07:00
Ishaan Jaff
a457aec761 add doc string for v1/model/info 2024-07-04 13:21:02 -07:00
Ishaan Jaff
12343650e4 feat - allow looking up model_id in model info 2024-07-04 13:13:42 -07:00
Krrish Dholakia
a3e9bc4ae2 fix(aws_secret_manager.py): fix litellm license check 2024-07-03 22:07:48 -07:00
Krish Dholakia
5e47970eed
Merge branch 'main' into litellm_anthropic_tool_calling_streaming_fix 2024-07-03 20:43:51 -07:00
Krrish Dholakia
2e5a81f280 fix(utils.py): stream_options working across all providers 2024-07-03 20:40:46 -07:00
Krrish Dholakia
8dbe0559dd fix(utils.py): stream_options fix 2024-07-03 19:57:34 -07:00
Ishaan Jaff
046b9d8f66 fix lakera ai testing 2024-07-03 18:58:36 -07:00
Ishaan Jaff
1028be6308 feat- control lakera ai per llm call 2024-07-03 16:34:23 -07:00
Ishaan Jaff
80dd14d59e test - default on/off guardrails 2024-07-03 14:50:13 -07:00
Ishaan Jaff
b1e6cee000
Merge branch 'main' into litellm_allow_setting_guardrails_config 2024-07-03 14:21:51 -07:00
Ishaan Jaff
129c2e0c4f init guardrails on proxy 2024-07-03 14:18:12 -07:00
Ishaan Jaff
50443d3d48 fix checks on litellm license 2024-07-03 14:02:07 -07:00
Krrish Dholakia
c6962bda80 fix(user_api_key_auth.py): expose /health as an info route
this still requires key access. Allows users to check model health
2024-07-03 10:02:50 -07:00
Krrish Dholakia
606d04b05b fix(_service_logging.py): only trigger otel if in service_callback
Fixes https://github.com/BerriAI/litellm/issues/4511
2024-07-03 09:48:38 -07:00
Krish Dholakia
21d3a28e51
Merge branch 'main' into litellm_support_dynamic_rpm_limiting 2024-07-02 17:51:18 -07:00
Ishaan Jaff
174b2b69df
Merge pull request #4518 from BerriAI/litellm_fix_background_health_checks
[Fix-Proxy] Background health checks use deep copy of model list for _run_background_health_check
2024-07-02 16:42:34 -07:00
Krrish Dholakia
66c6992f8a fix(slack_alerting.py): use in-memory cache for checking request status 2024-07-02 13:01:59 -07:00
Ishaan Jaff
cd6b121642 use deep copy of router for _run_background_health_check 2024-07-02 11:29:24 -07:00
Krrish Dholakia
5aae2313f3 fix(aws_secret_manager.py): fix string replace 2024-07-02 00:42:12 -07:00
Krrish Dholakia
196b94455e fix(dynamic_rate_limiter.py): add rpm allocation, priority + quota reservation to docs 2024-07-01 23:35:42 -07:00