Commit graph

2873 commits

Author SHA1 Message Date
Ishaan Jaff
4202be8e1f raise budget_exceeded in user_api_key_auth 2024-07-08 12:45:39 -07:00
Ishaan Jaff
d3fc5d4a17 use types for ProxyErrorTypes 2024-07-08 12:42:27 -07:00
Ishaan Jaff
113f625469 Merge pull request #4603 from BerriAI/litellm_track_user_ip
[Enterprise-Feature: Proxy] Track user-ip address in requests & in LiteLLM_SpendLogs
2024-07-08 12:18:52 -07:00
Ishaan Jaff
78839eb46e SpendLogsPayload- track user ip 2024-07-08 10:16:58 -07:00
Krrish Dholakia
d68ab2a8bc fix(whisper---handle-openai/azure-vtt-response-format): Fixes https://github.com/BerriAI/litellm/issues/4595 2024-07-08 09:10:40 -07:00
Ishaan Jaff
7bbf4047e7 track user_ip address per request 2024-07-08 09:00:08 -07:00
Ishaan Jaff
af4bdae066 fix - setting rpm/tpm 2024-07-08 07:43:00 -07:00
Krrish Dholakia
bcd7358daf fix(presidio_pii_masking.py): fix presidio unset url check + add same check for langfuse 2024-07-06 17:50:55 -07:00
Krrish Dholakia
e424fea721 fix(presidio_pii_masking.py): add support for setting 'http://' if unset by render env for presidio base url 2024-07-06 17:42:10 -07:00
Krrish Dholakia
1dae0a5b6a fix(utils.py): cleanup 'additionalProperties=False' for tool calling with zod
Fixes issue with zod passing in additionalProperties=False, causing vertex ai / gemini calls to fail
2024-07-06 17:27:37 -07:00
Ishaan Jaff
202f34fff5 fix trace hierarchy on otel 2024-07-06 15:37:23 -07:00
Ishaan Jaff
8f5ce1a3ad ui new build 2024-07-06 15:26:26 -07:00
Ishaan Jaff
76bb824f59 Merge pull request #4578 from BerriAI/litellm_allow_querying_spend_report_by_key
[Feat-Enterprise] /spend/report view spend for a specific key
2024-07-06 15:11:46 -07:00
Ishaan Jaff
f96c0efd90 Merge pull request #4576 from BerriAI/litellm_encrypt_decrypt_using_salt
[Refactor] Use helper function to encrypt/decrypt model credentials
2024-07-06 15:11:09 -07:00
Krish Dholakia
ece24015cc Merge branch 'main' into litellm_tts_pricing 2024-07-06 14:57:34 -07:00
Krish Dholakia
5640ed4c8c Merge branch 'main' into litellm_proxy_tts_pricing 2024-07-06 14:56:16 -07:00
Krrish Dholakia
f89632f5ac fix(main.py): fix stream_chunk_builder usage calc
Closes https://github.com/BerriAI/litellm/issues/4496
2024-07-06 14:52:59 -07:00
Ishaan Jaff
37108765eb get spend per internal user / api_key 2024-07-06 14:45:58 -07:00
Ishaan Jaff
ae19965ea8 /spend/report view spend for a specific key 2024-07-06 14:24:29 -07:00
Ishaan Jaff
46b1f8ba2b fix links on admin ui 2024-07-06 14:00:49 -07:00
Ishaan Jaff
752fe3ac7c improve sign up flow - show missing env vars 2024-07-06 13:57:19 -07:00
Ishaan Jaff
fa4aeab197 use a salt key for encrypt/decryption 2024-07-06 13:27:44 -07:00
Ishaan Jaff
3f3594f106 init litellm router 2024-07-06 13:14:04 -07:00
Ishaan Jaff
9d7b03d31c fix checking store_model_in_deb 2024-07-06 11:35:28 -07:00
Ishaan Jaff
05667f75f2 fix decrypt value logic 2024-07-06 11:26:12 -07:00
Krish Dholakia
9217151b74 Merge branch 'main' into litellm_proxy_tts_pricing 2024-07-06 11:16:07 -07:00
Krrish Dholakia
47ce6ccac0 fix(proxy_server.py): fix embedding model exception mapping 2024-07-06 11:14:41 -07:00
Ishaan Jaff
561a30dd59 move encrypt / decrypt to helper 2024-07-06 11:09:47 -07:00
Ishaan Jaff
fd578477e5 fix - make encrypt / decrypt helpers 2024-07-06 11:08:30 -07:00
Krrish Dholakia
356c18c929 feat(litellm_logging.py): support cost tracking for tts calls 2024-07-05 22:09:08 -07:00
Ishaan Jaff
201dfe6161 Merge pull request #4569 from BerriAI/litelm_control_guardrails_api_key
feat - control guardrails per api key
2024-07-05 19:56:15 -07:00
Ishaan Jaff
68df5449c0 feat - control guardrails per api key 2024-07-05 19:39:07 -07:00
Krrish Dholakia
faf11c3a3e fix(test_proxy_reject_logging.py): fix test 2024-07-05 19:09:37 -07:00
Krrish Dholakia
fe889c47db fix(utils.py): log failure to sync failure callbacks as well 2024-07-05 14:49:34 -07:00
Krrish Dholakia
deb7a86e9c fix(proxy/utils.py): support logging rejected requests to langfuse, etc. 2024-07-05 14:39:35 -07:00
Krrish Dholakia
9f039a9776 fix(proxy_server.py): fix callback check order 2024-07-05 14:06:33 -07:00
Krrish Dholakia
56410cfcd0 fix(proxy_server.py): support langfuse logging for rejected requests on /v1/chat/completions 2024-07-05 13:07:09 -07:00
Krrish Dholakia
4fea3c0b59 fix(litellm_license.py): add better error logs 2024-07-04 21:07:10 -07:00
Krrish Dholakia
b332ee3a59 feat(internal_user_endpoints.py): expose /user/delete endpoint 2024-07-04 17:01:16 -07:00
Krish Dholakia
d7244be254 Merge pull request #4386 from BerriAI/litellm_user_delete_endpoint
feat(internal_user_endpoints.py): expose `/user/delete` endpoint
2024-07-04 16:38:31 -07:00
Krrish Dholakia
00497b408d fix(anthropic.py): fix anthropic tool calling + streaming
Fixes https://github.com/BerriAI/litellm/issues/4537
2024-07-04 16:30:24 -07:00
Krrish Dholakia
8625770010 fix(types/router.py): add custom pricing info to 'model_info'
Fixes https://github.com/BerriAI/litellm/issues/4542
2024-07-04 16:07:58 -07:00
Ishaan Jaff
b8fa4023ea ui new build 2024-07-04 15:58:20 -07:00
Ishaan Jaff
bf674b7a9a fix backend invite link sign up 2024-07-04 15:55:04 -07:00
Ishaan Jaff
53412d4dde add doc string for v1/model/info 2024-07-04 13:21:02 -07:00
Ishaan Jaff
4af5531834 feat - allow looking up model_id in model info 2024-07-04 13:13:42 -07:00
Krrish Dholakia
23571c59c7 fix(aws_secret_manager.py): fix litellm license check 2024-07-03 22:07:48 -07:00
Krish Dholakia
06c6c65d2a Merge branch 'main' into litellm_anthropic_tool_calling_streaming_fix 2024-07-03 20:43:51 -07:00
Krrish Dholakia
84044c08b6 fix(utils.py): stream_options working across all providers 2024-07-03 20:40:46 -07:00
Krrish Dholakia
150cfb68d5 fix(utils.py): stream_options fix 2024-07-03 19:57:34 -07:00