Commit graph

2778 commits

Author SHA1 Message Date
Krrish Dholakia
f3cc57bc6f feat(user_api_key_auth.py): allow restricting calls by IP address
Allows admin to restrict which IP addresses can make calls to the proxy
2024-07-08 15:58:15 -07:00
Ishaan Jaff
6930881891
Merge pull request #4611 from BerriAI/litellm_fix_assistants_routes
[Proxy-Fix]: Add /assistants, /threads as OpenAI routes
2024-07-08 15:16:11 -07:00
Ishaan Jaff
9d5853943a fix routes on assistants endpoints 2024-07-08 15:02:12 -07:00
Andres Guzman
a650160390 fix(utils.py): change update to upsert 2024-07-08 15:49:29 -06:00
Ishaan Jaff
5c0d4a4162 use ProxyErrorTypes, 2024-07-08 12:47:53 -07:00
Ishaan Jaff
25ddbbb41d raise budget_exceeded in user_api_key_auth 2024-07-08 12:45:39 -07:00
Ishaan Jaff
c6256284da use types for ProxyErrorTypes 2024-07-08 12:42:27 -07:00
Ishaan Jaff
fad595fd47
Merge pull request #4603 from BerriAI/litellm_track_user_ip
[Enterprise-Feature: Proxy] Track user-ip address in requests & in LiteLLM_SpendLogs
2024-07-08 12:18:52 -07:00
Ishaan Jaff
b99ffcf8ae SpendLogsPayload- track user ip 2024-07-08 10:16:58 -07:00
Krrish Dholakia
298505c47c fix(whisper---handle-openai/azure-vtt-response-format): Fixes https://github.com/BerriAI/litellm/issues/4595 2024-07-08 09:10:40 -07:00
Ishaan Jaff
626c630eaf track user_ip address per request 2024-07-08 09:00:08 -07:00
Ishaan Jaff
bbf3de74dd fix - setting rpm/tpm 2024-07-08 07:43:00 -07:00
Krrish Dholakia
1193ee8803 fix(presidio_pii_masking.py): fix presidio unset url check + add same check for langfuse 2024-07-06 17:50:55 -07:00
Krrish Dholakia
d57d3df1d6 fix(presidio_pii_masking.py): add support for setting 'http://' if unset by render env for presidio base url 2024-07-06 17:42:10 -07:00
Krrish Dholakia
20e39d6acc fix(utils.py): cleanup 'additionalProperties=False' for tool calling with zod
Fixes issue with zod passing in additionalProperties=False, causing vertex ai / gemini calls to fail
2024-07-06 17:27:37 -07:00
Ishaan Jaff
196884a779 fix trace hierarchy on otel 2024-07-06 15:37:23 -07:00
Ishaan Jaff
547f6ffdd5 ui new build 2024-07-06 15:26:26 -07:00
Ishaan Jaff
e815563638
Merge pull request #4578 from BerriAI/litellm_allow_querying_spend_report_by_key
[Feat-Enterprise] /spend/report view spend for a specific key
2024-07-06 15:11:46 -07:00
Ishaan Jaff
d61cc598b0
Merge pull request #4576 from BerriAI/litellm_encrypt_decrypt_using_salt
[Refactor] Use helper function to encrypt/decrypt model credentials
2024-07-06 15:11:09 -07:00
Krish Dholakia
127f08ee67
Merge branch 'main' into litellm_tts_pricing 2024-07-06 14:57:34 -07:00
Krish Dholakia
b3ef1ac18c
Merge branch 'main' into litellm_proxy_tts_pricing 2024-07-06 14:56:16 -07:00
Krrish Dholakia
27e9f96380 fix(main.py): fix stream_chunk_builder usage calc
Closes https://github.com/BerriAI/litellm/issues/4496
2024-07-06 14:52:59 -07:00
Ishaan Jaff
f691ff7005 get spend per internal user / api_key 2024-07-06 14:45:58 -07:00
Ishaan Jaff
3623d49c2f /spend/report view spend for a specific key 2024-07-06 14:24:29 -07:00
Ishaan Jaff
c268ead43f fix links on admin ui 2024-07-06 14:00:49 -07:00
Ishaan Jaff
7f6f85ec3c improve sign up flow - show missing env vars 2024-07-06 13:57:19 -07:00
Ishaan Jaff
bf9e85c8d1 use a salt key for encrypt/decryption 2024-07-06 13:27:44 -07:00
Ishaan Jaff
a5d9a6cebd init litellm router 2024-07-06 13:14:04 -07:00
Ishaan Jaff
2e956f7c01 fix checking store_model_in_deb 2024-07-06 11:35:28 -07:00
Ishaan Jaff
6b2856e064 fix decrypt value logic 2024-07-06 11:26:12 -07:00
Krish Dholakia
ea9718a848
Merge branch 'main' into litellm_proxy_tts_pricing 2024-07-06 11:16:07 -07:00
Krrish Dholakia
71edb28d6a fix(proxy_server.py): fix embedding model exception mapping 2024-07-06 11:14:41 -07:00
Ishaan Jaff
8f0b55879f move encrypt / decrypt to helper 2024-07-06 11:09:47 -07:00
Ishaan Jaff
4e7a99e0f9 fix - make encrypt / decrypt helpers 2024-07-06 11:08:30 -07:00
Krrish Dholakia
6e43cdcb17 feat(litellm_logging.py): support cost tracking for tts calls 2024-07-05 22:09:08 -07:00
Ishaan Jaff
51e7099b13
Merge pull request #4569 from BerriAI/litelm_control_guardrails_api_key
feat - control guardrails per api key
2024-07-05 19:56:15 -07:00
Ishaan Jaff
22e31cb1ed feat - control guardrails per api key 2024-07-05 19:39:07 -07:00
Krrish Dholakia
6090fd37fa fix(test_proxy_reject_logging.py): fix test 2024-07-05 19:09:37 -07:00
Krrish Dholakia
fd11f63f71 fix(utils.py): log failure to sync failure callbacks as well 2024-07-05 14:49:34 -07:00
Krrish Dholakia
b1b21b0340 fix(proxy/utils.py): support logging rejected requests to langfuse, etc. 2024-07-05 14:39:35 -07:00
Krrish Dholakia
d528b66db0 fix(proxy_server.py): fix callback check order 2024-07-05 14:06:33 -07:00
Krrish Dholakia
7618ec43b3 fix(proxy_server.py): support langfuse logging for rejected requests on /v1/chat/completions 2024-07-05 13:07:09 -07:00
Krrish Dholakia
3ece295bf7 fix(litellm_license.py): add better error logs 2024-07-04 21:07:10 -07:00
Krrish Dholakia
ffcf9e695f feat(internal_user_endpoints.py): expose /user/delete endpoint 2024-07-04 17:01:16 -07:00
Krish Dholakia
aebcdc04ff
Merge pull request #4386 from BerriAI/litellm_user_delete_endpoint
feat(internal_user_endpoints.py): expose `/user/delete` endpoint
2024-07-04 16:38:31 -07:00
Krrish Dholakia
f2dabc65be fix(anthropic.py): fix anthropic tool calling + streaming
Fixes https://github.com/BerriAI/litellm/issues/4537
2024-07-04 16:30:24 -07:00
Krrish Dholakia
86632f6da0 fix(types/router.py): add custom pricing info to 'model_info'
Fixes https://github.com/BerriAI/litellm/issues/4542
2024-07-04 16:07:58 -07:00
Ishaan Jaff
3460a96c8a ui new build 2024-07-04 15:58:20 -07:00
Ishaan Jaff
c1c2f9faa4 fix backend invite link sign up 2024-07-04 15:55:04 -07:00
Ishaan Jaff
a457aec761 add doc string for v1/model/info 2024-07-04 13:21:02 -07:00