phoenix/litellm-mirror
0
0
Fork 1
mirror of https://github.com/BerriAI/litellm.git synced 2025-04-27 11:43:54 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions
13639 commits 2497 branches 897 tags 550 MiB
Commit graph

8471 commits

Author SHA1 Message Date
Krrish Dholakia
1ff0129a94 fix(vertex_httpx.py): cover gemini content violation (on prompt) 2024-06-24 19:13:56 -07:00
Krrish Dholakia
123477b55a fix(utils.py): fix exception_mapping check for errors 
If exception already mapped - don't attach traceback to it
 2024-06-24 16:55:19 -07:00
Ishaan Jaff
dd048cf342
Merge pull request #4382 from BerriAI/litellm_ui_fix_login_bug 
[Fix] - Admin UI login bug
 2024-06-24 08:19:37 -07:00
Ishaan Jaff
acbcfef5af fix ui login bug 2024-06-24 07:54:08 -07:00
7HR4IZ3
515dc9acc7
fix: Lunary integration 
Fixes the bug of litellm not logging system messages to lunary
 2024-06-24 14:09:40 +01:00
Krrish Dholakia
769c60e4f6 test: skip unstable tests 2024-06-23 00:30:45 -07:00
Krrish Dholakia
3d09a196a4 test(test_completion.py): handle replicate api error 2024-06-23 00:06:15 -07:00
Krrish Dholakia
9cff2b03f3 test(test_proxy_server_langfuse.py): cleanup tests causing OOM issues. 2024-06-22 23:53:18 -07:00
Krrish Dholakia
d857d82b0e fix(redact_messages.py): fix pr 2024-06-22 23:27:13 -07:00
Krrish Dholakia
9450d2cf77 fix(test_dynamic_rate_limit_handler.py): cleanup 2024-06-22 22:43:56 -07:00
Krrish Dholakia
dc43ffb771 fix(redact_messages.py): fix get 2024-06-22 21:57:54 -07:00
Krish Dholakia
9bffa9a48e
Merge pull request #4352 from msabramo/msabramo/turn-on-message-logging-via-request-header 
Disable message redaction in logs via request header
 2024-06-22 21:30:41 -07:00
Krish Dholakia
0454c0781a
Merge branch 'main' into litellm_azure_content_filter_fallbacks 2024-06-22 21:28:29 -07:00
Krrish Dholakia
cea630022e fix(add-exception-mapping-+-langfuse-exception-logging-for-streaming-exceptions): add exception mapping + langfuse exception logging for streaming exceptions 
Fixes https://github.com/BerriAI/litellm/issues/4338
 2024-06-22 21:26:15 -07:00
Krrish Dholakia
0fd9033502 fix(vertex_httpx.py): flush remaining chunks from stream 2024-06-22 20:33:54 -07:00
Krrish Dholakia
73254987da fix(vertex_httpx.py): ignore vertex finish reason - wait for stream to end 
Fixes https://github.com/BerriAI/litellm/issues/4339
 2024-06-22 20:21:01 -07:00
Krish Dholakia
961e7ac95d
Merge branch 'main' into litellm_dynamic_tpm_limits 2024-06-22 19:14:59 -07:00
Krrish Dholakia
2c7a80d08d fix(router.py): check if azure returns 'content_filter' response + fallback available -> fallback 
Exception maps azure content filter response exceptions
 2024-06-22 19:10:15 -07:00
Krrish Dholakia
c4b1540ce0 fix(utils.py): support streamingchoices in 'get_response_string 2024-06-22 15:45:52 -07:00
Krrish Dholakia
bae7377128 docs(team_budgets.md): fix script 
/
 2024-06-22 15:42:05 -07:00
Krrish Dholakia
fc4e900a23 docs(team_budgets.md): update docs with script for testing dynamic rate limiting 2024-06-22 15:26:58 -07:00
Krrish Dholakia
a31a05d45d feat(dynamic_rate_limiter.py): working e2e 2024-06-22 14:41:22 -07:00
Ishaan Jaff
cb828a464a fix langfuse tests in_memory_langfuse_clients 2024-06-22 13:59:36 -07:00
Ishaan Jaff
ab38a90be0 fix /audio/speech 2024-06-22 13:45:34 -07:00
Ishaan Jaff
c44e5a3d93 testing - use in memory langfuse client cache 2024-06-22 13:40:34 -07:00
Ishaan Jaff
b201402b0b fix testing - we had two files running the exact same langfuse test 2024-06-22 13:32:28 -07:00
Ishaan Jaff
c4f6b903b3 ui - new build 2024-06-22 09:13:34 -07:00
Ishaan Jaff
1a4ddf9a8e
Merge pull request #4356 from BerriAI/litellm_test_routes_on_proxy 
[Test] Test routes on LiteLLM Proxy always includes OpenAI Routes
 2024-06-22 09:12:30 -07:00
Ishaan Jaff
d32b8d589b
Merge pull request #4357 from BerriAI/litellm_use_jwt_in_cookies 
[Security Fix - Proxy Server ADMIN UI] - Store credentials in cookies + use strong JWT signing secret
 2024-06-22 09:12:17 -07:00
Krrish Dholakia
f814f24d9d fix(litellm_logging.py): Fix gemini google ai studio system prompt logging 
Fixes https://github.com/BerriAI/litellm/issues/2963
 2024-06-22 09:11:23 -07:00
Ishaan Jaff
c86efa55a5 use hash of master key encode the jwt 2024-06-22 08:58:31 -07:00
Ishaan Jaff
03d1d9229d ui - use cookies to return JWTs 2024-06-22 08:50:26 -07:00
Ishaan Jaff
b2a1cadf8c test test_routes_on_litellm_proxy 2024-06-22 08:19:17 -07:00
Krrish Dholakia
532f24bfb7 refactor: instrument 'dynamic_rate_limiting' callback on proxy 2024-06-22 00:32:29 -07:00
Krish Dholakia
f192b76ed4
Merge pull request #4344 from BerriAI/litellm_refactor_langfuse_slack_trace_url 
refactor(litellm_logging.py): refactors how slack_alerting generates langfuse trace url
 2024-06-21 23:37:38 -07:00
Krrish Dholakia
068e8dff5b feat(dynamic_rate_limiter.py): passing base case 2024-06-21 22:46:46 -07:00
Marc Abramowitz
b7452cb383 Rename request header 2024-06-21 21:52:55 -07:00
Krrish Dholakia
5e893ed13e fix(utils.py): Fix anthropic tool calling exception mapping 
Fixes https://github.com/BerriAI/litellm/issues/4348
 2024-06-21 21:20:49 -07:00
Krrish Dholakia
000d678445 fix(utils.py): improve coverage for anthropic exception mapping 2024-06-21 21:15:10 -07:00
Ishaan Jaff
24addd8a4f fix test test_router_completion_streaming 2024-06-21 21:02:34 -07:00
Ishaan Jaff
b4d95e740e fix get_logging_payload 2024-06-21 20:42:28 -07:00
Krrish Dholakia
a028600932 feat(dynamic_rate_limiter.py): update cache with active project 2024-06-21 20:25:40 -07:00
Marc Abramowitz
91e2b661ca Turn on message logging via request header 2024-06-21 20:21:19 -07:00
Steven Osborn
0ab6a18516 Print content window fallbacks on startup to help verify configuration 2024-06-21 19:43:26 -07:00
Krrish Dholakia
2545da777b feat(dynamic_rate_limiter.py): initial commit for dynamic rate limiting 
Closes https://github.com/BerriAI/litellm/issues/4124
 2024-06-21 18:41:31 -07:00
Ishaan Jaff
662cb5a5ec ui - new build 2024-06-21 18:12:12 -07:00
Ishaan Jaff
6b63b663b9
Merge pull request #4345 from BerriAI/litellm_fix_cost_tracking_tags 
[Fix + Test] -  Spend tags not getting stored on 1.40.9
 2024-06-21 17:34:27 -07:00
Krrish Dholakia
06b297a6e8 fix(router.py): fix set_client init to check if custom_llm_provider is azure not if in model name 
fixes issue where 'azure_ai/' was being init as azureopenai client
 2024-06-21 17:09:20 -07:00
Ishaan Jaff
fff928b10b fix testing spend_tracking 2024-06-21 16:52:42 -07:00
Ishaan Jaff
29c2155796 fix cost tracking by tags 2024-06-21 16:49:57 -07:00