Commit graph

2690 commits

Author SHA1 Message Date
Ishaan Jaff
80960facfa fix secret redaction logic 2024-06-27 13:19:54 -07:00
Krrish Dholakia
adcd55fca0 fix(initial-commit): decrypts aws keys in entrypoint.sh 2024-06-26 22:33:26 -07:00
Krrish Dholakia
f533e1da09 fix(utils.py): return 'response_cost' in completion call
Closes https://github.com/BerriAI/litellm/issues/4335
2024-06-26 17:55:57 -07:00
Ishaan Jaff
8ecf15185b
Merge pull request #4423 from BerriAI/litellm_forward_traceparent_otel
[Fix] Forward OTEL Traceparent Header to provider
2024-06-26 17:16:23 -07:00
Ishaan Jaff
e0258708c7 fix cost tracking for whisper 2024-06-26 14:21:57 -07:00
Ishaan Jaff
b16b846711 forward otel traceparent in request headers 2024-06-26 12:31:28 -07:00
Ishaan Jaff
9942a5cbcf
Merge branch 'main' into litellm_add_secret_detection 2024-06-25 18:08:51 -07:00
Ishaan Jaff
66f0d6ae8f test secret detection 2024-06-25 17:27:02 -07:00
Ishaan Jaff
38ec55bd95
Merge pull request #4409 from BerriAI/litellm_enforce_premium_license_in_vpc
enterprise - allow verifying license in air gapped vpc
2024-06-25 16:29:57 -07:00
Ishaan Jaff
4abb83b12d fix only use crypto imports when needed 2024-06-25 16:28:47 -07:00
Ishaan Jaff
e22c9ba0cc init secret detection callback 2024-06-25 16:25:14 -07:00
Krrish Dholakia
e813e984f7 fix(predibase.py): support json schema on predibase 2024-06-25 16:03:47 -07:00
Ishaan Jaff
4c99010eee fix - verify license without api request 2024-06-25 13:55:54 -07:00
Krrish Dholakia
6889a4c0dd fix(utils.py): predibase exception mapping - map 424 as a badrequest error 2024-06-25 13:47:38 -07:00
Krrish Dholakia
cccc55213b fix(router.py): improve error message returned for fallbacks 2024-06-25 11:27:20 -07:00
Krrish Dholakia
0396d484fb feat(router.py): support mock testing content policy + context window fallbacks 2024-06-25 10:58:19 -07:00
Ishaan Jaff
b9f83f48ba
Merge pull request #4364 from BerriAI/litellm_use_tracemalloc_mem_usage
[Feat]  add endpoint to debug memory util
2024-06-25 10:32:52 -07:00
Ishaan Jaff
a9d1be71ff
Merge pull request #4395 from BerriAI/litelm_use_spend_calc_aliases
Fix /spend/calculate use model_group_alias when set
2024-06-24 21:15:05 -07:00
Ishaan Jaff
9e7d8ba910 /spend/calculate use model aliases on this endpoint 2024-06-24 21:14:00 -07:00
Krish Dholakia
9902947521
Merge pull request #4390 from BerriAI/litellm_langfuse_router_logging
Log rejected router requests to langfuse
2024-06-24 21:13:45 -07:00
Ishaan Jaff
37f2712bba
Merge pull request #4389 from BerriAI/litellm_allow_user_to_define_public_routes
[Feat-Enterprise] - Allow setting custom public routes
2024-06-24 20:23:35 -07:00
Krish Dholakia
5d570e7c6c
Merge pull request #4392 from BerriAI/litellm_gemini_content_policy_errors
fix(vertex_httpx.py): cover gemini content violation (on prompt)
2024-06-24 20:00:06 -07:00
Ishaan Jaff
2aa0ce50b5 fix importing litellm 2024-06-24 19:58:53 -07:00
Ishaan Jaff
bd2298eba4 example cofnig with public routes 2024-06-24 19:51:23 -07:00
Ishaan Jaff
5e1403cd0a add helper to check route_in_additonal_public_routes 2024-06-24 19:50:35 -07:00
Ishaan Jaff
11117665e1 test - spend/calculate endpoints 2024-06-24 19:32:52 -07:00
Krrish Dholakia
1ff0129a94 fix(vertex_httpx.py): cover gemini content violation (on prompt) 2024-06-24 19:13:56 -07:00
Ishaan Jaff
02ffed2545 feat - refactor /spend/calculate 2024-06-24 19:05:34 -07:00
Krrish Dholakia
a4bea47a2d fix(router.py): log rejected router requests to langfuse
Fixes issue where rejected requests weren't being logged
2024-06-24 17:52:01 -07:00
Ishaan Jaff
5309be2456 example config with public routes 2024-06-24 17:46:38 -07:00
Ishaan Jaff
2f90759db5 feat - allow user to define public routes 2024-06-24 17:45:13 -07:00
Krrish Dholakia
f5fbdf0fee fix(router.py): use user-defined model_input_tokens for pre-call filter checks 2024-06-24 17:25:26 -07:00
Ishaan Jaff
dd048cf342
Merge pull request #4382 from BerriAI/litellm_ui_fix_login_bug
[Fix] - Admin UI login bug
2024-06-24 08:19:37 -07:00
Ishaan Jaff
acbcfef5af fix ui login bug 2024-06-24 07:54:08 -07:00
Krish Dholakia
0454c0781a
Merge branch 'main' into litellm_azure_content_filter_fallbacks 2024-06-22 21:28:29 -07:00
Krrish Dholakia
cea630022e fix(add-exception-mapping-+-langfuse-exception-logging-for-streaming-exceptions): add exception mapping + langfuse exception logging for streaming exceptions
Fixes https://github.com/BerriAI/litellm/issues/4338
2024-06-22 21:26:15 -07:00
Krish Dholakia
961e7ac95d
Merge branch 'main' into litellm_dynamic_tpm_limits 2024-06-22 19:14:59 -07:00
Krrish Dholakia
2c7a80d08d fix(router.py): check if azure returns 'content_filter' response + fallback available -> fallback
Exception maps azure content filter response exceptions
2024-06-22 19:10:15 -07:00
Ishaan Jaff
3105eaebc3 feat - add debug_utils 2024-06-22 16:12:42 -07:00
Krrish Dholakia
bae7377128 docs(team_budgets.md): fix script
/
2024-06-22 15:42:05 -07:00
Krrish Dholakia
fc4e900a23 docs(team_budgets.md): update docs with script for testing dynamic rate limiting 2024-06-22 15:26:58 -07:00
Krrish Dholakia
a31a05d45d feat(dynamic_rate_limiter.py): working e2e 2024-06-22 14:41:22 -07:00
Ishaan Jaff
ab38a90be0 fix /audio/speech 2024-06-22 13:45:34 -07:00
Ishaan Jaff
c4f6b903b3 ui - new build 2024-06-22 09:13:34 -07:00
Ishaan Jaff
c86efa55a5 use hash of master key encode the jwt 2024-06-22 08:58:31 -07:00
Ishaan Jaff
03d1d9229d ui - use cookies to return JWTs 2024-06-22 08:50:26 -07:00
Krrish Dholakia
532f24bfb7 refactor: instrument 'dynamic_rate_limiting' callback on proxy 2024-06-22 00:32:29 -07:00
Krish Dholakia
f192b76ed4
Merge pull request #4344 from BerriAI/litellm_refactor_langfuse_slack_trace_url
refactor(litellm_logging.py): refactors how slack_alerting generates langfuse trace url
2024-06-21 23:37:38 -07:00
Krrish Dholakia
068e8dff5b feat(dynamic_rate_limiter.py): passing base case 2024-06-21 22:46:46 -07:00
Ishaan Jaff
b4d95e740e fix get_logging_payload 2024-06-21 20:42:28 -07:00