Commit graph

2701 commits

Author SHA1 Message Date
Ishaan Jaff
bfae8c3da6 example config with public routes 2024-06-27 20:20:29 -07:00
Ishaan Jaff
e30410f700 feat - allow user to define public routes 2024-06-27 20:20:29 -07:00
Krrish Dholakia
6f2f89d7b2 fix(vertex_httpx.py): cover gemini content violation (on prompt) 2024-06-27 20:20:29 -07:00
Krrish Dholakia
2e588c0685 fix(router.py): use user-defined model_input_tokens for pre-call filter checks 2024-06-27 20:20:29 -07:00
Ishaan Jaff
b2302bf224 fix ui login bug 2024-06-27 20:20:29 -07:00
Krrish Dholakia
7f54c90459 fix(add-exception-mapping-+-langfuse-exception-logging-for-streaming-exceptions): add exception mapping + langfuse exception logging for streaming exceptions
Fixes https://github.com/BerriAI/litellm/issues/4338
2024-06-27 20:20:29 -07:00
Krrish Dholakia
f479cd549f fix(router.py): check if azure returns 'content_filter' response + fallback available -> fallback
Exception maps azure content filter response exceptions
2024-06-27 20:20:18 -07:00
Krrish Dholakia
c14cc35e52 feat(azure.py): azure tts support
Closes https://github.com/BerriAI/litellm/issues/4002
2024-06-27 16:59:25 -07:00
Ishaan Jaff
0cd25c250d
Merge pull request #4447 from BerriAI/litellm_fix_error_on_v2_model_info
[fix] error message on /v2/model info when no models exist
2024-06-27 16:33:19 -07:00
Ishaan Jaff
0c6cd2c894 fix error message on v2/model info 2024-06-27 16:29:11 -07:00
Krrish Dholakia
d421486a45 fix(token_counter.py): New `get_modified_max_tokens' helper func
Fixes https://github.com/BerriAI/litellm/issues/4439
2024-06-27 15:38:09 -07:00
Ishaan Jaff
80960facfa fix secret redaction logic 2024-06-27 13:19:54 -07:00
Krrish Dholakia
adcd55fca0 fix(initial-commit): decrypts aws keys in entrypoint.sh 2024-06-26 22:33:26 -07:00
Krrish Dholakia
f533e1da09 fix(utils.py): return 'response_cost' in completion call
Closes https://github.com/BerriAI/litellm/issues/4335
2024-06-26 17:55:57 -07:00
Ishaan Jaff
8ecf15185b
Merge pull request #4423 from BerriAI/litellm_forward_traceparent_otel
[Fix] Forward OTEL Traceparent Header to provider
2024-06-26 17:16:23 -07:00
Ishaan Jaff
e0258708c7 fix cost tracking for whisper 2024-06-26 14:21:57 -07:00
Ishaan Jaff
b16b846711 forward otel traceparent in request headers 2024-06-26 12:31:28 -07:00
Ishaan Jaff
9942a5cbcf
Merge branch 'main' into litellm_add_secret_detection 2024-06-25 18:08:51 -07:00
Ishaan Jaff
66f0d6ae8f test secret detection 2024-06-25 17:27:02 -07:00
Ishaan Jaff
38ec55bd95
Merge pull request #4409 from BerriAI/litellm_enforce_premium_license_in_vpc
enterprise - allow verifying license in air gapped vpc
2024-06-25 16:29:57 -07:00
Ishaan Jaff
4abb83b12d fix only use crypto imports when needed 2024-06-25 16:28:47 -07:00
Ishaan Jaff
e22c9ba0cc init secret detection callback 2024-06-25 16:25:14 -07:00
Krrish Dholakia
e813e984f7 fix(predibase.py): support json schema on predibase 2024-06-25 16:03:47 -07:00
Ishaan Jaff
4c99010eee fix - verify license without api request 2024-06-25 13:55:54 -07:00
Krrish Dholakia
6889a4c0dd fix(utils.py): predibase exception mapping - map 424 as a badrequest error 2024-06-25 13:47:38 -07:00
Krrish Dholakia
cccc55213b fix(router.py): improve error message returned for fallbacks 2024-06-25 11:27:20 -07:00
Krrish Dholakia
0396d484fb feat(router.py): support mock testing content policy + context window fallbacks 2024-06-25 10:58:19 -07:00
Ishaan Jaff
b9f83f48ba
Merge pull request #4364 from BerriAI/litellm_use_tracemalloc_mem_usage
[Feat]  add endpoint to debug memory util
2024-06-25 10:32:52 -07:00
Ishaan Jaff
a9d1be71ff
Merge pull request #4395 from BerriAI/litelm_use_spend_calc_aliases
Fix /spend/calculate use model_group_alias when set
2024-06-24 21:15:05 -07:00
Ishaan Jaff
9e7d8ba910 /spend/calculate use model aliases on this endpoint 2024-06-24 21:14:00 -07:00
Krish Dholakia
9902947521
Merge pull request #4390 from BerriAI/litellm_langfuse_router_logging
Log rejected router requests to langfuse
2024-06-24 21:13:45 -07:00
Ishaan Jaff
37f2712bba
Merge pull request #4389 from BerriAI/litellm_allow_user_to_define_public_routes
[Feat-Enterprise] - Allow setting custom public routes
2024-06-24 20:23:35 -07:00
Krish Dholakia
5d570e7c6c
Merge pull request #4392 from BerriAI/litellm_gemini_content_policy_errors
fix(vertex_httpx.py): cover gemini content violation (on prompt)
2024-06-24 20:00:06 -07:00
Ishaan Jaff
2aa0ce50b5 fix importing litellm 2024-06-24 19:58:53 -07:00
Ishaan Jaff
bd2298eba4 example cofnig with public routes 2024-06-24 19:51:23 -07:00
Ishaan Jaff
5e1403cd0a add helper to check route_in_additonal_public_routes 2024-06-24 19:50:35 -07:00
Ishaan Jaff
11117665e1 test - spend/calculate endpoints 2024-06-24 19:32:52 -07:00
Krrish Dholakia
1ff0129a94 fix(vertex_httpx.py): cover gemini content violation (on prompt) 2024-06-24 19:13:56 -07:00
Ishaan Jaff
02ffed2545 feat - refactor /spend/calculate 2024-06-24 19:05:34 -07:00
Krrish Dholakia
a4bea47a2d fix(router.py): log rejected router requests to langfuse
Fixes issue where rejected requests weren't being logged
2024-06-24 17:52:01 -07:00
Ishaan Jaff
5309be2456 example config with public routes 2024-06-24 17:46:38 -07:00
Ishaan Jaff
2f90759db5 feat - allow user to define public routes 2024-06-24 17:45:13 -07:00
Krrish Dholakia
f5fbdf0fee fix(router.py): use user-defined model_input_tokens for pre-call filter checks 2024-06-24 17:25:26 -07:00
Ishaan Jaff
dd048cf342
Merge pull request #4382 from BerriAI/litellm_ui_fix_login_bug
[Fix] - Admin UI login bug
2024-06-24 08:19:37 -07:00
Ishaan Jaff
acbcfef5af fix ui login bug 2024-06-24 07:54:08 -07:00
Krish Dholakia
0454c0781a
Merge branch 'main' into litellm_azure_content_filter_fallbacks 2024-06-22 21:28:29 -07:00
Krrish Dholakia
cea630022e fix(add-exception-mapping-+-langfuse-exception-logging-for-streaming-exceptions): add exception mapping + langfuse exception logging for streaming exceptions
Fixes https://github.com/BerriAI/litellm/issues/4338
2024-06-22 21:26:15 -07:00
Krish Dholakia
961e7ac95d
Merge branch 'main' into litellm_dynamic_tpm_limits 2024-06-22 19:14:59 -07:00
Krrish Dholakia
2c7a80d08d fix(router.py): check if azure returns 'content_filter' response + fallback available -> fallback
Exception maps azure content filter response exceptions
2024-06-22 19:10:15 -07:00
Ishaan Jaff
3105eaebc3 feat - add debug_utils 2024-06-22 16:12:42 -07:00