Commit graph

2873 commits

Author SHA1 Message Date
Ishaan Jaff
196d15967b fix pre call utils adding extra headers 2024-06-27 21:03:36 -07:00
Ishaan Jaff
1592de0b7f fix error message on v2/model info 2024-06-27 20:20:47 -07:00
Ishaan Jaff
fc8714fc9c fix secret redaction logic 2024-06-27 20:20:46 -07:00
Ishaan Jaff
0ac77551be forward otel traceparent in request headers 2024-06-27 20:20:46 -07:00
Ishaan Jaff
0bdbe55c7d fix cost tracking for whisper 2024-06-27 20:20:46 -07:00
Ishaan Jaff
8bde270d86 fix only use crypto imports when needed 2024-06-27 20:20:46 -07:00
Ishaan Jaff
bcde3ee27a fix - verify license without api request 2024-06-27 20:20:46 -07:00
Krrish Dholakia
bb098a8e5f fix(predibase.py): support json schema on predibase 2024-06-27 20:20:31 -07:00
Krrish Dholakia
111c20bdc1 fix(utils.py): predibase exception mapping - map 424 as a badrequest error 2024-06-27 20:20:31 -07:00
Ishaan Jaff
a5d40c2145 test secret detection 2024-06-27 20:20:31 -07:00
Ishaan Jaff
4c2d594bc7 init secret detection callback 2024-06-27 20:20:31 -07:00
Krrish Dholakia
d4ed74e946 fix(router.py): improve error message returned for fallbacks 2024-06-27 20:20:30 -07:00
Krrish Dholakia
a7aa8e28bd feat(router.py): support mock testing content policy + context window fallbacks 2024-06-27 20:20:30 -07:00
Ishaan Jaff
0a71b2e7b6 feat - add debug_utils 2024-06-27 20:20:30 -07:00
Ishaan Jaff
e6e614f8d0 /spend/calculate use model aliases on this endpoint 2024-06-27 20:20:30 -07:00
Krrish Dholakia
744791c4e2 fix(router.py): log rejected router requests to langfuse
Fixes issue where rejected requests weren't being logged
2024-06-27 20:20:30 -07:00
Ishaan Jaff
f6e07bec16 fix importing litellm 2024-06-27 20:20:29 -07:00
Ishaan Jaff
f612a33548 example cofnig with public routes 2024-06-27 20:20:29 -07:00
Ishaan Jaff
905c656ba7 add helper to check route_in_additonal_public_routes 2024-06-27 20:20:29 -07:00
Ishaan Jaff
71c3aa9f22 test - spend/calculate endpoints 2024-06-27 20:20:29 -07:00
Ishaan Jaff
3d317c54a0 feat - refactor /spend/calculate 2024-06-27 20:20:29 -07:00
Ishaan Jaff
6022207c4d example config with public routes 2024-06-27 20:20:29 -07:00
Ishaan Jaff
d832b88099 feat - allow user to define public routes 2024-06-27 20:20:29 -07:00
Krrish Dholakia
8707e65ea1 fix(vertex_httpx.py): cover gemini content violation (on prompt) 2024-06-27 20:20:29 -07:00
Krrish Dholakia
b2afd57e34 fix(router.py): use user-defined model_input_tokens for pre-call filter checks 2024-06-27 20:20:29 -07:00
Ishaan Jaff
da1e804540 fix ui login bug 2024-06-27 20:20:29 -07:00
Krrish Dholakia
169a101ddd fix(add-exception-mapping-+-langfuse-exception-logging-for-streaming-exceptions): add exception mapping + langfuse exception logging for streaming exceptions
Fixes https://github.com/BerriAI/litellm/issues/4338
2024-06-27 20:20:29 -07:00
Krrish Dholakia
3f59b7cc1a fix(router.py): check if azure returns 'content_filter' response + fallback available -> fallback
Exception maps azure content filter response exceptions
2024-06-27 20:20:18 -07:00
Krrish Dholakia
58244ba71f feat(azure.py): azure tts support
Closes https://github.com/BerriAI/litellm/issues/4002
2024-06-27 16:59:25 -07:00
Ishaan Jaff
6fdbe82bfb Merge pull request #4447 from BerriAI/litellm_fix_error_on_v2_model_info
[fix] error message on /v2/model info when no models exist
2024-06-27 16:33:19 -07:00
Ishaan Jaff
096ec0aade fix error message on v2/model info 2024-06-27 16:29:11 -07:00
Krrish Dholakia
797a018bb0 fix(token_counter.py): New `get_modified_max_tokens' helper func
Fixes https://github.com/BerriAI/litellm/issues/4439
2024-06-27 15:38:09 -07:00
Ishaan Jaff
fde80eb117 fix secret redaction logic 2024-06-27 13:19:54 -07:00
Krrish Dholakia
6f7f75eece fix(initial-commit): decrypts aws keys in entrypoint.sh 2024-06-26 22:33:26 -07:00
Krrish Dholakia
be5d918211 fix(utils.py): return 'response_cost' in completion call
Closes https://github.com/BerriAI/litellm/issues/4335
2024-06-26 17:55:57 -07:00
Ishaan Jaff
f6735cab6e Merge pull request #4423 from BerriAI/litellm_forward_traceparent_otel
[Fix] Forward OTEL Traceparent Header to provider
2024-06-26 17:16:23 -07:00
Ishaan Jaff
108013e9fc fix cost tracking for whisper 2024-06-26 14:21:57 -07:00
Ishaan Jaff
0368c89dd8 forward otel traceparent in request headers 2024-06-26 12:31:28 -07:00
Ishaan Jaff
f60f2906aa Merge branch 'main' into litellm_add_secret_detection 2024-06-25 18:08:51 -07:00
Ishaan Jaff
7c88791775 test secret detection 2024-06-25 17:27:02 -07:00
Ishaan Jaff
9d297459bd Merge pull request #4409 from BerriAI/litellm_enforce_premium_license_in_vpc
enterprise - allow verifying license in air gapped vpc
2024-06-25 16:29:57 -07:00
Ishaan Jaff
9311879681 fix only use crypto imports when needed 2024-06-25 16:28:47 -07:00
Ishaan Jaff
14220712be init secret detection callback 2024-06-25 16:25:14 -07:00
Krrish Dholakia
91bbef4bcd fix(predibase.py): support json schema on predibase 2024-06-25 16:03:47 -07:00
Ishaan Jaff
99fd393353 fix - verify license without api request 2024-06-25 13:55:54 -07:00
Krrish Dholakia
1e51b8894f fix(utils.py): predibase exception mapping - map 424 as a badrequest error 2024-06-25 13:47:38 -07:00
Krrish Dholakia
715153b27b fix(router.py): improve error message returned for fallbacks 2024-06-25 11:27:20 -07:00
Krrish Dholakia
c46b229202 feat(router.py): support mock testing content policy + context window fallbacks 2024-06-25 10:58:19 -07:00
Ishaan Jaff
3bce8a2395 Merge pull request #4364 from BerriAI/litellm_use_tracemalloc_mem_usage
[Feat]  add endpoint to debug memory util
2024-06-25 10:32:52 -07:00
Ishaan Jaff
168c7af9da Merge pull request #4395 from BerriAI/litelm_use_spend_calc_aliases
Fix /spend/calculate use model_group_alias when set
2024-06-24 21:15:05 -07:00