Commit graph

2778 commits

Author SHA1 Message Date
Krrish Dholakia
224148d613 docs(anthropic.md): add claude-3-5-sonnet example to docs 2024-06-28 11:00:36 -07:00
Krish Dholakia
7b54c9d5bc
Merge pull request #4446 from BerriAI/litellm_get_max_modified_tokens
fix(token_counter.py): New `get_modified_max_tokens' helper func
2024-06-27 21:43:23 -07:00
Krish Dholakia
1223b2b111
Merge pull request #4449 from BerriAI/litellm_azure_tts
feat(azure.py): azure tts support
2024-06-27 21:33:38 -07:00
Krish Dholakia
869275585a
Merge branch 'main' into litellm_response_cost_headers 2024-06-27 21:33:09 -07:00
Ishaan Jaff
3bcf9dd9fb
Merge branch 'main' into litellm_fix_in_mem_usage 2024-06-27 21:12:06 -07:00
Ishaan Jaff
413877d1c6 fix pre call utils adding extra headers 2024-06-27 21:03:36 -07:00
Ishaan Jaff
4cffcb5f28 fix error message on v2/model info 2024-06-27 20:20:47 -07:00
Ishaan Jaff
9b98269f59 fix secret redaction logic 2024-06-27 20:20:46 -07:00
Ishaan Jaff
b9bc16590d forward otel traceparent in request headers 2024-06-27 20:20:46 -07:00
Ishaan Jaff
c0c715b905 fix cost tracking for whisper 2024-06-27 20:20:46 -07:00
Ishaan Jaff
882b6dcab4 fix only use crypto imports when needed 2024-06-27 20:20:46 -07:00
Ishaan Jaff
85f463dff5 fix - verify license without api request 2024-06-27 20:20:46 -07:00
Krrish Dholakia
aa9e542d21 fix(predibase.py): support json schema on predibase 2024-06-27 20:20:31 -07:00
Krrish Dholakia
adfb9cda79 fix(utils.py): predibase exception mapping - map 424 as a badrequest error 2024-06-27 20:20:31 -07:00
Ishaan Jaff
1962a24802 test secret detection 2024-06-27 20:20:31 -07:00
Ishaan Jaff
350e87f1d6 init secret detection callback 2024-06-27 20:20:31 -07:00
Krrish Dholakia
c45d93b93a fix(router.py): improve error message returned for fallbacks 2024-06-27 20:20:30 -07:00
Krrish Dholakia
9b47ba72cb feat(router.py): support mock testing content policy + context window fallbacks 2024-06-27 20:20:30 -07:00
Ishaan Jaff
e471aca81f feat - add debug_utils 2024-06-27 20:20:30 -07:00
Ishaan Jaff
c5020878e4 /spend/calculate use model aliases on this endpoint 2024-06-27 20:20:30 -07:00
Krrish Dholakia
690c7f6e47 fix(router.py): log rejected router requests to langfuse
Fixes issue where rejected requests weren't being logged
2024-06-27 20:20:30 -07:00
Ishaan Jaff
412c1fc541 fix importing litellm 2024-06-27 20:20:29 -07:00
Ishaan Jaff
e7ff5014b1 example cofnig with public routes 2024-06-27 20:20:29 -07:00
Ishaan Jaff
fa5eb5c96f add helper to check route_in_additonal_public_routes 2024-06-27 20:20:29 -07:00
Ishaan Jaff
556ef8dd18 test - spend/calculate endpoints 2024-06-27 20:20:29 -07:00
Ishaan Jaff
2cb4d845ae feat - refactor /spend/calculate 2024-06-27 20:20:29 -07:00
Ishaan Jaff
bfae8c3da6 example config with public routes 2024-06-27 20:20:29 -07:00
Ishaan Jaff
e30410f700 feat - allow user to define public routes 2024-06-27 20:20:29 -07:00
Krrish Dholakia
6f2f89d7b2 fix(vertex_httpx.py): cover gemini content violation (on prompt) 2024-06-27 20:20:29 -07:00
Krrish Dholakia
2e588c0685 fix(router.py): use user-defined model_input_tokens for pre-call filter checks 2024-06-27 20:20:29 -07:00
Ishaan Jaff
b2302bf224 fix ui login bug 2024-06-27 20:20:29 -07:00
Krrish Dholakia
7f54c90459 fix(add-exception-mapping-+-langfuse-exception-logging-for-streaming-exceptions): add exception mapping + langfuse exception logging for streaming exceptions
Fixes https://github.com/BerriAI/litellm/issues/4338
2024-06-27 20:20:29 -07:00
Krrish Dholakia
f479cd549f fix(router.py): check if azure returns 'content_filter' response + fallback available -> fallback
Exception maps azure content filter response exceptions
2024-06-27 20:20:18 -07:00
Krrish Dholakia
c14cc35e52 feat(azure.py): azure tts support
Closes https://github.com/BerriAI/litellm/issues/4002
2024-06-27 16:59:25 -07:00
Ishaan Jaff
0cd25c250d
Merge pull request #4447 from BerriAI/litellm_fix_error_on_v2_model_info
[fix] error message on /v2/model info when no models exist
2024-06-27 16:33:19 -07:00
Ishaan Jaff
0c6cd2c894 fix error message on v2/model info 2024-06-27 16:29:11 -07:00
Krrish Dholakia
d421486a45 fix(token_counter.py): New `get_modified_max_tokens' helper func
Fixes https://github.com/BerriAI/litellm/issues/4439
2024-06-27 15:38:09 -07:00
Ishaan Jaff
80960facfa fix secret redaction logic 2024-06-27 13:19:54 -07:00
Krrish Dholakia
adcd55fca0 fix(initial-commit): decrypts aws keys in entrypoint.sh 2024-06-26 22:33:26 -07:00
Krrish Dholakia
f533e1da09 fix(utils.py): return 'response_cost' in completion call
Closes https://github.com/BerriAI/litellm/issues/4335
2024-06-26 17:55:57 -07:00
Ishaan Jaff
8ecf15185b
Merge pull request #4423 from BerriAI/litellm_forward_traceparent_otel
[Fix] Forward OTEL Traceparent Header to provider
2024-06-26 17:16:23 -07:00
Ishaan Jaff
e0258708c7 fix cost tracking for whisper 2024-06-26 14:21:57 -07:00
Ishaan Jaff
b16b846711 forward otel traceparent in request headers 2024-06-26 12:31:28 -07:00
Ishaan Jaff
9942a5cbcf
Merge branch 'main' into litellm_add_secret_detection 2024-06-25 18:08:51 -07:00
Ishaan Jaff
66f0d6ae8f test secret detection 2024-06-25 17:27:02 -07:00
Ishaan Jaff
38ec55bd95
Merge pull request #4409 from BerriAI/litellm_enforce_premium_license_in_vpc
enterprise - allow verifying license in air gapped vpc
2024-06-25 16:29:57 -07:00
Ishaan Jaff
4abb83b12d fix only use crypto imports when needed 2024-06-25 16:28:47 -07:00
Ishaan Jaff
e22c9ba0cc init secret detection callback 2024-06-25 16:25:14 -07:00
Krrish Dholakia
e813e984f7 fix(predibase.py): support json schema on predibase 2024-06-25 16:03:47 -07:00
Ishaan Jaff
4c99010eee fix - verify license without api request 2024-06-25 13:55:54 -07:00