Commit graph

3588 commits

Author SHA1 Message Date
Krish Dholakia
869275585a
Merge branch 'main' into litellm_response_cost_headers 2024-06-27 21:33:09 -07:00
Krrish Dholakia
94c069e869 fix(cost_calculator.py): infer provider name if not given
Fixes https://github.com/BerriAI/litellm/issues/4452
2024-06-27 18:41:04 -07:00
Krrish Dholakia
2faa6f704a fix(factory.py): get image type from response headers
Fixes https://github.com/BerriAI/litellm/issues/4441
2024-06-27 18:19:16 -07:00
Krrish Dholakia
c14cc35e52 feat(azure.py): azure tts support
Closes https://github.com/BerriAI/litellm/issues/4002
2024-06-27 16:59:25 -07:00
Krrish Dholakia
d421486a45 fix(token_counter.py): New `get_modified_max_tokens' helper func
Fixes https://github.com/BerriAI/litellm/issues/4439
2024-06-27 15:38:09 -07:00
Ishaan Jaff
84ee37086c add stricter secret detection 2024-06-27 15:12:13 -07:00
Ishaan Jaff
c9cee3d910 test - test_chat_completion_request_with_redaction 2024-06-27 13:48:25 -07:00
Ishaan Jaff
dad09fdc3d ci/cd run again 2024-06-26 19:18:12 -07:00
Ishaan Jaff
3dc578555c
Merge pull request #4421 from BerriAI/litellm_add_vertex_models
[Feat] Add all Vertex AI Models
2024-06-26 18:10:09 -07:00
Ishaan Jaff
7264113c25 vertex testing 2024-06-26 18:08:54 -07:00
Krrish Dholakia
f533e1da09 fix(utils.py): return 'response_cost' in completion call
Closes https://github.com/BerriAI/litellm/issues/4335
2024-06-26 17:55:57 -07:00
Krrish Dholakia
98daedaf60 fix(router.py): fix setting httpx mounts 2024-06-26 17:22:04 -07:00
Ishaan Jaff
0f489b68eb test volcengine 2024-06-26 17:09:30 -07:00
Krrish Dholakia
151d19960e fix(bedrock_httpx.py): Fix https://github.com/BerriAI/litellm/issues/4415 2024-06-26 16:19:46 -07:00
Ishaan Jaff
5c673551a1 test_spend_logs_payload_whisper 2024-06-26 15:21:49 -07:00
Brian Schultheiss
eeedfceee4 Merge branch 'main' of https://github.com/BerriAI/litellm into litellm_ftr_bedrock_aws_session_token 2024-06-26 08:11:34 -07:00
Ishaan Jaff
829dece9aa test - fireworks ai param mapping 2024-06-26 06:58:00 -07:00
Ishaan Jaff
6c388dc05a test fireworks ai tool calling 2024-06-26 06:45:29 -07:00
Ishaan Jaff
eca4876bbf run again 2024-06-25 18:22:20 -07:00
Krish Dholakia
d772b8d9b0
Merge pull request #4411 from BerriAI/litellm_router_dynamic_cooldowns
fix(router.py): set `cooldown_time:` per model
2024-06-25 18:20:03 -07:00
Ishaan Jaff
33c11c94f8 fix detect secrets test 2024-06-25 17:44:36 -07:00
Ishaan Jaff
66f0d6ae8f test secret detection 2024-06-25 17:27:02 -07:00
Krrish Dholakia
d98e00d1e0 fix(router.py): set cooldown_time: per model 2024-06-25 16:51:55 -07:00
Brian Schultheiss
09492cceba Update tests to verify streaming works 2024-06-25 14:33:40 -07:00
Krrish Dholakia
cccc55213b fix(router.py): improve error message returned for fallbacks 2024-06-25 11:27:20 -07:00
Ishaan Jaff
2bd993039b
Merge pull request #4405 from BerriAI/litellm_update_mock_completion
[Fix] - use `n` in mock completion responses
2024-06-25 11:20:30 -07:00
Ishaan Jaff
ccf1bbc5d7 fix using mock completion 2024-06-25 11:14:40 -07:00
Ishaan Jaff
343e3f3e90 test - test_mock_request_n_greater_than_1 2024-06-25 10:54:18 -07:00
Ishaan Jaff
b4497acfc2 ci/cd run again 2024-06-25 09:48:49 -07:00
Ishaan Jaff
e5f281074f test - nvidia nim 2024-06-25 09:16:31 -07:00
Ishaan Jaff
a64d1de80f test - aliases on /spend/calculate 2024-06-24 21:13:01 -07:00
Ishaan Jaff
37f2712bba
Merge pull request #4389 from BerriAI/litellm_allow_user_to_define_public_routes
[Feat-Enterprise] - Allow setting custom public routes
2024-06-24 20:23:35 -07:00
Krish Dholakia
5d570e7c6c
Merge pull request #4392 from BerriAI/litellm_gemini_content_policy_errors
fix(vertex_httpx.py): cover gemini content violation (on prompt)
2024-06-24 20:00:06 -07:00
Ishaan Jaff
11117665e1 test - spend/calculate endpoints 2024-06-24 19:32:52 -07:00
Krrish Dholakia
8e6e5a6d37 fix(vertex_httpx.py): Return empty model response for content filter violations 2024-06-24 19:22:20 -07:00
Krrish Dholakia
341c7857c1 test(test_router.py): add testing 2024-06-24 17:28:12 -07:00
Krrish Dholakia
f5fbdf0fee fix(router.py): use user-defined model_input_tokens for pre-call filter checks 2024-06-24 17:25:26 -07:00
Brian Schultheiss
5a6588342c added test for change 2024-06-23 15:19:54 -07:00
Krrish Dholakia
769c60e4f6 test: skip unstable tests 2024-06-23 00:30:45 -07:00
Krrish Dholakia
3d09a196a4 test(test_completion.py): handle replicate api error 2024-06-23 00:06:15 -07:00
Krrish Dholakia
9cff2b03f3 test(test_proxy_server_langfuse.py): cleanup tests causing OOM issues. 2024-06-22 23:53:18 -07:00
Krrish Dholakia
d857d82b0e fix(redact_messages.py): fix pr 2024-06-22 23:27:13 -07:00
Krrish Dholakia
9450d2cf77 fix(test_dynamic_rate_limit_handler.py): cleanup 2024-06-22 22:43:56 -07:00
Krish Dholakia
0454c0781a
Merge branch 'main' into litellm_azure_content_filter_fallbacks 2024-06-22 21:28:29 -07:00
Krrish Dholakia
0fd9033502 fix(vertex_httpx.py): flush remaining chunks from stream 2024-06-22 20:33:54 -07:00
Krrish Dholakia
73254987da fix(vertex_httpx.py): ignore vertex finish reason - wait for stream to end
Fixes https://github.com/BerriAI/litellm/issues/4339
2024-06-22 20:21:01 -07:00
Krish Dholakia
961e7ac95d
Merge branch 'main' into litellm_dynamic_tpm_limits 2024-06-22 19:14:59 -07:00
Krrish Dholakia
2c7a80d08d fix(router.py): check if azure returns 'content_filter' response + fallback available -> fallback
Exception maps azure content filter response exceptions
2024-06-22 19:10:15 -07:00
Krrish Dholakia
a31a05d45d feat(dynamic_rate_limiter.py): working e2e 2024-06-22 14:41:22 -07:00
Ishaan Jaff
cb828a464a fix langfuse tests in_memory_langfuse_clients 2024-06-22 13:59:36 -07:00