Commit graph

8704 commits

Author SHA1 Message Date
Krrish Dholakia
a765bae2b6 fix(http_handler.py): raise more detailed http status errors 2024-06-28 15:12:38 -07:00
Krrish Dholakia
97ad7eb535 fix(cost_calculator.py): handle unexpected error in cost_calculator.py 2024-06-28 14:53:00 -07:00
Krrish Dholakia
3e9ce534b4 docs(anthropic.md): add claude-3-5-sonnet example to docs 2024-06-28 11:00:36 -07:00
Krrish Dholakia
6e53de5462 fix(router.py): only return 'max_tokens', 'input_cost_per_token', etc. in 'get_router_model_info' if base_model is set 2024-06-28 10:45:31 -07:00
Krrish Dholakia
66e3a4f30e fix(support-'alt=sse'-param): Fixes https://github.com/BerriAI/litellm/issues/4459 2024-06-28 10:40:47 -07:00
Krrish Dholakia
1d690fd3f3 fix(vertex_httpx.py): only use credential project id, if user project id not given 2024-06-27 22:08:14 -07:00
Krrish Dholakia
5862a6888e build(model_prices_and_context_window.json): update gemini-1.5-pro max input tokens 2024-06-27 21:58:54 -07:00
Krish Dholakia
014c032b00 Merge pull request #4446 from BerriAI/litellm_get_max_modified_tokens
fix(token_counter.py): New `get_modified_max_tokens' helper func
2024-06-27 21:43:23 -07:00
Krish Dholakia
134aa3cbd8 Merge pull request #4449 from BerriAI/litellm_azure_tts
feat(azure.py): azure tts support
2024-06-27 21:33:38 -07:00
Krish Dholakia
fa1cb7d903 Merge branch 'main' into litellm_response_cost_headers 2024-06-27 21:33:09 -07:00
Krish Dholakia
fd57294740 Merge pull request #4445 from ushuz/fix-google-creds
fix: do not resolve vertex project id from creds
2024-06-27 21:31:59 -07:00
Ishaan Jaff
bdb812ff97 Merge branch 'main' into litellm_fix_in_mem_usage 2024-06-27 21:12:06 -07:00
Ishaan Jaff
196d15967b fix pre call utils adding extra headers 2024-06-27 21:03:36 -07:00
Ishaan Jaff
a1968eaf3f remove debug print statement 2024-06-27 20:58:29 -07:00
Ishaan Jaff
f1965811fe ci/cd run again 2024-06-27 20:25:09 -07:00
Ishaan Jaff
1592de0b7f fix error message on v2/model info 2024-06-27 20:20:47 -07:00
Ishaan Jaff
13e11c2288 add stricter secret detection 2024-06-27 20:20:46 -07:00
Ishaan Jaff
d4baf3192e test - test_chat_completion_request_with_redaction 2024-06-27 20:20:46 -07:00
Ishaan Jaff
fc8714fc9c fix secret redaction logic 2024-06-27 20:20:46 -07:00
Ishaan Jaff
32fe441080 fix raise better error message on reaching failed vertex import 2024-06-27 20:20:46 -07:00
Krrish Dholakia
13fd23fcb1 fix(utils.py): handle arguments being None
Fixes https://github.com/BerriAI/litellm/issues/4440
2024-06-27 20:20:46 -07:00
Krrish Dholakia
bfa2b15e77 fix(utils.py): add new special token for cleanup 2024-06-27 20:20:46 -07:00
Ishaan Jaff
3696d47031 ci/cd run again 2024-06-27 20:20:46 -07:00
Ishaan Jaff
2ccdda8f5a fix gemini test 2024-06-27 20:20:46 -07:00
Ishaan Jaff
22243cc13c vertex testing 2024-06-27 20:20:46 -07:00
Ishaan Jaff
fcb2513593 add codechat-bison@latest 2024-06-27 20:20:46 -07:00
Ishaan Jaff
2f8ad2204f add code-gecko-latest 2024-06-27 20:20:46 -07:00
Ishaan Jaff
71253f6a02 add code-bison 2024-06-27 20:20:46 -07:00
Ishaan Jaff
1e8fe1b071 add chat-bison-32k@002 2024-06-27 20:20:46 -07:00
Ishaan Jaff
921948e202 add vertex text-bison 2024-06-27 20:20:46 -07:00
Ishaan Jaff
84d79b1101 fix gemini ultra info 2024-06-27 20:20:46 -07:00
Ishaan Jaff
5421377779 add gemini-1.0-ultra-001 2024-06-27 20:20:46 -07:00
Ishaan Jaff
ca376eb40d add source for codestral pricing 2024-06-27 20:20:46 -07:00
Ishaan Jaff
47772004bc add codestral pricing 2024-06-27 20:20:46 -07:00
Ishaan Jaff
0ac77551be forward otel traceparent in request headers 2024-06-27 20:20:46 -07:00
Ishaan Jaff
c48bbb3ec3 test volcengine 2024-06-27 20:20:46 -07:00
Ishaan Jaff
5a24ee2482 add initial support for volcengine 2024-06-27 20:20:46 -07:00
Ishaan Jaff
dfa1b3ace2 add volcengine as provider to litellm 2024-06-27 20:20:46 -07:00
Ishaan Jaff
1d33659802 fix - reuse client initialized on proxy config 2024-06-27 20:20:46 -07:00
Krrish Dholakia
2ca43f6432 fix(bedrock_httpx.py): Fix https://github.com/BerriAI/litellm/issues/4415 2024-06-27 20:20:46 -07:00
Ishaan Jaff
1b5b2cf376 fix handle_openai_chat_completion_chunk 2024-06-27 20:20:46 -07:00
Ishaan Jaff
aa2712fc48 Revert "Add return type annotations to util types"
This reverts commit faef56fe69.
2024-06-27 20:20:46 -07:00
Ishaan Jaff
6f8186b252 test_spend_logs_payload_whisper 2024-06-27 20:20:46 -07:00
Ishaan Jaff
0bdbe55c7d fix cost tracking for whisper 2024-06-27 20:20:46 -07:00
Josh Learn
7c1ed6e5a2 Add return type annotations to util types 2024-06-27 20:20:46 -07:00
Ishaan Jaff
5ff3561714 fix add ollama codegemma 2024-06-27 20:20:46 -07:00
Ishaan Jaff
20397094d2 test - fireworks ai param mapping 2024-06-27 20:20:46 -07:00
Ishaan Jaff
1283990cb6 fix + test fireworks ai param mapping for tools 2024-06-27 20:20:46 -07:00
Ishaan Jaff
2bc5c48397 test fireworks ai tool calling 2024-06-27 20:20:46 -07:00
Ishaan Jaff
1f23ac611e add fireworks ai param mapping 2024-06-27 20:20:46 -07:00