Commit graph

8721 commits

Author SHA1 Message Date
Krish Dholakia
4d24c3b666 Merge pull request #4437 from BerriAI/litellm_aws_kms_decryption
fix(initial-commit): decrypts aws keys in entrypoint.sh
2024-06-28 21:10:52 -07:00
Ishaan Jaff
2738065feb ci/cd run again 2024-06-28 18:05:03 -07:00
Ishaan Jaff
9c2baac28c fix gemini tool calling issue 2024-06-28 18:03:33 -07:00
Ishaan Jaff
c0d6dba9ff pass through langfuse "/api/public/ingestion" 2024-06-28 17:29:11 -07:00
Ishaan Jaff
a7cb2ed21f test - pass through langfuse requests 2024-06-28 17:28:21 -07:00
Ishaan Jaff
033da54a03 feat - pass through langfuse requests 2024-06-28 17:27:13 -07:00
Ishaan Jaff
158148d7ce fix python3.8 install 2024-06-28 16:58:57 -07:00
Ishaan Jaff
87a6c1651b Merge pull request #4464 from BerriAI/litellm_return_lakera_exception_in_response
[Enterprise] Return Raw response from Lakera in failed responses
2024-06-28 16:56:59 -07:00
Ishaan Jaff
c57f06fd0a Merge pull request #4463 from BerriAI/docs_create_pass_through_routes_litellm_proxy
Docs create pass through routes litellm proxy (tutorial setup cohere Re-Rank Endpoint)
2024-06-28 16:55:44 -07:00
Ishaan Jaff
c417ab7a77 fix test custom callback router 2024-06-28 16:54:28 -07:00
Krrish Dholakia
55637c9cfc fix(prisma_migration.py): support decrypting variables in a python script 2024-06-28 16:31:37 -07:00
Ishaan Jaff
6851cec93b test - lakera ai detection 2024-06-28 16:14:26 -07:00
Krrish Dholakia
4c5ee771e1 fix(proxy_cli.py): run aws kms decrypt before starting proxy server 2024-06-28 16:03:56 -07:00
Ishaan Jaff
69deb65c04 fix use os.environ/ vars for pass through endpoints 2024-06-28 15:30:31 -07:00
Krrish Dholakia
a765bae2b6 fix(http_handler.py): raise more detailed http status errors 2024-06-28 15:12:38 -07:00
Ishaan Jaff
cf9636cc59 fix support pass through endpoints 2024-06-28 15:06:51 -07:00
Ishaan Jaff
a8c8138552 feat - support pass through endpoints 2024-06-28 15:03:21 -07:00
Krrish Dholakia
97ad7eb535 fix(cost_calculator.py): handle unexpected error in cost_calculator.py 2024-06-28 14:53:00 -07:00
Krrish Dholakia
3e9ce534b4 docs(anthropic.md): add claude-3-5-sonnet example to docs 2024-06-28 11:00:36 -07:00
Krrish Dholakia
6e53de5462 fix(router.py): only return 'max_tokens', 'input_cost_per_token', etc. in 'get_router_model_info' if base_model is set 2024-06-28 10:45:31 -07:00
Krrish Dholakia
66e3a4f30e fix(support-'alt=sse'-param): Fixes https://github.com/BerriAI/litellm/issues/4459 2024-06-28 10:40:47 -07:00
Krrish Dholakia
1d690fd3f3 fix(vertex_httpx.py): only use credential project id, if user project id not given 2024-06-27 22:08:14 -07:00
Krrish Dholakia
5862a6888e build(model_prices_and_context_window.json): update gemini-1.5-pro max input tokens 2024-06-27 21:58:54 -07:00
Krish Dholakia
014c032b00 Merge pull request #4446 from BerriAI/litellm_get_max_modified_tokens
fix(token_counter.py): New `get_modified_max_tokens' helper func
2024-06-27 21:43:23 -07:00
Krish Dholakia
134aa3cbd8 Merge pull request #4449 from BerriAI/litellm_azure_tts
feat(azure.py): azure tts support
2024-06-27 21:33:38 -07:00
Krish Dholakia
fa1cb7d903 Merge branch 'main' into litellm_response_cost_headers 2024-06-27 21:33:09 -07:00
Krish Dholakia
fd57294740 Merge pull request #4445 from ushuz/fix-google-creds
fix: do not resolve vertex project id from creds
2024-06-27 21:31:59 -07:00
Ishaan Jaff
bdb812ff97 Merge branch 'main' into litellm_fix_in_mem_usage 2024-06-27 21:12:06 -07:00
Ishaan Jaff
196d15967b fix pre call utils adding extra headers 2024-06-27 21:03:36 -07:00
Ishaan Jaff
a1968eaf3f remove debug print statement 2024-06-27 20:58:29 -07:00
Ishaan Jaff
f1965811fe ci/cd run again 2024-06-27 20:25:09 -07:00
Ishaan Jaff
1592de0b7f fix error message on v2/model info 2024-06-27 20:20:47 -07:00
Ishaan Jaff
13e11c2288 add stricter secret detection 2024-06-27 20:20:46 -07:00
Ishaan Jaff
d4baf3192e test - test_chat_completion_request_with_redaction 2024-06-27 20:20:46 -07:00
Ishaan Jaff
fc8714fc9c fix secret redaction logic 2024-06-27 20:20:46 -07:00
Ishaan Jaff
32fe441080 fix raise better error message on reaching failed vertex import 2024-06-27 20:20:46 -07:00
Krrish Dholakia
13fd23fcb1 fix(utils.py): handle arguments being None
Fixes https://github.com/BerriAI/litellm/issues/4440
2024-06-27 20:20:46 -07:00
Krrish Dholakia
bfa2b15e77 fix(utils.py): add new special token for cleanup 2024-06-27 20:20:46 -07:00
Ishaan Jaff
3696d47031 ci/cd run again 2024-06-27 20:20:46 -07:00
Ishaan Jaff
2ccdda8f5a fix gemini test 2024-06-27 20:20:46 -07:00
Ishaan Jaff
22243cc13c vertex testing 2024-06-27 20:20:46 -07:00
Ishaan Jaff
fcb2513593 add codechat-bison@latest 2024-06-27 20:20:46 -07:00
Ishaan Jaff
2f8ad2204f add code-gecko-latest 2024-06-27 20:20:46 -07:00
Ishaan Jaff
71253f6a02 add code-bison 2024-06-27 20:20:46 -07:00
Ishaan Jaff
1e8fe1b071 add chat-bison-32k@002 2024-06-27 20:20:46 -07:00
Ishaan Jaff
921948e202 add vertex text-bison 2024-06-27 20:20:46 -07:00
Ishaan Jaff
84d79b1101 fix gemini ultra info 2024-06-27 20:20:46 -07:00
Ishaan Jaff
5421377779 add gemini-1.0-ultra-001 2024-06-27 20:20:46 -07:00
Ishaan Jaff
ca376eb40d add source for codestral pricing 2024-06-27 20:20:46 -07:00
Ishaan Jaff
47772004bc add codestral pricing 2024-06-27 20:20:46 -07:00