Commit graph

1078 commits

Author SHA1 Message Date
Krrish Dholakia
4a6471e075 fix(utils.py): fix vertex anthropic streaming 2024-07-03 18:43:46 -07:00
Krish Dholakia
4e1b247c1d Revert "fix(vertex_anthropic.py): Vertex Anthropic tool calling - native params " 2024-07-03 17:55:37 -07:00
Krrish Dholakia
46800ba20a fix(vertex_anthropic.py): Updates the vertex anthropic endpoint to do tool calling with the anthropic api params 2024-07-03 15:28:31 -07:00
Krish Dholakia
637369d2ac Merge branch 'main' into litellm_fix_httpx_transport 2024-07-02 17:17:43 -07:00
Ishaan Jaff
d8160e8459 Merge pull request #4519 from BerriAI/litellm_re_use_openai_azure_clients_whisper
[Fix+Test] /audio/transcriptions - use initialized OpenAI / Azure OpenAI clients
2024-07-02 16:42:22 -07:00
Ishaan Jaff
c7f278f686 fix use router level client for OpenAI / Azure transcription calls 2024-07-02 12:33:31 -07:00
Krrish Dholakia
39348317d2 fix(main.py): get the region name from boto3 client if dynamic var not set 2024-07-02 09:24:07 -07:00
Krrish Dholakia
459d294e21 fix(router.py): disable cooldowns
allow admin to disable model cooldowns
2024-07-01 15:03:10 -07:00
Krrish Dholakia
9400edaf33 fix(main.py): copy messages - prevent modifying user input
Fixes https://github.com/BerriAI/litellm/discussions/4489
2024-07-01 08:14:46 -07:00
Ishaan Jaff
695fb5118c fix bedrock claude test 2024-06-29 18:46:06 -07:00
Brian Schultheiss
195cab8e07 Resolve merge conflicts 2024-06-29 15:53:02 -07:00
Krrish Dholakia
ca22d2a106 fix(main.py): pass in openrouter as custom provider for openai client call
Fixes https://github.com/BerriAI/litellm/issues/4414
2024-06-28 21:26:42 -07:00
Krish Dholakia
134aa3cbd8 Merge pull request #4449 from BerriAI/litellm_azure_tts
feat(azure.py): azure tts support
2024-06-27 21:33:38 -07:00
Ishaan Jaff
7041e22aa5 azure - fix custom logger on post call 2024-06-27 17:37:02 -07:00
Krrish Dholakia
58244ba71f feat(azure.py): azure tts support
Closes https://github.com/BerriAI/litellm/issues/4002
2024-06-27 16:59:25 -07:00
Krrish Dholakia
d67cdee850 fix(router.py): fix setting httpx mounts 2024-06-26 17:22:04 -07:00
Ishaan Jaff
339c5d17ed add initial support for volcengine 2024-06-26 16:53:44 -07:00
Brian Schultheiss
1176272734 Merge branch 'main' of https://github.com/BerriAI/litellm into litellm_ftr_bedrock_aws_session_token 2024-06-26 08:11:34 -07:00
Krrish Dholakia
c70d4ffafb fix(router.py): set cooldown_time: per model 2024-06-25 16:51:55 -07:00
Ishaan Jaff
8ddc9a5ca4 Merge pull request #4405 from BerriAI/litellm_update_mock_completion
[Fix] - use `n` in mock completion responses
2024-06-25 11:20:30 -07:00
Ishaan Jaff
9372505e4e fix using mock completion 2024-06-25 11:14:40 -07:00
Ishaan Jaff
ae01cdfc3b feat - use n in mock completion 2024-06-25 10:50:47 -07:00
Ishaan Jaff
288ef78804 feat - add nvidia nim to main.py 2024-06-25 08:57:11 -07:00
Brian Schultheiss
d6925b40fe Support aws_session_token for bedrock client. https://github.com/BerriAI/litellm/issues/4346 2024-06-23 12:51:25 -07:00
Krrish Dholakia
6a7982fa40 feat(dynamic_rate_limiter.py): passing base case 2024-06-21 22:46:46 -07:00
Ishaan Jaff
f4db69a275 fix - /moderation don't require a model 2024-06-21 16:00:43 -07:00
Krish Dholakia
b09ac45d7b Merge pull request #4121 from friendliai/feat/friendliai
feat: friendli ai support
2024-06-20 22:17:41 -07:00
Krrish Dholakia
c88c3002a4 fix(vertex_httpx.py): allow passing extra headers
Closes https://github.com/BerriAI/litellm/pull/4327
2024-06-20 21:14:44 -07:00
Wonseok Lee (Jack)
86d87a3f38 Merge branch 'main' into feat/friendliai 2024-06-21 10:50:03 +09:00
Krrish Dholakia
1f87f45709 fix(vertex_httpx.py): support setting custom api base for vertex ai calls
Closes https://github.com/BerriAI/litellm/issues/4317
2024-06-20 16:33:37 -07:00
Krrish Dholakia
87c0ef2153 fix(main.py): fix text-completion vllm routing 2024-06-19 17:48:20 -07:00
Ishaan Jaff
0aa0049c43 fix - use router level client on proxy img gen 2024-06-19 15:27:46 -07:00
Krrish Dholakia
7966266d4f fix(main.py): route openai calls to /completion when text_completion is True 2024-06-19 12:37:05 -07:00
Krrish Dholakia
71e882f4a2 fix(vertex_httpx.py): re-raise vertex content policy violation error
Fixes https://github.com/BerriAI/litellm/issues/4270
2024-06-18 19:00:35 -07:00
Krish Dholakia
6f94456f40 Merge branch 'main' into litellm_gemini_refactoring 2024-06-17 19:50:56 -07:00
Krrish Dholakia
7981ca5074 fix(main.py): fix import 2024-06-17 18:50:16 -07:00
Krish Dholakia
8a837cdcdc Merge pull request #4195 from jacquesyvesgl/main
[New Feature] Add mock_tool_calls to `main.py`
2024-06-17 17:38:45 -07:00
Krish Dholakia
18d9dcc4db Merge branch 'main' into litellm_gemini_refactoring 2024-06-17 17:28:50 -07:00
Ishaan Jaff
c1981f5534 fix text completion response from codestral 2024-06-17 15:01:26 -07:00
Ishaan Jaff
87386b5cc3 feat - add fim codestral api 2024-06-17 13:46:03 -07:00
Krrish Dholakia
e31465d940 feat(main.py): initial commit - refactoring google ai studio to just use vertex httpx
Uses the same calling logic for google ai studio/vertex ai. Simplifies logic, gives google ai studio integration all of vertex
ai features.
2024-06-17 13:31:46 -07:00
Ishaan Jaff
2a5eabcceb feat add text completion config for mistral text 2024-06-17 12:48:46 -07:00
Ishaan Jaff
1a30068f90 vo - init commit adding codestral API 2024-06-17 11:05:24 -07:00
Krrish Dholakia
734bd5ef85 feat(router.py): support content policy fallbacks
Closes https://github.com/BerriAI/litellm/issues/2632
2024-06-14 17:15:44 -07:00
Krrish Dholakia
f1bff50d60 fix(main.py): include traceback in error string 2024-06-14 15:15:53 -07:00
=
6cffd0b62d Add mock_tool_calls 2024-06-14 15:19:11 +02:00
Krish Dholakia
50c74fce49 Merge branch 'main' into litellm_vertex_completion_httpx 2024-06-12 21:19:22 -07:00
Krrish Dholakia
afebf867f6 fix(vertex_httpx.py): support async completion calls 2024-06-12 20:15:03 -07:00
Krrish Dholakia
1dac2aa59f fix(vertex_httpx.py): support streaming via httpx client 2024-06-12 19:55:14 -07:00
Wonseok Lee (Jack)
99632752eb Merge branch 'main' into feat/friendliai 2024-06-13 09:59:56 +09:00