Commit graph

1157 commits

Author SHA1 Message Date
Ishaan Jaff
a230f5f6c5 feat - use n in mock completion 2024-06-25 10:50:47 -07:00
Ishaan Jaff
d829d6393d feat - add nvidia nim to main.py 2024-06-25 08:57:11 -07:00
Brian Schultheiss
8ad1ae73e5 Support aws_session_token for bedrock client. https://github.com/BerriAI/litellm/issues/4346 2024-06-23 12:51:25 -07:00
Krrish Dholakia
068e8dff5b feat(dynamic_rate_limiter.py): passing base case 2024-06-21 22:46:46 -07:00
Ishaan Jaff
eb8a9b2654 fix - /moderation don't require a model 2024-06-21 16:00:43 -07:00
Krish Dholakia
361e47882b
Merge pull request #4121 from friendliai/feat/friendliai
feat: friendli ai support
2024-06-20 22:17:41 -07:00
Krrish Dholakia
dfd5882c31 fix(vertex_httpx.py): allow passing extra headers
Closes https://github.com/BerriAI/litellm/pull/4327
2024-06-20 21:14:44 -07:00
Wonseok Lee (Jack)
c4c7d1b367
Merge branch 'main' into feat/friendliai 2024-06-21 10:50:03 +09:00
Krrish Dholakia
d3a3146155 fix(vertex_httpx.py): support setting custom api base for vertex ai calls
Closes https://github.com/BerriAI/litellm/issues/4317
2024-06-20 16:33:37 -07:00
Krrish Dholakia
05a4b6188e fix(main.py): fix text-completion vllm routing 2024-06-19 17:48:20 -07:00
Ishaan Jaff
931a72523e fix - use router level client on proxy img gen 2024-06-19 15:27:46 -07:00
Krrish Dholakia
9cc104eb03 fix(main.py): route openai calls to /completion when text_completion is True 2024-06-19 12:37:05 -07:00
Krrish Dholakia
f41c443abb fix(vertex_httpx.py): re-raise vertex content policy violation error
Fixes https://github.com/BerriAI/litellm/issues/4270
2024-06-18 19:00:35 -07:00
Krish Dholakia
63216f42b8
Merge branch 'main' into litellm_gemini_refactoring 2024-06-17 19:50:56 -07:00
Krrish Dholakia
4f32bca8d9 fix(main.py): fix import 2024-06-17 18:50:16 -07:00
Krish Dholakia
e9c92c571c
Merge pull request #4195 from jacquesyvesgl/main
[New Feature] Add mock_tool_calls to `main.py`
2024-06-17 17:38:45 -07:00
Krish Dholakia
a80520004e
Merge branch 'main' into litellm_gemini_refactoring 2024-06-17 17:28:50 -07:00
Ishaan Jaff
5a28875e77 fix text completion response from codestral 2024-06-17 15:01:26 -07:00
Ishaan Jaff
364492297d feat - add fim codestral api 2024-06-17 13:46:03 -07:00
Krrish Dholakia
be66800a98 feat(main.py): initial commit - refactoring google ai studio to just use vertex httpx
Uses the same calling logic for google ai studio/vertex ai. Simplifies logic, gives google ai studio integration all of vertex
ai features.
2024-06-17 13:31:46 -07:00
Ishaan Jaff
ad47fee181 feat add text completion config for mistral text 2024-06-17 12:48:46 -07:00
Ishaan Jaff
3ae05c0404 vo - init commit adding codestral API 2024-06-17 11:05:24 -07:00
Krrish Dholakia
6f715b4782 feat(router.py): support content policy fallbacks
Closes https://github.com/BerriAI/litellm/issues/2632
2024-06-14 17:15:44 -07:00
Krrish Dholakia
0404d30a9c fix(main.py): include traceback in error string 2024-06-14 15:15:53 -07:00
=
9df0091b97 Add mock_tool_calls 2024-06-14 15:19:11 +02:00
Krish Dholakia
05e21441a6
Merge branch 'main' into litellm_vertex_completion_httpx 2024-06-12 21:19:22 -07:00
Krrish Dholakia
995631bd39 fix(vertex_httpx.py): support async completion calls 2024-06-12 20:15:03 -07:00
Krrish Dholakia
3955b058ed fix(vertex_httpx.py): support streaming via httpx client 2024-06-12 19:55:14 -07:00
Wonseok Lee (Jack)
776c75c1e5
Merge branch 'main' into feat/friendliai 2024-06-13 09:59:56 +09:00
Krrish Dholakia
3b913443fe feat(vertex_httpx.py): Moving to call vertex ai via httpx (instead of their sdk). Allows us to support all their api updates. 2024-06-12 16:47:00 -07:00
Ishaan Jaff
95aaef4f94 feat - add async support for clarifai 2024-06-12 16:32:16 -07:00
Krish Dholakia
75b0d7821b
Merge pull request #4139 from BerriAI/litellm_fix_budget_exceeded_error_code
fix(proxy_server.py): use consistent 400-status code error code for exceeded budget errors
2024-06-11 18:36:58 -07:00
Krrish Dholakia
0ab0111d57 test(test_team.py): fix error string asserted 2024-06-11 18:05:20 -07:00
Krrish Dholakia
2d8e4ddfa0 fix(main.py): trigger new build 2024-06-11 15:13:50 -07:00
wslee
18cc703aa2 change friendli_ai -> friendliai 2024-06-11 16:17:30 +09:00
wslee
1442adbc33 resolve comments 2024-06-11 14:49:39 +09:00
wslee
fe8d59f5eb add friendli_ai provider 2024-06-10 17:27:15 +09:00
Krrish Dholakia
1dafb1b3b7 fix(utils.py): improved predibase exception mapping
adds unit testing + better coverage for predibase errors
2024-06-08 14:32:43 -07:00
Ishaan Jaff
3ecc077507 fix mock_completion 2024-06-07 19:10:05 -07:00
Ishaan Jaff
718b547646
Merge branch 'main' into litellm_security_fix 2024-06-07 16:52:25 -07:00
Krrish Dholakia
f73b6033fd fix(test_custom_callbacks_input.py): unit tests for 'turn_off_message_logging'
ensure no raw request is logged either
2024-06-07 15:39:15 -07:00
Ishaan Jaff
d9dacc1f43
Merge pull request #4065 from BerriAI/litellm_use_common_func
[Refactor] - Refactor proxy_server.py to use common function for `add_litellm_data_to_request`
2024-06-07 14:02:17 -07:00
Ishaan Jaff
2cf3133669
Merge branch 'main' into litellm_svc_logger 2024-06-07 14:01:54 -07:00
Ishaan Jaff
7ef7bc8a9a fix simplify - pass litellm_parent_otel_span 2024-06-07 13:48:21 -07:00
Ishaan Jaff
54ac848bfb use litellm_parent_otel_span as litellm_param 2024-06-07 08:54:28 -07:00
Krish Dholakia
26993c067e
Merge branch 'main' into litellm_bedrock_converse_api 2024-06-07 08:49:52 -07:00
Krrish Dholakia
35e4323095 refactor(main.py): only route anthropic calls through converse api
v0 scope let's move function calling to converse api
2024-06-07 08:47:51 -07:00
Krrish Dholakia
44670d952d test(main.py): test cicd 2024-06-07 08:18:37 -07:00
Krrish Dholakia
b3bf93685a style(main.py): trigger new build 2024-06-07 08:10:28 -07:00
Krrish Dholakia
a995a0b172 fix(bedrock_httpx.py): working claude 3 function calling 2024-06-06 20:12:41 -07:00