Commit graph

1143 commits

Author SHA1 Message Date
Krrish Dholakia
7981ca5074 fix(main.py): fix import 2024-06-17 18:50:16 -07:00
Krish Dholakia
8a837cdcdc Merge pull request #4195 from jacquesyvesgl/main
[New Feature] Add mock_tool_calls to `main.py`
2024-06-17 17:38:45 -07:00
Krish Dholakia
18d9dcc4db Merge branch 'main' into litellm_gemini_refactoring 2024-06-17 17:28:50 -07:00
Ishaan Jaff
c1981f5534 fix text completion response from codestral 2024-06-17 15:01:26 -07:00
Ishaan Jaff
87386b5cc3 feat - add fim codestral api 2024-06-17 13:46:03 -07:00
Krrish Dholakia
e31465d940 feat(main.py): initial commit - refactoring google ai studio to just use vertex httpx
Uses the same calling logic for google ai studio/vertex ai. Simplifies logic, gives google ai studio integration all of vertex
ai features.
2024-06-17 13:31:46 -07:00
Ishaan Jaff
2a5eabcceb feat add text completion config for mistral text 2024-06-17 12:48:46 -07:00
Ishaan Jaff
1a30068f90 vo - init commit adding codestral API 2024-06-17 11:05:24 -07:00
Krrish Dholakia
734bd5ef85 feat(router.py): support content policy fallbacks
Closes https://github.com/BerriAI/litellm/issues/2632
2024-06-14 17:15:44 -07:00
Krrish Dholakia
f1bff50d60 fix(main.py): include traceback in error string 2024-06-14 15:15:53 -07:00
=
6cffd0b62d Add mock_tool_calls 2024-06-14 15:19:11 +02:00
Krish Dholakia
50c74fce49 Merge branch 'main' into litellm_vertex_completion_httpx 2024-06-12 21:19:22 -07:00
Krrish Dholakia
afebf867f6 fix(vertex_httpx.py): support async completion calls 2024-06-12 20:15:03 -07:00
Krrish Dholakia
1dac2aa59f fix(vertex_httpx.py): support streaming via httpx client 2024-06-12 19:55:14 -07:00
Wonseok Lee (Jack)
99632752eb Merge branch 'main' into feat/friendliai 2024-06-13 09:59:56 +09:00
Krrish Dholakia
29169b3039 feat(vertex_httpx.py): Moving to call vertex ai via httpx (instead of their sdk). Allows us to support all their api updates. 2024-06-12 16:47:00 -07:00
Ishaan Jaff
23c466d2df feat - add async support for clarifai 2024-06-12 16:32:16 -07:00
Krish Dholakia
30d269f93a Merge pull request #4139 from BerriAI/litellm_fix_budget_exceeded_error_code
fix(proxy_server.py): use consistent 400-status code error code for exceeded budget errors
2024-06-11 18:36:58 -07:00
Krrish Dholakia
fb1dc7d86b test(test_team.py): fix error string asserted 2024-06-11 18:05:20 -07:00
Krrish Dholakia
0f1c40d698 fix(main.py): trigger new build 2024-06-11 15:13:50 -07:00
wslee
61badd8fd6 change friendli_ai -> friendliai 2024-06-11 16:17:30 +09:00
wslee
99e2050125 resolve comments 2024-06-11 14:49:39 +09:00
wslee
2ba421fbe0 add friendli_ai provider 2024-06-10 17:27:15 +09:00
Krrish Dholakia
39ee6be477 fix(utils.py): improved predibase exception mapping
adds unit testing + better coverage for predibase errors
2024-06-08 14:32:43 -07:00
Ishaan Jaff
1cbd36433b fix mock_completion 2024-06-07 19:10:05 -07:00
Ishaan Jaff
92841dfe1b Merge branch 'main' into litellm_security_fix 2024-06-07 16:52:25 -07:00
Krrish Dholakia
de98bd939c fix(test_custom_callbacks_input.py): unit tests for 'turn_off_message_logging'
ensure no raw request is logged either
2024-06-07 15:39:15 -07:00
Ishaan Jaff
80def35a04 Merge pull request #4065 from BerriAI/litellm_use_common_func
[Refactor] - Refactor proxy_server.py to use common function for `add_litellm_data_to_request`
2024-06-07 14:02:17 -07:00
Ishaan Jaff
860c9b52b6 Merge branch 'main' into litellm_svc_logger 2024-06-07 14:01:54 -07:00
Ishaan Jaff
8106a6dc9b fix simplify - pass litellm_parent_otel_span 2024-06-07 13:48:21 -07:00
Ishaan Jaff
0f99d47d87 use litellm_parent_otel_span as litellm_param 2024-06-07 08:54:28 -07:00
Krish Dholakia
7bf5c61007 Merge branch 'main' into litellm_bedrock_converse_api 2024-06-07 08:49:52 -07:00
Krrish Dholakia
12ed3dc911 refactor(main.py): only route anthropic calls through converse api
v0 scope let's move function calling to converse api
2024-06-07 08:47:51 -07:00
Krrish Dholakia
bad5cde7c5 test(main.py): test cicd 2024-06-07 08:18:37 -07:00
Krrish Dholakia
3f4b617767 style(main.py): trigger new build 2024-06-07 08:10:28 -07:00
Krrish Dholakia
f8b5aa3df6 fix(bedrock_httpx.py): working claude 3 function calling 2024-06-06 20:12:41 -07:00
Krrish Dholakia
e391e30285 refactor: replace 'traceback.print_exc()' with logging library
allows error logs to be in json format for otel logging
2024-06-06 13:47:43 -07:00
Krish Dholakia
e678dce88b Merge pull request #4009 from BerriAI/litellm_fix_streaming_cost_cal
fix(utils.py): fix cost calculation for openai-compatible streaming object
2024-06-04 21:00:22 -07:00
Krrish Dholakia
11b44192c2 fix(main.py): check verify ssl on custom endpoint call 2024-06-04 17:12:42 -07:00
Krrish Dholakia
7432c6a4d9 fix(utils.py): fix cost calculation for openai-compatible streaming object 2024-06-04 10:36:25 -07:00
Krrish Dholakia
661b67e71c fix(main.py): fix typing for image gen response 2024-06-04 08:29:30 -07:00
Krrish Dholakia
46a0ac7953 fix(main.py): fix ahealth_check to infer mode when custom_llm_provider/model_name used 2024-06-03 14:06:36 -07:00
Krrish Dholakia
594daef07a fix(utils.py): correctly instrument passing through api version in optional param check 2024-06-01 19:31:52 -07:00
Krrish Dholakia
5d3a0ace4b fix(openai.py): fix client caching logic 2024-06-01 16:45:56 -07:00
Krrish Dholakia
69244aabf3 fix(http_handler.py): allow setting ca bundle path 2024-06-01 14:48:53 -07:00
Krrish Dholakia
de62c5f565 docs(assistants.md): add assistants api to docs 2024-06-01 10:30:07 -07:00
Krish Dholakia
1529f665cc Merge pull request #3954 from BerriAI/litellm_simple_request_prioritization
feat(scheduler.py): add request prioritization scheduler
2024-05-31 23:29:09 -07:00
Krrish Dholakia
6221fabecf fix(router.py): fix cooldown logic for usage-based-routing-v2 pre-call-checks 2024-05-31 21:32:01 -07:00
Krrish Dholakia
3896e3e88f fix: fix streaming with httpx client
prevent overwriting streams in parallel streaming calls
2024-05-31 10:55:18 -07:00
Krrish Dholakia
6b4153ff03 fix(main.py): add logging to audio_transcription calls 2024-05-30 16:57:11 -07:00