phoenix/litellm-mirror
0
0
Fork 1
mirror of https://github.com/BerriAI/litellm.git synced 2025-04-27 11:43:54 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions
14322 commits 2497 branches 897 tags 550 MiB
Commit graph

237 commits

Author SHA1 Message Date
Ishaan Jaff
0b24027da2 test had "assert False" for some reason ? 2024-07-06 15:46:28 -07:00
Krrish Dholakia
00497b408d fix(anthropic.py): fix anthropic tool calling + streaming 
Fixes https://github.com/BerriAI/litellm/issues/4537
 2024-07-04 16:30:24 -07:00
Krrish Dholakia
84044c08b6 fix(utils.py): stream_options working across all providers 2024-07-03 20:40:46 -07:00
Krrish Dholakia
eae049d059 fix(anthropic.py): support *real* anthropic tool calling + streaming 
Parses each chunk and translates to openai format
 2024-07-03 19:48:35 -07:00
Krrish Dholakia
3fdfb8470d fix(replicate.py): correctly handly invalid replicate response 2024-07-03 10:09:46 -07:00
Ishaan Jaff
1a0f2aff24 fix test_completion_replicate_llama3_streaming 2024-06-29 19:51:07 -07:00
Krrish Dholakia
0029d437cc test(test_streaming.py): try-except replicate api instability 2024-06-28 22:19:44 -07:00
Krrish Dholakia
97ad7eb535 fix(cost_calculator.py): handle unexpected error in cost_calculator.py 2024-06-28 14:53:00 -07:00
Krrish Dholakia
66e3a4f30e fix(support-'alt=sse'-param): Fixes https://github.com/BerriAI/litellm/issues/4459 2024-06-28 10:40:47 -07:00
Krrish Dholakia
14fdbf26a6 fix(vertex_httpx.py): flush remaining chunks from stream 2024-06-22 20:33:54 -07:00
Krrish Dholakia
2d8135231f fix(vertex_httpx.py): ignore vertex finish reason - wait for stream to end 
Fixes https://github.com/BerriAI/litellm/issues/4339
 2024-06-22 20:21:01 -07:00
Krrish Dholakia
a6716177fa test: cleanup tests 2024-06-17 16:33:58 -07:00
Krrish Dholakia
58907917b6 test(test_streaming.py): reduce vertex tests to avoid exhausting limits 2024-06-13 07:30:53 -07:00
Krish Dholakia
50c74fce49 Merge branch 'main' into litellm_vertex_completion_httpx 2024-06-12 21:19:22 -07:00
Ishaan Jaff
f70a3cc588 ci/cd predibase is an unstable provider 2024-06-12 21:10:30 -07:00
Krrish Dholakia
1dac2aa59f fix(vertex_httpx.py): support streaming via httpx client 2024-06-12 19:55:14 -07:00
Ishaan Jaff
2622f33bbd ci/cd fix predibase 500 errors 2024-06-11 23:15:48 -07:00
Krrish Dholakia
5056fd5778 fix(bedrock_httpx.py): returning correct finish reason on streaming completion 2024-06-10 14:47:49 -07:00
Krrish Dholakia
2d95eaa5bc fix(bedrock_httpx.py): fix tool calling for anthropic bedrock calls w/ streaming 
Fixes https://github.com/BerriAI/litellm/issues/4091
 2024-06-10 14:20:25 -07:00
Krrish Dholakia
12ed3dc911 refactor(main.py): only route anthropic calls through converse api 
v0 scope let's move function calling to converse api
 2024-06-07 08:47:51 -07:00
Krrish Dholakia
c41b60f6bf feat(bedrock_httpx.py): working bedrock converse api streaming 2024-06-06 22:13:21 -07:00
Krish Dholakia
e678dce88b Merge pull request #4009 from BerriAI/litellm_fix_streaming_cost_cal 
fix(utils.py): fix cost calculation for openai-compatible streaming object
 2024-06-04 21:00:22 -07:00
Krrish Dholakia
1336957077 fix(utils.py): fix 2024-06-04 19:41:20 -07:00
Krrish Dholakia
e279498970 feat(utils.py): support 'stream_options' param across all providers 
Closes https://github.com/BerriAI/litellm/issues/3553
 2024-06-04 19:03:26 -07:00
Krrish Dholakia
d74ccc6c84 fix(utils.py): fix stream options to return consistent response object 2024-06-04 18:17:45 -07:00
Krrish Dholakia
7432c6a4d9 fix(utils.py): fix cost calculation for openai-compatible streaming object 2024-06-04 10:36:25 -07:00
Ishaan Jaff
e21408717c test - test gpt-3.5-turbo on test_parallel_streaming_requests 2024-06-01 20:56:33 -07:00
Krrish Dholakia
594daef07a fix(utils.py): correctly instrument passing through api version in optional param check 2024-06-01 19:31:52 -07:00
Krrish Dholakia
ca82b82d4b fix(test_scheduler.py): fix test 2024-06-01 11:30:26 -07:00
Krrish Dholakia
3896e3e88f fix: fix streaming with httpx client 
prevent overwriting streams in parallel streaming calls
 2024-05-31 10:55:18 -07:00
Krrish Dholakia
ccee9e4eb1 fix(anthropic.py): fix parallel streaming on anthropic.py 
prevent parallel requests from cancelling each other

Fixes https://github.com/BerriAI/litellm/issues/3881
 2024-05-28 16:29:09 -07:00
Andres Barbaro
abb8e17d4b Update test 2024-05-24 11:48:35 -05:00
Andres Barbaro
33a047315e Improve test 2024-05-24 11:11:43 -05:00
Andres Barbaro
2cce5b3959 Remove unnecessary import 2024-05-24 11:00:29 -05:00
Andres Barbaro
c893674180 Add test to validate chunks with no delta are processed correctly 2024-05-24 10:57:35 -05:00
Krrish Dholakia
143a44823a feat(databricks.py): adds databricks support - completion, async, streaming 
Closes https://github.com/BerriAI/litellm/issues/2160
 2024-05-23 16:29:46 -07:00
Krrish Dholakia
808bea03db test(test_streaming.py): retry if openai is inconsistent with stream options 2024-05-21 18:51:24 -07:00
Krrish Dholakia
56084d5ac1 fix(bedrock_httpx.py): support mapping for bedrock cohere command r text 2024-05-17 16:13:49 -07:00
Krrish Dholakia
13e4196e3e fix(bedrock_httpx.py): add async support for bedrock amazon, meta, mistral models 2024-05-16 22:39:25 -07:00
Krrish Dholakia
8409b39f0d fix(bedrock_httpx.py): move bedrock ai21 calls to being async 2024-05-16 22:21:30 -07:00
Krrish Dholakia
118fc4ffac fix(bedrock_httpx.py): move anthropic bedrock calls to httpx 
Fixing https://github.com/BerriAI/litellm/issues/2921
 2024-05-16 21:51:55 -07:00
Krrish Dholakia
e41897808d fix(replicate.py): move replicate calls to being completely async 
Closes https://github.com/BerriAI/litellm/issues/3128
 2024-05-16 17:24:08 -07:00
Krrish Dholakia
87a21115c5 test: handle watsonx rate limit error 2024-05-13 18:27:39 -07:00
Krish Dholakia
784ae85ba0 Merge branch 'main' into litellm_bedrock_command_r_support 2024-05-11 21:24:42 -07:00
Krrish Dholakia
df34c64464 test(test_streaming.py): fix test 2024-05-11 19:44:47 -07:00
Krrish Dholakia
68596ced04 feat(bedrock_httpx.py): working bedrock command-r sync+async streaming 2024-05-11 19:39:51 -07:00
Krish Dholakia
8ab9c861c9 Merge pull request #3369 from mogith-pn/main 
Clarifai-LiteLLM : Added clarifai as LLM Provider.
 2024-05-11 09:31:46 -07:00
Krish Dholakia
ddf09a3193 Merge pull request #3552 from BerriAI/litellm_predibase_support 
feat(predibase.py): add support for predibase provider
 2024-05-09 22:21:16 -07:00
Krrish Dholakia
7c0ab40fd5 feat(predibase.py): support async_completion + streaming (sync + async) 
finishes up pr
 2024-05-09 17:41:27 -07:00
Ishaan Jaff
27de9e92cc test - stream_options on OpenAI text_completion 2024-05-09 08:41:31 -07:00