phoenix/litellm-mirror
0
0
Fork 1
mirror of https://github.com/BerriAI/litellm.git synced 2025-04-27 11:43:54 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions
10455 commits 2497 branches 897 tags 550 MiB
Commit graph

177 commits

Author SHA1 Message Date
Krish Dholakia
ef471480b2 Merge pull request #3124 from elisalimli/bugfix/add-missing-tool-calls-mistral-messages 
Add missing tool_calls and name to messages
 2024-04-23 17:25:12 -07:00
alisalim17
25e594dc44 test: add test forfunction calling with mistral large latest to test_streaming.py 2024-04-21 11:27:42 +04:00
Krrish Dholakia
64fe5b146c fix(utils.py): fix azure streaming logic 2024-04-18 07:08:36 -07:00
Krrish Dholakia
caa46ca905 fix(utils.py): fix streaming special character flushing logic 2024-04-17 18:03:40 -07:00
Krrish Dholakia
1b4462ee70 fix(utils.py): ensure streaming output parsing only applied for hf / sagemaker models 
selectively applies the <s>
</s> checking
 2024-04-17 17:43:41 -07:00
Ishaan Jaff
b00ad976af fix function calling prompt - ask llm to respond in fahrenheit 2024-04-16 21:09:53 -07:00
Krrish Dholakia
1cd0551a1e fix(anthropic_text.py): add support for async text completion calls 2024-04-15 08:15:00 -07:00
Ishaan Jaff
d1d3d932ca Merge pull request #2879 from BerriAI/litellm_async_anthropic_api 
[Feat] Async Anthropic API 97.5% lower median latency
 2024-04-07 09:56:52 -07:00
Ishaan Jaff
9b8555e482 undo adding next-asyncio 2024-04-06 19:28:51 -07:00
Krrish Dholakia
0d067fb65d test(test_streaming.py): fix vertex project name 2024-04-06 18:45:17 -07:00
Ishaan Jaff
c37383192f fix - test streaming 2024-04-06 18:28:07 -07:00
Ishaan Jaff
aca692282a (ci/cd) run again 2024-04-06 18:26:52 -07:00
Ishaan Jaff
ccab3cdfb5 Revert "fix test streaming" 
This reverts commit f10aba1007.
 2024-04-06 18:24:00 -07:00
Ishaan Jaff
9e92b9b8ad fix test streaming 2024-04-06 18:23:10 -07:00
Ishaan Jaff
436133b4b3 ci/cd run again 2024-04-06 18:07:41 -07:00
Ishaan Jaff
3978a17ff9 test - async claude streaming 2024-04-06 17:55:26 -07:00
Ishaan Jaff
8436b611b4 (ci/cd) run again 2024-04-05 20:44:51 -07:00
Ishaan Jaff
aa0c01dcf3 fix gemini test 2024-04-05 20:38:28 -07:00
Ishaan Jaff
54e4326a92 ci/cd - skip 429 errors from google gemini 2024-04-05 13:36:29 -07:00
Krrish Dholakia
271fe184eb fix(sagemaker.py): support model_id consistently. support dynamic args for async calls 2024-03-29 09:05:00 -07:00
Krrish Dholakia
006c20a10f fix(utils.py): support bedrock mistral streaming 2024-03-29 07:56:10 -07:00
Krrish Dholakia
05fddcb06b fix(utils.py): don't send subsequent chunks if last chunk sent 
prevents multiple empty finish chunks from being sent
 2024-03-26 13:49:42 -07:00
Krrish Dholakia
1137264d99 test(test_streaming.py): add unit testing for custom stream wrapper 2024-03-26 08:57:44 -07:00
Krrish Dholakia
be055f31ee test(test_azure_astreaming_and_function_calling): fix test to handle caching 2024-03-25 19:33:57 -07:00
Krrish Dholakia
26dbb76d53 fix(utils.py): ensure last chunk is always empty delta w/ finish reason 
makes sure we're openai-compatible with our streaming. Adds stricter tests for this as well
 2024-03-25 16:33:41 -07:00
Krrish Dholakia
16368fec98 fix(anthropic.py): support async claude 3 tool calling + streaming 
https://github.com/BerriAI/litellm/issues/2644
 2024-03-22 19:57:01 -07:00
Krrish Dholakia
697758e188 test(test_streaming.py): fix test 2024-03-18 22:06:29 -07:00
ishaan-jaff
960d7ae2a4 (fix-ci-cd) skip deep infra 429 errors 2024-03-13 22:05:16 -07:00
Krrish Dholakia
0bdaf3e05b test: set verbose for test 2024-03-12 12:56:38 -07:00
Krrish Dholakia
1c6438c267 fix(anthropic.py): support streaming with function calling 2024-03-12 09:52:11 -07:00
Krrish Dholakia
d8cf889597 fix(bedrock.py): enable claude-3 streaming 2024-03-09 14:02:27 -08:00
ishaan-jaff
f6e53f542c (ci/cd) run again 2024-03-08 22:05:39 -08:00
Krrish Dholakia
3dd680a7cd test(test_streaming.py): skip flaky test 2024-03-04 22:33:45 -08:00
Krrish Dholakia
0c00b57a5c fix(test_streaming.py): skip flaky test 2024-03-04 20:46:21 -08:00
Krrish Dholakia
dad65ca602 fix(bedrock.py): support anthropic messages api on bedrock (claude-3) 2024-03-04 17:15:47 -08:00
ishaan-jaff
351c648dc0 (fix) test streaming 2024-03-04 08:29:16 -08:00
Krish Dholakia
7d2a9f9222 Merge pull request #2236 from BerriAI/litellm_faster_usage_logs_pg_db 
fix(proxy_server.py): introduces a beta endpoint for admin to view global spend
 2024-02-28 17:08:55 -08:00
Krrish Dholakia
129e84f0c5 test: removing aws tests - account suspended - pending their approval 2024-02-28 13:46:20 -08:00
ishaan-jaff
6b253fec7c (test) hugging face test - their endpoint is unstable 2024-02-28 12:11:29 -08:00
Krrish Dholakia
032eb2f143 test(test_streaming.py): add more logging 2024-02-26 21:44:28 -08:00
Krrish Dholakia
4e608c86c1 fix(utils.py): fix streaming 2024-02-26 12:52:53 -08:00
Krrish Dholakia
dcca55159b fix(utils.py): support returning caching streaming response for function calling streaming calls 2024-02-26 12:31:00 -08:00
Krrish Dholakia
74b97b23e9 fix(utils.py): stricter azure function calling tests 2024-02-23 20:55:32 -08:00
Krish Dholakia
858c21c96d Merge branch 'main' into litellm_fix_azure_function_calling_streaming 2024-02-22 22:36:38 -08:00
Krrish Dholakia
38f7873d6f test(test_streaming.py): fix openai streaming function calling test 2024-02-22 21:50:14 -08:00
Krrish Dholakia
5775526453 test(test_streaming.py): add exception mapping for palm timeout error 2024-02-22 21:36:57 -08:00
Krrish Dholakia
3b156888a6 fix(utils.py): ensure argument is always a string 2024-02-22 15:15:56 -08:00
Krrish Dholakia
75d30cd000 test: handle api errors for gemini/palm testing 2024-02-21 21:44:08 -08:00
Krrish Dholakia
540c9e7bae test(test_streaming.py): handle gemini 500 error 2024-02-21 21:32:03 -08:00
Krrish Dholakia
13b35db8d7 fix(gemini.py): implement custom streamer 2024-02-20 17:10:51 -08:00