phoenix/litellm-mirror
0
0
Fork 1
mirror of https://github.com/BerriAI/litellm.git synced 2025-04-27 11:43:54 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions
4833 commits 2497 branches 897 tags 550 MiB
Commit graph

107 commits

Author SHA1 Message Date
Krrish Dholakia
6d73a77b01 fix(proxy_server.py): raise streaming exceptions 2023-12-25 07:18:09 +05:30
Krrish Dholakia
a65dfdde94 test(test_completion.py-+-test_streaming.py): add ollama endpoint to ci/cd pipeline 2023-12-22 12:21:33 +05:30
ishaan-jaff
4fb2dd7cae (test) mistral api streaming 2023-12-14 18:28:03 +05:30
Krrish Dholakia
c0d42ab5b1 test: refactor testing 2023-12-12 16:21:41 -08:00
Krrish Dholakia
d0e01d7e7a fix(utils.py): flush holding chunk for streaming, on stream end 2023-12-12 16:13:31 -08:00
Krrish Dholakia
243b914965 test(test_streaming.py): stricter output format testing 2023-12-12 00:16:48 -08:00
Krrish Dholakia
2c49bd4c60 test(test_streaming.py): add testing for azure output chunk 2023-12-11 23:32:38 -08:00
Krrish Dholakia
a94b6b5cd5 test(test_streaming.py): refactor testing 2023-11-29 19:58:04 -08:00
Krrish Dholakia
a1ea893a73 fix(main.py): don't pass stream to petals 2023-11-29 19:58:04 -08:00
Krrish Dholakia
2a5592abe7 fix(bedrock.py): support ai21 / bedrock streaming 2023-11-29 16:35:06 -08:00
Krrish Dholakia
ff865ab2c5 fix(azure.py): fix error handling for openai/azure streaming 2023-11-29 11:52:24 -08:00
Krrish Dholakia
5450fb26f4 fix(utils.py): azure tool calling streaming 2023-11-27 19:07:38 -08:00
Krrish Dholakia
0b2c1496d2 fix: fix nlp cloud streaming 2023-11-25 13:45:23 -08:00
Krrish Dholakia
20ca1b32eb bump: version 1.7.0 → 1.7.1 2023-11-25 12:34:28 -08:00
Krrish Dholakia
90385ef6a5 fix(utils.py): remove eos token for zephyr models 2023-11-23 17:47:39 -08:00
ishaan-jaff
7e6c37962b (test) update testing streaming for open ai v1.0.0+ 2023-11-18 19:04:41 -08:00
ishaan-jaff
e276023462 (test) palm streaming test 2023-11-18 17:32:15 -08:00
ishaan-jaff
9bea4044b0 (test) remove unused tests 2023-11-18 17:25:42 -08:00
ishaan-jaff
b2f8f8ed45 (test) openai streaming + function calling 2023-11-18 17:01:46 -08:00
Krrish Dholakia
e54056f0ed fix(azure.py): use openai client sdk for handling sync+async calling 2023-11-16 12:08:12 -08:00
Krrish Dholakia
9c7cc84eb0 fix(openai.py): supporting openai client sdk for handling sync + async calls (incl. for openai-compatible apis) 2023-11-16 10:35:03 -08:00
Krrish Dholakia
68a4229d0c test(test_streaming.py): turning on print verbose for streaming tests 2023-11-13 18:00:48 -08:00
Krrish Dholakia
c86be7665d test(utils.py): adding logging for azure streaming 2023-11-13 17:53:15 -08:00
Krrish Dholakia
4031f25345 test(test_streaming.py): adding retries to streaming tests 2023-11-13 16:34:59 -08:00
Krrish Dholakia
777a924e6b fix(utils.py): fix response object mapping 2023-11-13 15:58:25 -08:00
Krrish Dholakia
330708e7ef fix(tests): fixing response objects for testing 2023-11-13 14:39:30 -08:00
Krrish Dholakia
7b4e21e574 refactor(bedrock.py-+-cohere.py): making bedrock and cohere compatible with openai v1 sdk 2023-11-11 17:33:19 -08:00
Krrish Dholakia
c0a757a25f refactor(azure.py): working azure completion calls with openai v1 sdk 2023-11-11 16:44:39 -08:00
Krrish Dholakia
1ec07c0aba refactor(openai.py): working openai chat + text completion for openai v1 sdk 2023-11-11 16:25:10 -08:00
Krrish Dholakia
a5ec85b1f2 refactor(openai.py): making it compatible for openai v1 
BREAKING CHANGE:
 2023-11-11 15:33:02 -08:00
Krrish Dholakia
11d1651d36 test(test_streaming.py): set cache to none 2023-11-10 15:24:17 -08:00
ishaan-jaff
4e071291bb (test) fix caching 2023-11-10 15:23:56 -08:00
Krrish Dholakia
4c103592e3 test(test_streaming.py): set cache to none 2023-11-10 15:04:01 -08:00
Krrish Dholakia
8ee4b1f603 feat(utils.py): enable returning complete response when stream=true 2023-11-09 09:17:51 -08:00
Krrish Dholakia
36c99b93c6 test(test_streaming.py): fix linting errors 2023-11-08 19:31:06 -08:00
Krrish Dholakia
e66373bd47 refactor(openai.py): moving openai text completion calls to http 2023-11-08 18:40:03 -08:00
Krrish Dholakia
decf86b145 refactor(openai.py): moving openai chat completion calls to http 2023-11-08 17:40:41 -08:00
Krrish Dholakia
17f5e46080 refactor(azure.py): moving azure openai calls to http calls 2023-11-08 16:52:18 -08:00
Krrish Dholakia
297bd67a45 test: removing unstable tests 2023-10-30 21:10:36 -07:00
Krrish Dholakia
147d69f230 feat(main.py): add support for maritalk api 2023-10-30 17:36:51 -07:00
Krrish Dholakia
879b4b983f test(test_streaming.py): commenting out sagemaker test due to aws key issue 2023-10-28 12:10:07 -07:00
Krrish Dholakia
b95720bfea test(test_proxy.py): deprecating cli tool 2023-10-21 15:53:42 -07:00
ishaan-jaff
f54da33f05 (test) test accessing class attributes for streamed responses 2023-10-20 13:06:25 -07:00
ishaan-jaff
bcd16640a2 (test) temp comment unstable NLP Cloud API test 2023-10-12 18:24:37 -07:00
ishaan-jaff
7de993300b (test) load_dotenv in streaming tests 2023-10-12 16:35:33 -07:00
ishaan-jaff
e77fc7e10d (feat) bedrock add finish_reason to streaming responses 2023-10-12 16:22:34 -07:00
ishaan-jaff
7378ec5f68 (test) catch bedrock RateLimitErrors 2023-10-12 16:04:32 -07:00
ishaan-jaff
83ac1ec91a (test) try replicate test streaming with verbose mode 2023-10-12 15:48:20 -07:00
ishaan-jaff
d818ead0e5 (test) fix failing replicate test, catch AuthenticationError 2023-10-12 15:24:33 -07:00
ishaan-jaff
a70797086c (test) openai api currently flaky - leading to failures 2023-10-11 22:32:53 -07:00