phoenix/litellm-mirror
0
0
Fork 1
mirror of https://github.com/BerriAI/litellm.git synced 2025-04-27 11:43:54 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions
17541 commits 2497 branches 897 tags 550 MiB
Commit graph

274 commits

Author SHA1 Message Date
Krrish Dholakia
5de569fcb1 feat(sagemaker.py): aioboto3 streaming support 2024-02-12 21:18:34 -08:00
Krrish Dholakia
0ab8b764cc fix(utils.py): fix deepinfra streaming 2024-02-01 18:46:50 -08:00
Krrish Dholakia
bdc749baa0 test(test_streaming.py): add test to make sure role is not returned in middle chunks during streaming 2024-02-01 09:55:56 -08:00
Krrish Dholakia
2a9d8c1b70 test(test_streaming.py): fix test to handle none chunk 2024-01-25 18:34:13 -08:00
Krrish Dholakia
402235dc5d fix(utils.py): fix sagemaker async logging for sync streaming 
https://github.com/BerriAI/litellm/issues/1592
 2024-01-25 12:49:45 -08:00
ishaan-jaff
d966e2dadd (test) test chunk_ids match across chunks for bedrock 2024-01-23 13:06:05 -08:00
ishaan-jaff
e2e56c03f4 (test) fix sagemaker stream test 2024-01-23 10:07:13 -08:00
Krrish Dholakia
2ecc2f12cd fix(gemini.py): support streaming 2024-01-19 20:21:34 -08:00
ishaan-jaff
af5cbf75f8 (ci/cd) skip streaming + hosted ollama flaky test 2024-01-16 15:01:56 -08:00
ishaan-jaff
7226fdff57 (ci/cd) fix olama hosted testing 2024-01-16 12:27:16 -08:00
ishaan-jaff
99474dbf33 (test) custom_llm_provider in streaming response 2024-01-12 17:15:15 -08:00
Krrish Dholakia
49e9604de1 test: testing fixes 2024-01-09 10:23:34 +05:30
Krrish Dholakia
e4a5a3395c fix(huggingface_restapi.py): support timeouts for huggingface + openai text completions 
https://github.com/BerriAI/litellm/issues/1334
 2024-01-08 11:40:56 +05:30
ishaan-jaff
89c80f2a60 (ci/cd) retry hosted ollama + stream test 3 times 2024-01-05 18:02:20 +05:30
Krrish Dholakia
fd5e6efb1d fix(azure.py,-openai.py): correctly raise errors if streaming calls fail 2023-12-27 15:08:37 +05:30
Krrish Dholakia
79978c44ba refactor: add black formatting 2023-12-25 14:11:20 +05:30
Krrish Dholakia
72e8c84914 build(test_streaming.py): fix linting issues 2023-12-25 07:34:54 +05:30
Krrish Dholakia
6d73a77b01 fix(proxy_server.py): raise streaming exceptions 2023-12-25 07:18:09 +05:30
Krrish Dholakia
a65dfdde94 test(test_completion.py-+-test_streaming.py): add ollama endpoint to ci/cd pipeline 2023-12-22 12:21:33 +05:30
ishaan-jaff
4fb2dd7cae (test) mistral api streaming 2023-12-14 18:28:03 +05:30
Krrish Dholakia
c0d42ab5b1 test: refactor testing 2023-12-12 16:21:41 -08:00
Krrish Dholakia
d0e01d7e7a fix(utils.py): flush holding chunk for streaming, on stream end 2023-12-12 16:13:31 -08:00
Krrish Dholakia
243b914965 test(test_streaming.py): stricter output format testing 2023-12-12 00:16:48 -08:00
Krrish Dholakia
2c49bd4c60 test(test_streaming.py): add testing for azure output chunk 2023-12-11 23:32:38 -08:00
Krrish Dholakia
a94b6b5cd5 test(test_streaming.py): refactor testing 2023-11-29 19:58:04 -08:00
Krrish Dholakia
a1ea893a73 fix(main.py): don't pass stream to petals 2023-11-29 19:58:04 -08:00
Krrish Dholakia
2a5592abe7 fix(bedrock.py): support ai21 / bedrock streaming 2023-11-29 16:35:06 -08:00
Krrish Dholakia
ff865ab2c5 fix(azure.py): fix error handling for openai/azure streaming 2023-11-29 11:52:24 -08:00
Krrish Dholakia
5450fb26f4 fix(utils.py): azure tool calling streaming 2023-11-27 19:07:38 -08:00
Krrish Dholakia
0b2c1496d2 fix: fix nlp cloud streaming 2023-11-25 13:45:23 -08:00
Krrish Dholakia
20ca1b32eb bump: version 1.7.0 → 1.7.1 2023-11-25 12:34:28 -08:00
Krrish Dholakia
90385ef6a5 fix(utils.py): remove eos token for zephyr models 2023-11-23 17:47:39 -08:00
ishaan-jaff
7e6c37962b (test) update testing streaming for open ai v1.0.0+ 2023-11-18 19:04:41 -08:00
ishaan-jaff
e276023462 (test) palm streaming test 2023-11-18 17:32:15 -08:00
ishaan-jaff
9bea4044b0 (test) remove unused tests 2023-11-18 17:25:42 -08:00
ishaan-jaff
b2f8f8ed45 (test) openai streaming + function calling 2023-11-18 17:01:46 -08:00
Krrish Dholakia
e54056f0ed fix(azure.py): use openai client sdk for handling sync+async calling 2023-11-16 12:08:12 -08:00
Krrish Dholakia
9c7cc84eb0 fix(openai.py): supporting openai client sdk for handling sync + async calls (incl. for openai-compatible apis) 2023-11-16 10:35:03 -08:00
Krrish Dholakia
68a4229d0c test(test_streaming.py): turning on print verbose for streaming tests 2023-11-13 18:00:48 -08:00
Krrish Dholakia
c86be7665d test(utils.py): adding logging for azure streaming 2023-11-13 17:53:15 -08:00
Krrish Dholakia
4031f25345 test(test_streaming.py): adding retries to streaming tests 2023-11-13 16:34:59 -08:00
Krrish Dholakia
777a924e6b fix(utils.py): fix response object mapping 2023-11-13 15:58:25 -08:00
Krrish Dholakia
330708e7ef fix(tests): fixing response objects for testing 2023-11-13 14:39:30 -08:00
Krrish Dholakia
7b4e21e574 refactor(bedrock.py-+-cohere.py): making bedrock and cohere compatible with openai v1 sdk 2023-11-11 17:33:19 -08:00
Krrish Dholakia
c0a757a25f refactor(azure.py): working azure completion calls with openai v1 sdk 2023-11-11 16:44:39 -08:00
Krrish Dholakia
1ec07c0aba refactor(openai.py): working openai chat + text completion for openai v1 sdk 2023-11-11 16:25:10 -08:00
Krrish Dholakia
a5ec85b1f2 refactor(openai.py): making it compatible for openai v1 
BREAKING CHANGE:
 2023-11-11 15:33:02 -08:00
Krrish Dholakia
11d1651d36 test(test_streaming.py): set cache to none 2023-11-10 15:24:17 -08:00
ishaan-jaff
4e071291bb (test) fix caching 2023-11-10 15:23:56 -08:00
Krrish Dholakia
4c103592e3 test(test_streaming.py): set cache to none 2023-11-10 15:04:01 -08:00