Commit graph

113 commits

Author SHA1 Message Date
Krrish Dholakia
10f76ec36c test: testing fixes 2024-01-09 12:59:42 +05:30
Krrish Dholakia
b1fd0a164b fix(huggingface_restapi.py): support timeouts for huggingface + openai text completions
https://github.com/BerriAI/litellm/issues/1334
2024-01-08 11:40:56 +05:30
ishaan-jaff
6f9d3fc3bc (ci/cd) retry hosted ollama + stream test 3 times 2024-01-05 18:02:20 +05:30
Krrish Dholakia
c9fdbaf898 fix(azure.py,-openai.py): correctly raise errors if streaming calls fail 2023-12-27 15:08:37 +05:30
Krrish Dholakia
4905929de3 refactor: add black formatting 2023-12-25 14:11:20 +05:30
Krrish Dholakia
402b2e5733 build(test_streaming.py): fix linting issues 2023-12-25 07:34:54 +05:30
Krrish Dholakia
343a06fd84 fix(proxy_server.py): raise streaming exceptions 2023-12-25 07:18:09 +05:30
Krrish Dholakia
eb2d13e2fb test(test_completion.py-+-test_streaming.py): add ollama endpoint to ci/cd pipeline 2023-12-22 12:21:33 +05:30
ishaan-jaff
6cda49ac6a (test) mistral api streaming 2023-12-14 18:28:03 +05:30
Krrish Dholakia
dfdb17ae36 test: refactor testing 2023-12-12 16:21:41 -08:00
Krrish Dholakia
669862643b fix(utils.py): flush holding chunk for streaming, on stream end 2023-12-12 16:13:31 -08:00
Krrish Dholakia
8bb01422ee test(test_streaming.py): stricter output format testing 2023-12-12 00:16:48 -08:00
Krrish Dholakia
1d42967725 test(test_streaming.py): add testing for azure output chunk 2023-12-11 23:32:38 -08:00
Krrish Dholakia
a9fdae0d23 test(test_streaming.py): refactor testing 2023-11-29 19:58:04 -08:00
Krrish Dholakia
c312ac4ca8 fix(main.py): don't pass stream to petals 2023-11-29 19:58:04 -08:00
Krrish Dholakia
ab76daa90b fix(bedrock.py): support ai21 / bedrock streaming 2023-11-29 16:35:06 -08:00
Krrish Dholakia
a9ed768991 fix(azure.py): fix error handling for openai/azure streaming 2023-11-29 11:52:24 -08:00
Krrish Dholakia
e8331a4647 fix(utils.py): azure tool calling streaming 2023-11-27 19:07:38 -08:00
Krrish Dholakia
6d9f7b8f9d fix: fix nlp cloud streaming 2023-11-25 13:45:23 -08:00
Krrish Dholakia
30f47d3169 bump: version 1.7.0 → 1.7.1 2023-11-25 12:34:28 -08:00
Krrish Dholakia
94dc3f66f3 fix(utils.py): remove eos token for zephyr models 2023-11-23 17:47:39 -08:00
ishaan-jaff
b262f0846b (test) update testing streaming for open ai v1.0.0+ 2023-11-18 19:04:41 -08:00
ishaan-jaff
4b110b3fa4 (test) palm streaming test 2023-11-18 17:32:15 -08:00
ishaan-jaff
80002e9a14 (test) remove unused tests 2023-11-18 17:25:42 -08:00
ishaan-jaff
349a1472df (test) openai streaming + function calling 2023-11-18 17:01:46 -08:00
Krrish Dholakia
bf0f8b824c fix(azure.py): use openai client sdk for handling sync+async calling 2023-11-16 12:08:12 -08:00
Krrish Dholakia
bb51216846 fix(openai.py): supporting openai client sdk for handling sync + async calls (incl. for openai-compatible apis) 2023-11-16 10:35:03 -08:00
Krrish Dholakia
fe9c1e2b45 test(test_streaming.py): turning on print verbose for streaming tests 2023-11-13 18:00:48 -08:00
Krrish Dholakia
afc19caf0f test(utils.py): adding logging for azure streaming 2023-11-13 17:53:15 -08:00
Krrish Dholakia
42d0925209 test(test_streaming.py): adding retries to streaming tests 2023-11-13 16:34:59 -08:00
Krrish Dholakia
38ff412b9a fix(utils.py): fix response object mapping 2023-11-13 15:58:25 -08:00
Krrish Dholakia
8a3b771e50 fix(tests): fixing response objects for testing 2023-11-13 14:39:30 -08:00
Krrish Dholakia
547598a134 refactor(bedrock.py-+-cohere.py): making bedrock and cohere compatible with openai v1 sdk 2023-11-11 17:33:19 -08:00
Krrish Dholakia
39c2597c33 refactor(azure.py): working azure completion calls with openai v1 sdk 2023-11-11 16:44:39 -08:00
Krrish Dholakia
d0bd932b3c refactor(openai.py): working openai chat + text completion for openai v1 sdk 2023-11-11 16:25:10 -08:00
Krrish Dholakia
d3323ba637 refactor(openai.py): making it compatible for openai v1
BREAKING CHANGE:
2023-11-11 15:33:02 -08:00
Krrish Dholakia
697497cdfa test(test_streaming.py): set cache to none 2023-11-10 15:24:17 -08:00
ishaan-jaff
2c32f4a588 (test) fix caching 2023-11-10 15:23:56 -08:00
Krrish Dholakia
40edb546dc test(test_streaming.py): set cache to none 2023-11-10 15:04:01 -08:00
Krrish Dholakia
9bfbdc18fb feat(utils.py): enable returning complete response when stream=true 2023-11-09 09:17:51 -08:00
Krrish Dholakia
84f68b2cd1 test(test_streaming.py): fix linting errors 2023-11-08 19:31:06 -08:00
Krrish Dholakia
c2cbdb23fd refactor(openai.py): moving openai text completion calls to http 2023-11-08 18:40:03 -08:00
Krrish Dholakia
c57ed0a9d7 refactor(openai.py): moving openai chat completion calls to http 2023-11-08 17:40:41 -08:00
Krrish Dholakia
53abc31c27 refactor(azure.py): moving azure openai calls to http calls 2023-11-08 16:52:18 -08:00
Krrish Dholakia
caa199d851 test: removing unstable tests 2023-10-30 21:10:36 -07:00
Krrish Dholakia
0ed3917b09 feat(main.py): add support for maritalk api 2023-10-30 17:36:51 -07:00
Krrish Dholakia
b178596d05 test(test_streaming.py): commenting out sagemaker test due to aws key issue 2023-10-28 12:10:07 -07:00
Krrish Dholakia
9c0b475a14 test(test_proxy.py): deprecating cli tool 2023-10-21 15:53:42 -07:00
ishaan-jaff
3548a6ffc3 (test) test accessing class attributes for streamed responses 2023-10-20 13:06:25 -07:00
ishaan-jaff
3da89a58ae (test) temp comment unstable NLP Cloud API test 2023-10-12 18:24:37 -07:00