277 commits

Author	SHA1	Message	Date
Krrish Dholakia	11c12e7381	fix(gemini.py): fix async streaming + add native async completions	2024-02-19 22:41:36 -08:00
Krrish Dholakia	9c2cce56f7	fix(huggingface_restapi.py): return streamed response correctly	2024-02-16 13:25:13 -08:00
Krrish Dholakia	f82a335118	fix(test_streaming.py): handle hf tgi zephyr not loading for streaming issue	2024-02-15 19:24:02 -08:00
Krrish Dholakia	5de569fcb1	feat(sagemaker.py): aioboto3 streaming support	2024-02-12 21:18:34 -08:00
Krrish Dholakia	0ab8b764cc	fix(utils.py): fix deepinfra streaming	2024-02-01 18:46:50 -08:00
Krrish Dholakia	bdc749baa0	test(test_streaming.py): add test to make sure role is not returned in middle chunks during streaming	2024-02-01 09:55:56 -08:00
Krrish Dholakia	2a9d8c1b70	test(test_streaming.py): fix test to handle none chunk	2024-01-25 18:34:13 -08:00
Krrish Dholakia	402235dc5d	fix(utils.py): fix sagemaker async logging for sync streaming ... https://github.com/BerriAI/litellm/issues/1592	2024-01-25 12:49:45 -08:00
ishaan-jaff	d966e2dadd	(test) test chunk_ids match across chunks for bedrock	2024-01-23 13:06:05 -08:00
ishaan-jaff	e2e56c03f4	(test) fix sagemaker stream test	2024-01-23 10:07:13 -08:00
Krrish Dholakia	2ecc2f12cd	fix(gemini.py): support streaming	2024-01-19 20:21:34 -08:00
ishaan-jaff	af5cbf75f8	(ci/cd) skip streaming + hosted ollama flaky test	2024-01-16 15:01:56 -08:00
ishaan-jaff	7226fdff57	(ci/cd) fix olama hosted testing	2024-01-16 12:27:16 -08:00
ishaan-jaff	99474dbf33	(test) custom_llm_provider in streaming response	2024-01-12 17:15:15 -08:00
Krrish Dholakia	49e9604de1	test: testing fixes	2024-01-09 10:23:34 +05:30
Krrish Dholakia	e4a5a3395c	fix(huggingface_restapi.py): support timeouts for huggingface + openai text completions ... https://github.com/BerriAI/litellm/issues/1334	2024-01-08 11:40:56 +05:30
ishaan-jaff	89c80f2a60	(ci/cd) retry hosted ollama + stream test 3 times	2024-01-05 18:02:20 +05:30
Krrish Dholakia	fd5e6efb1d	fix(azure.py,-openai.py): correctly raise errors if streaming calls fail	2023-12-27 15:08:37 +05:30
Krrish Dholakia	79978c44ba	refactor: add black formatting	2023-12-25 14:11:20 +05:30
Krrish Dholakia	72e8c84914	build(test_streaming.py): fix linting issues	2023-12-25 07:34:54 +05:30
Krrish Dholakia	6d73a77b01	fix(proxy_server.py): raise streaming exceptions	2023-12-25 07:18:09 +05:30
Krrish Dholakia	a65dfdde94	test(test_completion.py-+-test_streaming.py): add ollama endpoint to ci/cd pipeline	2023-12-22 12:21:33 +05:30
ishaan-jaff	4fb2dd7cae	(test) mistral api streaming	2023-12-14 18:28:03 +05:30
Krrish Dholakia	c0d42ab5b1	test: refactor testing	2023-12-12 16:21:41 -08:00
Krrish Dholakia	d0e01d7e7a	fix(utils.py): flush holding chunk for streaming, on stream end	2023-12-12 16:13:31 -08:00
Krrish Dholakia	243b914965	test(test_streaming.py): stricter output format testing	2023-12-12 00:16:48 -08:00
Krrish Dholakia	2c49bd4c60	test(test_streaming.py): add testing for azure output chunk	2023-12-11 23:32:38 -08:00
Krrish Dholakia	a94b6b5cd5	test(test_streaming.py): refactor testing	2023-11-29 19:58:04 -08:00
Krrish Dholakia	a1ea893a73	fix(main.py): don't pass stream to petals	2023-11-29 19:58:04 -08:00
Krrish Dholakia	2a5592abe7	fix(bedrock.py): support ai21 / bedrock streaming	2023-11-29 16:35:06 -08:00
Krrish Dholakia	ff865ab2c5	fix(azure.py): fix error handling for openai/azure streaming	2023-11-29 11:52:24 -08:00
Krrish Dholakia	5450fb26f4	fix(utils.py): azure tool calling streaming	2023-11-27 19:07:38 -08:00
Krrish Dholakia	0b2c1496d2	fix: fix nlp cloud streaming	2023-11-25 13:45:23 -08:00
Krrish Dholakia	20ca1b32eb	bump: version 1.7.0 → 1.7.1	2023-11-25 12:34:28 -08:00
Krrish Dholakia	90385ef6a5	fix(utils.py): remove eos token for zephyr models	2023-11-23 17:47:39 -08:00
ishaan-jaff	7e6c37962b	(test) update testing streaming for open ai v1.0.0+	2023-11-18 19:04:41 -08:00
ishaan-jaff	e276023462	(test) palm streaming test	2023-11-18 17:32:15 -08:00
ishaan-jaff	9bea4044b0	(test) remove unused tests	2023-11-18 17:25:42 -08:00
ishaan-jaff	b2f8f8ed45	(test) openai streaming + function calling	2023-11-18 17:01:46 -08:00
Krrish Dholakia	e54056f0ed	fix(azure.py): use openai client sdk for handling sync+async calling	2023-11-16 12:08:12 -08:00
Krrish Dholakia	9c7cc84eb0	fix(openai.py): supporting openai client sdk for handling sync + async calls (incl. for openai-compatible apis)	2023-11-16 10:35:03 -08:00
Krrish Dholakia	68a4229d0c	test(test_streaming.py): turning on print verbose for streaming tests	2023-11-13 18:00:48 -08:00
Krrish Dholakia	c86be7665d	test(utils.py): adding logging for azure streaming	2023-11-13 17:53:15 -08:00
Krrish Dholakia	4031f25345	test(test_streaming.py): adding retries to streaming tests	2023-11-13 16:34:59 -08:00
Krrish Dholakia	777a924e6b	fix(utils.py): fix response object mapping	2023-11-13 15:58:25 -08:00
Krrish Dholakia	330708e7ef	fix(tests): fixing response objects for testing	2023-11-13 14:39:30 -08:00
Krrish Dholakia	7b4e21e574	refactor(bedrock.py-+-cohere.py): making bedrock and cohere compatible with openai v1 sdk	2023-11-11 17:33:19 -08:00
Krrish Dholakia	c0a757a25f	refactor(azure.py): working azure completion calls with openai v1 sdk	2023-11-11 16:44:39 -08:00
Krrish Dholakia	1ec07c0aba	refactor(openai.py): working openai chat + text completion for openai v1 sdk	2023-11-11 16:25:10 -08:00
Krrish Dholakia	a5ec85b1f2	refactor(openai.py): making it compatible for openai v1 ... BREAKING CHANGE:	2023-11-11 15:33:02 -08:00