243 commits

Author	SHA1	Message	Date
Krrish Dholakia	90385ef6a5	fix(utils.py): remove eos token for zephyr models	2023-11-23 17:47:39 -08:00
ishaan-jaff	7e6c37962b	(test) update testing streaming for open ai v1.0.0+	2023-11-18 19:04:41 -08:00
ishaan-jaff	e276023462	(test) palm streaming test	2023-11-18 17:32:15 -08:00
ishaan-jaff	9bea4044b0	(test) remove unused tests	2023-11-18 17:25:42 -08:00
ishaan-jaff	b2f8f8ed45	(test) openai streaming + function calling	2023-11-18 17:01:46 -08:00
Krrish Dholakia	e54056f0ed	fix(azure.py): use openai client sdk for handling sync+async calling	2023-11-16 12:08:12 -08:00
Krrish Dholakia	9c7cc84eb0	fix(openai.py): supporting openai client sdk for handling sync + async calls (incl. for openai-compatible apis)	2023-11-16 10:35:03 -08:00
Krrish Dholakia	68a4229d0c	test(test_streaming.py): turning on print verbose for streaming tests	2023-11-13 18:00:48 -08:00
Krrish Dholakia	c86be7665d	test(utils.py): adding logging for azure streaming	2023-11-13 17:53:15 -08:00
Krrish Dholakia	4031f25345	test(test_streaming.py): adding retries to streaming tests	2023-11-13 16:34:59 -08:00
Krrish Dholakia	777a924e6b	fix(utils.py): fix response object mapping	2023-11-13 15:58:25 -08:00
Krrish Dholakia	330708e7ef	fix(tests): fixing response objects for testing	2023-11-13 14:39:30 -08:00
Krrish Dholakia	7b4e21e574	refactor(bedrock.py-+-cohere.py): making bedrock and cohere compatible with openai v1 sdk	2023-11-11 17:33:19 -08:00
Krrish Dholakia	c0a757a25f	refactor(azure.py): working azure completion calls with openai v1 sdk	2023-11-11 16:44:39 -08:00
Krrish Dholakia	1ec07c0aba	refactor(openai.py): working openai chat + text completion for openai v1 sdk	2023-11-11 16:25:10 -08:00
Krrish Dholakia	a5ec85b1f2	refactor(openai.py): making it compatible for openai v1 ... BREAKING CHANGE:	2023-11-11 15:33:02 -08:00
Krrish Dholakia	11d1651d36	test(test_streaming.py): set cache to none	2023-11-10 15:24:17 -08:00
ishaan-jaff	4e071291bb	(test) fix caching	2023-11-10 15:23:56 -08:00
Krrish Dholakia	4c103592e3	test(test_streaming.py): set cache to none	2023-11-10 15:04:01 -08:00
Krrish Dholakia	8ee4b1f603	feat(utils.py): enable returning complete response when stream=true	2023-11-09 09:17:51 -08:00
Krrish Dholakia	36c99b93c6	test(test_streaming.py): fix linting errors	2023-11-08 19:31:06 -08:00
Krrish Dholakia	e66373bd47	refactor(openai.py): moving openai text completion calls to http	2023-11-08 18:40:03 -08:00
Krrish Dholakia	decf86b145	refactor(openai.py): moving openai chat completion calls to http	2023-11-08 17:40:41 -08:00
Krrish Dholakia	17f5e46080	refactor(azure.py): moving azure openai calls to http calls	2023-11-08 16:52:18 -08:00
Krrish Dholakia	297bd67a45	test: removing unstable tests	2023-10-30 21:10:36 -07:00
Krrish Dholakia	147d69f230	feat(main.py): add support for maritalk api	2023-10-30 17:36:51 -07:00
Krrish Dholakia	879b4b983f	test(test_streaming.py): commenting out sagemaker test due to aws key issue	2023-10-28 12:10:07 -07:00
Krrish Dholakia	b95720bfea	test(test_proxy.py): deprecating cli tool	2023-10-21 15:53:42 -07:00
ishaan-jaff	f54da33f05	(test) test accessing class attributes for streamed responses	2023-10-20 13:06:25 -07:00
ishaan-jaff	bcd16640a2	(test) temp comment unstable NLP Cloud API test	2023-10-12 18:24:37 -07:00
ishaan-jaff	7de993300b	(test) load_dotenv in streaming tests	2023-10-12 16:35:33 -07:00
ishaan-jaff	e77fc7e10d	(feat) bedrock add finish_reason to streaming responses	2023-10-12 16:22:34 -07:00
ishaan-jaff	7378ec5f68	(test) catch bedrock RateLimitErrors	2023-10-12 16:04:32 -07:00
ishaan-jaff	83ac1ec91a	(test) try replicate test streaming with verbose mode	2023-10-12 15:48:20 -07:00
ishaan-jaff	d818ead0e5	(test) fix failing replicate test, catch AuthenticationError	2023-10-12 15:24:33 -07:00
ishaan-jaff	a70797086c	(test) openai api currently flaky - leading to failures	2023-10-11 22:32:53 -07:00
ishaan-jaff	3e05e7ad24	(test) flaky cohere endpoint for streaming	2023-10-11 22:11:20 -07:00
ishaan-jaff	e41f237fde	(test) fix streaming test - running into rate limits, set max_tokens	2023-10-11 21:32:00 -07:00
Krrish Dholakia	cc0e4f4f9f	fix: fix value error if model returns empty completion	2023-10-10 10:11:40 -07:00
Krrish Dholakia	1c9f87751d	fix(test-fixes): test fixes	2023-10-10 08:09:42 -07:00
Krrish Dholakia	5ab3a4b8d7	fix(add-custom-success-callback-for-streaming): add custom success callback for streaming	2023-10-06 15:02:02 -07:00
Krrish Dholakia	c7384859a3	support n param for hf	2023-10-03 07:10:13 -07:00
Krrish Dholakia	8c48af11c2	fixes to get optional params	2023-10-02 14:44:11 -07:00
Krrish Dholakia	05b0ae2e67	fix streaming test	2023-09-30 15:59:27 -07:00
Krrish Dholakia	5e394ce95a	add support for custom hf prompt templates	2023-09-30 15:37:30 -07:00
Krrish Dholakia	11bee9a641	fix streaming tests	2023-09-29 22:41:04 -07:00
Krrish Dholakia	6ac9470203	add mistral prompt templating	2023-09-29 21:41:28 -07:00
ishaan-jaff	4c9aadc33e	flaky bedrock test	2023-09-28 20:09:19 -07:00
ishaan-jaff	906a25ba06	flaky bedrock streaming test	2023-09-28 20:06:10 -07:00
ishaan-jaff	4b903742a4	new test for deep infra	2023-09-26 13:15:39 -07:00