262 commits

Author	SHA1	Message	Date
ishaan-jaff	e77fc7e10d	(feat) bedrock add finish_reason to streaming responses	2023-10-12 16:22:34 -07:00
ishaan-jaff	7378ec5f68	(test) catch bedrock RateLimitErrors	2023-10-12 16:04:32 -07:00
ishaan-jaff	83ac1ec91a	(test) try replicate test streaming with verbose mode	2023-10-12 15:48:20 -07:00
ishaan-jaff	d818ead0e5	(test) fix failing replicate test, catch AuthenticationError	2023-10-12 15:24:33 -07:00
ishaan-jaff	a70797086c	(test) openai api currently flaky - leading to failures	2023-10-11 22:32:53 -07:00
ishaan-jaff	3e05e7ad24	(test) flaky cohere endpoint for streaming	2023-10-11 22:11:20 -07:00
ishaan-jaff	e41f237fde	(test) fix streaming test - running into rate limits, set max_tokens	2023-10-11 21:32:00 -07:00
Krrish Dholakia	cc0e4f4f9f	fix: fix value error if model returns empty completion	2023-10-10 10:11:40 -07:00
Krrish Dholakia	1c9f87751d	fix(test-fixes): test fixes	2023-10-10 08:09:42 -07:00
Krrish Dholakia	5ab3a4b8d7	fix(add-custom-success-callback-for-streaming): add custom success callback for streaming	2023-10-06 15:02:02 -07:00
Krrish Dholakia	c7384859a3	support n param for hf	2023-10-03 07:10:13 -07:00
Krrish Dholakia	8c48af11c2	fixes to get optional params	2023-10-02 14:44:11 -07:00
Krrish Dholakia	05b0ae2e67	fix streaming test	2023-09-30 15:59:27 -07:00
Krrish Dholakia	5e394ce95a	add support for custom hf prompt templates	2023-09-30 15:37:30 -07:00
Krrish Dholakia	11bee9a641	fix streaming tests	2023-09-29 22:41:04 -07:00
Krrish Dholakia	6ac9470203	add mistral prompt templating	2023-09-29 21:41:28 -07:00
ishaan-jaff	4c9aadc33e	flaky bedrock test	2023-09-28 20:09:19 -07:00
ishaan-jaff	906a25ba06	flaky bedrock streaming test	2023-09-28 20:06:10 -07:00
ishaan-jaff	4b903742a4	new test for deep infra	2023-09-26 13:15:39 -07:00
ishaan-jaff	804bfee1a2	add palm stream testing	2023-09-26 12:32:59 -07:00
Krrish Dholakia	20eb0229e4	bump version and fix testing issue	2023-09-23 23:07:41 -07:00
Krrish Dholakia	b32ea90939	bump versions	2023-09-23 22:32:20 -07:00
Krrish Dholakia	bb46c60a7d	fix linting bugs	2023-09-23 22:23:41 -07:00
Krrish Dholakia	3cac04f459	fix exception mapping for streaming	2023-09-23 15:04:59 -07:00
Krrish Dholakia	6f4641ac47	handle llama 2 eos tokens in streaming	2023-09-18 13:44:19 -07:00
Krrish Dholakia	b45bb78bee	bump pyproject version	2023-09-16 20:45:16 -07:00
Krrish Dholakia	1ac316cc0a	bug fixes	2023-09-16 16:32:12 -07:00
Krrish Dholakia	d80fe482ce	except custom openai proxy	2023-09-16 16:15:44 -07:00
Krrish Dholakia	b3b445a5f8	check function call + streaming format	2023-09-16 13:31:18 -07:00
Krrish Dholakia	84ff5c2e46	bump version and fix testing	2023-09-16 13:04:59 -07:00
Krrish Dholakia	8df2916078	bump version	2023-09-16 12:28:57 -07:00
Krrish Dholakia	925ec2ded9	fixes to testing	2023-09-16 11:40:01 -07:00
ishaan-jaff	d34b9f3688	add extensive oi test	2023-09-16 11:27:22 -07:00
Krrish Dholakia	38e443a1b4	moving open interpreter tests	2023-09-16 11:04:35 -07:00
Krrish Dholakia	1e2d6846ac	improvements to streaming	2023-09-16 11:02:06 -07:00
Krrish Dholakia	0a1f3af840	ensure streaming format is exactly the same as openai	2023-09-16 10:35:20 -07:00
Krrish Dholakia	c2895268ba	update testing	2023-09-15 17:32:10 -07:00
Krrish Dholakia	0e6ace7875	fixes to streaming	2023-09-15 17:23:10 -07:00
Krrish Dholakia	ec559e854d	streaming fixes	2023-09-15 15:49:20 -07:00
Krrish Dholakia	e7b31bb7fc	fix streaming error	2023-09-15 15:21:15 -07:00
Krrish Dholakia	47253018bb	fixes to streaming	2023-09-14 19:27:12 -07:00
Krrish Dholakia	8b5a90aac7	fix streaming objects	2023-09-14 17:16:43 -07:00
Krrish Dholakia	22fb574009	move cohere to http endpoint	2023-09-14 11:17:38 -07:00
Krrish Dholakia	6cd950a031	return model name as part of streaming object	2023-09-13 09:48:49 -07:00
Krrish Dholakia	51b64c59f3	update streaming docs to show it working for async completion calls	2023-09-05 09:18:37 -07:00
Krrish Dholakia	548b419005	test async streaming	2023-09-04 15:42:24 -07:00
Krrish Dholakia	a972676655	adding support for aleph alpha	2023-09-02 13:15:41 -07:00
Krrish Dholakia	4927e5879f	update baseten handler to handle TGI calls	2023-08-30 19:14:48 -07:00
Krrish Dholakia	3087c904eb	fixes to streaming for ai21, baseten, and openai text completions	2023-08-28 09:42:51 -07:00
ishaan-jaff	a69b7ffcfa	formatting improvements	2023-08-28 09:20:50 -07:00