177 commits

Author	SHA1	Message	Date
Krrish Dholakia	14fa57c185	batch completions for vllm now works too	2023-09-06 19:26:19 -07:00
Krrish Dholakia	7290a972e5	adding support for vllm	2023-09-06 18:07:44 -07:00
ishaan-jaff	3fbf700642	improve replicate usage	2023-09-06 12:29:34 -07:00
ishaan-jaff	74e0e90620	add replicate streaming	2023-09-06 10:23:13 -07:00
ishaan-jaff	6fb01ec257	use replicate http requests instead	2023-09-06 09:43:05 -07:00
ishaan-jaff	f76cfb33f5	fix linting	2023-09-05 17:11:31 -07:00
ishaan-jaff	b4d1992b20	custom api base	2023-09-05 16:50:32 -07:00
ishaan-jaff	b05ca7a17f	clean install and import - vertexai	2023-09-05 16:10:07 -07:00
ishaan-jaff	48a5ed621f	clean up azure implementation	2023-09-05 15:31:59 -07:00
ishaan-jaff	54a77ec457	remove install_and_import remove petals	2023-09-05 15:06:24 -07:00
ishaan-jaff	5cbe7a941d	add completion types	2023-09-05 14:57:03 -07:00
ishaan-jaff	144ce4ec59	types completion()	2023-09-05 14:49:53 -07:00
ishaan-jaff	d0d5ef505d	add types to completion()	2023-09-05 14:42:10 -07:00
Krrish Dholakia	4b98feec36	bump version	2023-09-05 14:30:03 -07:00
ishaan-jaff	db4f4c0191	baseten client mapping	2023-09-04 15:41:37 -07:00
ishaan-jaff	b8b7d9bf44	fix aleph alpha client init	2023-09-04 15:14:09 -07:00
Krrish Dholakia	5ae420317e	adding first-party + custom prompt templates for huggingface	2023-09-04 14:54:09 -07:00
ishaan-jaff	c1fb3f19f5	clean up hugging face completion()	2023-09-04 14:41:06 -07:00
ishaan-jaff	f5931a7235	v0 bedrock support	2023-09-04 12:40:40 -07:00
ishaan-jaff	746001e32a	working sagemaker support	2023-09-04 11:30:34 -07:00
ishaan-jaff	022c632ce4	v0 add sagemaker	2023-09-04 11:02:20 -07:00
ishaan-jaff	c0c499f7db	clean out AI21 Init Client calls	2023-09-04 10:08:53 -07:00
ishaan-jaff	31ebbf5208	remove init for together_ai completion calls	2023-09-04 09:59:24 -07:00
ishaan-jaff	898df9a9d3	remove init AnthropicClient for completion calls	2023-09-04 09:34:15 -07:00
ishaan-jaff	67d881acb4	thread safe azure	2023-09-02 18:05:05 -07:00
ishaan-jaff	96fce0a880	thread safe version, key and base for openai	2023-09-02 17:49:26 -07:00
ishaan-jaff	c08479d5ed	make api base thread safe	2023-09-02 17:41:59 -07:00
ishaan-jaff	4a994dc498	use api_base instead of custom_api_base	2023-09-02 17:11:30 -07:00
ishaan-jaff	ff69377d0f	fix embedding call	2023-09-02 16:48:33 -07:00
Krrish Dholakia	78cd8d6e27	update to logging	2023-09-02 15:45:45 -07:00
Krrish Dholakia	a972676655	adding support for aleph alpha	2023-09-02 13:15:41 -07:00
Krrish Dholakia	db5e7a3515	fixes to litedebugger	2023-09-01 13:22:16 -07:00
Krrish Dholakia	1f2732a835	update model split tests with ui	2023-08-31 16:42:40 -07:00
Krrish Dholakia	0f973402ee	add completion call id	2023-08-31 12:54:38 -07:00
Krrish Dholakia	4927e5879f	update baseten handler to handle TGI calls	2023-08-30 19:14:48 -07:00
Krrish Dholakia	efbde50a03	adding coverage for openrouter in exception mapping	2023-08-29 15:30:24 -07:00
Krrish Dholakia	342fece93d	add coverage for rate limit errors to togetherai	2023-08-29 12:54:56 -07:00
Krrish Dholakia	c790dfe323	adding exception handling for together ai	2023-08-29 12:29:59 -07:00
ishaan-jaff	fd77baef83	vertex ai fix	2023-08-29 09:48:52 -07:00
ishaan-jaff	8454e2d436	working write to cache with streaming	2023-08-28 18:46:26 -07:00
ishaan-jaff	69f9c40d80	add customstreapwrapper for openai streaming	2023-08-28 15:32:53 -07:00
Krrish Dholakia	a0f882d507	new logger client	2023-08-28 14:59:00 -07:00
Krrish Dholakia	3087c904eb	fixes to streaming for ai21, baseten, and openai text completions	2023-08-28 09:42:51 -07:00
ishaan-jaff	a69b7ffcfa	formatting improvements	2023-08-28 09:20:50 -07:00
Ishaan Jaff	c910cdb795	Merge branch 'main' into dev/openai_api_base	2023-08-28 08:41:46 -07:00
ishaan-jaff	73e411572e	add text_completion	2023-08-28 08:20:20 -07:00
ishaan-jaff	8589a7e359	add text completion format support	2023-08-28 08:04:06 -07:00
Ishaan Jaff	8b5f3b5e40	Merge pull request #224 from galkleinman/main ... fix: context propagation on acompletion method	2023-08-28 07:36:48 -07:00
Krrish Dholakia	c9957fff25	update get secret logic	2023-08-28 07:21:02 -07:00
Gal Kleinman	2152fa7daf	fix: context propagation on acompletion method	2023-08-28 17:05:21 +03:00