1251 commits

Author	SHA1	Message	Date
Ishaan Jaff	5cec386ae2	Merge branch 'main' into main	2023-09-12 11:43:03 -07:00
Krrish Dholakia	3f6b194b71	raise better exception if llm provider isn't passed in or inferred	2023-09-12 11:28:50 -07:00
ishaan-jaff	56fee1b2a1	fix azure logging	2023-09-12 10:35:47 -07:00
ishaan-jaff	78b7bcb49d	use api_version for azure completion call	2023-09-12 10:35:24 -07:00
William Espegren	09022ad61d	util: verify_access_key ... Verify that the user provided a valid openai token by creating a request to the openAI endpoint.	2023-09-12 18:48:23 +02:00
Ishaan Jaff	029c3cb3b1	Merge pull request #330 from Taik/main ... Add support for overriding API type for Azure calls	2023-09-11 17:04:25 -07:00
Krrish Dholakia	cd12e95526	code cleanup	2023-09-11 16:32:17 -07:00
Krrish Dholakia	f944eaee4b	mock responses for streaming	2023-09-11 16:30:29 -07:00
Thinh Nguyen	92a1402663	Add support for overriding API type for Azure calls	2023-09-11 16:28:00 -07:00
Krrish Dholakia	9f7c1d3885	add mock request to docs	2023-09-11 12:19:13 -07:00
ishaan-jaff	c4f58695d4	begin using litellm.api_key	2023-09-11 07:32:20 -07:00
Krrish Dholakia	1dd77ff176	update testing	2023-09-09 16:35:38 -07:00
Krrish Dholakia	4319b1011c	add api manager	2023-09-09 15:55:38 -07:00
ishaan-jaff	3ed14cf8f8	add support for calling openai proxy using lite	2023-09-09 15:47:29 -07:00
ishaan-jaff	b8538fea34	olla upgrades, fix streaming, add non streaming resp	2023-09-09 14:07:13 -07:00
ishaan-jaff	990651c8c0	add cache params	2023-09-08 20:18:12 -07:00
ishaan-jaff	028fed5bf2	updating caching tests	2023-09-08 20:15:15 -07:00
ishaan-jaff	da87721a20	caching updates	2023-09-08 18:06:47 -07:00
ishaan-jaff	c1a7853da2	raise cohere, vertex, tenacity import errors	2023-09-08 15:26:09 -07:00
ishaan-jaff	847e9f47cc	comments about using hosted vllm	2023-09-08 14:06:52 -07:00
ishaan-jaff	9eae0dac26	hosted vllm usage	2023-09-08 13:58:06 -07:00
ishaan-jaff	9bdd27df1d	custom base with openai completion	2023-09-08 13:21:43 -07:00
ishaan-jaff	27b8145c56	async streaming generator	2023-09-07 13:53:40 -07:00
Krrish Dholakia	e6a65695eb	fix linting issues	2023-09-06 20:43:59 -07:00
Krrish Dholakia	14fa57c185	batch completions for vllm now works too	2023-09-06 19:26:19 -07:00
Krrish Dholakia	7290a972e5	adding support for vllm	2023-09-06 18:07:44 -07:00
ishaan-jaff	3fbf700642	improve replicate usage	2023-09-06 12:29:34 -07:00
ishaan-jaff	74e0e90620	add replicate streaming	2023-09-06 10:23:13 -07:00
ishaan-jaff	6fb01ec257	use replicate http requests instead	2023-09-06 09:43:05 -07:00
ishaan-jaff	f76cfb33f5	fix linting	2023-09-05 17:11:31 -07:00
ishaan-jaff	b4d1992b20	custom api base	2023-09-05 16:50:32 -07:00
ishaan-jaff	b05ca7a17f	clean install and import - vertexai	2023-09-05 16:10:07 -07:00
ishaan-jaff	48a5ed621f	clean up azure implementation	2023-09-05 15:31:59 -07:00
ishaan-jaff	54a77ec457	remove install_and_import remove petals	2023-09-05 15:06:24 -07:00
ishaan-jaff	5cbe7a941d	add completion types	2023-09-05 14:57:03 -07:00
ishaan-jaff	144ce4ec59	types completion()	2023-09-05 14:49:53 -07:00
ishaan-jaff	d0d5ef505d	add types to completion()	2023-09-05 14:42:10 -07:00
Krrish Dholakia	4b98feec36	bump version	2023-09-05 14:30:03 -07:00
ishaan-jaff	db4f4c0191	baseten client mapping	2023-09-04 15:41:37 -07:00
ishaan-jaff	b8b7d9bf44	fix aleph alpha client init	2023-09-04 15:14:09 -07:00
Krrish Dholakia	5ae420317e	adding first-party + custom prompt templates for huggingface	2023-09-04 14:54:09 -07:00
ishaan-jaff	c1fb3f19f5	clean up hugging face completion()	2023-09-04 14:41:06 -07:00
ishaan-jaff	f5931a7235	v0 bedrock support	2023-09-04 12:40:40 -07:00
ishaan-jaff	746001e32a	working sagemaker support	2023-09-04 11:30:34 -07:00
ishaan-jaff	022c632ce4	v0 add sagemaker	2023-09-04 11:02:20 -07:00
ishaan-jaff	c0c499f7db	clean out AI21 Init Client calls	2023-09-04 10:08:53 -07:00
ishaan-jaff	31ebbf5208	remove init for together_ai completion calls	2023-09-04 09:59:24 -07:00
ishaan-jaff	898df9a9d3	remove init AnthropicClient for completion calls	2023-09-04 09:34:15 -07:00
ishaan-jaff	67d881acb4	thread safe azure	2023-09-02 18:05:05 -07:00
ishaan-jaff	96fce0a880	thread safe version, key and base for openai	2023-09-02 17:49:26 -07:00