405 commits

Author	SHA1	Message	Date
Toni Engelhardt	630b5d2c1f	add kwargs to mock_completion ... Allows replacing `completion` with `mock_completion` without encountering errors.	2023-09-14 10:27:19 +01:00
Krrish Dholakia	aaa57abddd	map finish reason	2023-09-13 19:22:38 -07:00
Krrish Dholakia	5b6b9a9fab	huggingface conversational task support	2023-09-13 13:45:23 -07:00
ishaan-jaff	e3fa1d686e	remove verify_access_key from main	2023-09-12 11:50:30 -07:00
Ishaan Jaff	60e3e42fba	Merge branch 'main' into main	2023-09-12 11:43:03 -07:00
Krrish Dholakia	baa69734b0	raise better exception if llm provider isn't passed in or inferred	2023-09-12 11:28:50 -07:00
ishaan-jaff	0ffcf51445	fix azure logging	2023-09-12 10:35:47 -07:00
ishaan-jaff	0f89636b47	use api_version for azure completion call	2023-09-12 10:35:24 -07:00
William Espegren	261db15bcf	util: verify_access_key ... Verify that the user provided a valid openai token by creating a request to the openAI endpoint.	2023-09-12 18:48:23 +02:00
Ishaan Jaff	fdddd00bfd	Merge pull request #330 from Taik/main ... Add support for overriding API type for Azure calls	2023-09-11 17:04:25 -07:00
Krrish Dholakia	cc1313492b	code cleanup	2023-09-11 16:32:17 -07:00
Krrish Dholakia	cbc7e6dbc2	mock responses for streaming	2023-09-11 16:30:29 -07:00
Thinh Nguyen	8801f71a52	Add support for overriding API type for Azure calls	2023-09-11 16:28:00 -07:00
Krrish Dholakia	6da500c6e0	add mock request to docs	2023-09-11 12:19:13 -07:00
ishaan-jaff	1ef80c9a2a	begin using litellm.api_key	2023-09-11 07:32:20 -07:00
Krrish Dholakia	beecb60f51	update testing	2023-09-09 16:35:38 -07:00
Krrish Dholakia	a39756bfda	add api manager	2023-09-09 15:55:38 -07:00
ishaan-jaff	bc1ad908c0	add support for calling openai proxy using lite	2023-09-09 15:47:29 -07:00
ishaan-jaff	56bd8c1c52	olla upgrades, fix streaming, add non streaming resp	2023-09-09 14:07:13 -07:00
ishaan-jaff	9f7d397014	add cache params	2023-09-08 20:18:12 -07:00
ishaan-jaff	8180ba273b	updating caching tests	2023-09-08 20:15:15 -07:00
ishaan-jaff	0ab62f13e8	caching updates	2023-09-08 18:06:47 -07:00
ishaan-jaff	1c9169e563	raise cohere, vertex, tenacity import errors	2023-09-08 15:26:09 -07:00
ishaan-jaff	632d928bfb	comments about using hosted vllm	2023-09-08 14:06:52 -07:00
ishaan-jaff	c45e2ed48c	hosted vllm usage	2023-09-08 13:58:06 -07:00
ishaan-jaff	c05606b587	custom base with openai completion	2023-09-08 13:21:43 -07:00
ishaan-jaff	a611409e0f	async streaming generator	2023-09-07 13:53:40 -07:00
Krrish Dholakia	6b3cb18983	fix linting issues	2023-09-06 20:43:59 -07:00
Krrish Dholakia	35cf6ef0a1	batch completions for vllm now works too	2023-09-06 19:26:19 -07:00
Krrish Dholakia	4cfcabd919	adding support for vllm	2023-09-06 18:07:44 -07:00
ishaan-jaff	dc0c084813	improve replicate usage	2023-09-06 12:29:34 -07:00
ishaan-jaff	1c61b7b229	add replicate streaming	2023-09-06 10:23:13 -07:00
ishaan-jaff	c45b132675	use replicate http requests instead	2023-09-06 09:43:05 -07:00
ishaan-jaff	0bbcba269d	fix linting	2023-09-05 17:11:31 -07:00
ishaan-jaff	8ecef03f63	custom api base	2023-09-05 16:50:32 -07:00
ishaan-jaff	262bb07ade	clean install and import - vertexai	2023-09-05 16:10:07 -07:00
ishaan-jaff	2250d1375e	clean up azure implementation	2023-09-05 15:31:59 -07:00
ishaan-jaff	2a36f06763	remove install_and_import remove petals	2023-09-05 15:06:24 -07:00
ishaan-jaff	079ec7064b	add completion types	2023-09-05 14:57:03 -07:00
ishaan-jaff	846aeea4f9	types completion()	2023-09-05 14:49:53 -07:00
ishaan-jaff	794964993d	add types to completion()	2023-09-05 14:42:10 -07:00
Krrish Dholakia	faa78ad543	bump version	2023-09-05 14:30:03 -07:00
ishaan-jaff	fe4caf5c3d	baseten client mapping	2023-09-04 15:41:37 -07:00
ishaan-jaff	79acfb4dab	fix aleph alpha client init	2023-09-04 15:14:09 -07:00
Krrish Dholakia	2384806cfd	adding first-party + custom prompt templates for huggingface	2023-09-04 14:54:09 -07:00
ishaan-jaff	a474b89779	clean up hugging face completion()	2023-09-04 14:41:06 -07:00
ishaan-jaff	2bf9ee4ecf	v0 bedrock support	2023-09-04 12:40:40 -07:00
ishaan-jaff	4a4ee51df3	working sagemaker support	2023-09-04 11:30:34 -07:00
ishaan-jaff	138c26d98d	v0 add sagemaker	2023-09-04 11:02:20 -07:00
ishaan-jaff	38564ddc82	clean out AI21 Init Client calls	2023-09-04 10:08:53 -07:00