271 commits

Author	SHA1	Message	Date
ishaan-jaff	7527b7ba0d	petals fixes	2023-09-19 09:24:34 -07:00
ishaan-jaff	38348f9390	add petals to init and main	2023-09-19 09:24:34 -07:00
ishaan-jaff	de0d345257	add gpt-3.5-instruct	2023-09-18 12:14:52 -07:00
ishaan-jaff	5299401c1d	fix linting errors	2023-09-18 10:57:55 -07:00
WilliamEspegren	287381cf58	Added Type stubs to __init__.py	2023-09-16 21:35:08 +02:00
ishaan-jaff	2cc1466fd6	new vert llms	2023-09-15 13:37:58 -07:00
ishaan-jaff	8f027e35a7	new init	2023-09-15 09:05:13 -07:00
ishaan-jaff	d7972c7ed6	update utils	2023-09-15 08:34:36 -07:00
Krrish Dholakia	d9eb7a248f	make max budget work for openai streaming	2023-09-14 16:22:52 -07:00
Krrish Dholakia	e3293ee264	exposing a litellm.max budget	2023-09-14 14:20:06 -07:00
ishaan-jaff	486fe00ba6	add bedrock to main and init	2023-09-14 13:51:09 -07:00
Toni Engelhardt	f1d464bf3b	fix openai completion model names ... The model names are wrong, they need to be prefixed with `text-`.	2023-09-14 18:57:48 +01:00
Krrish Dholakia	bd01f70257	adding support for nlp cloud	2023-09-14 09:19:34 -07:00
Krrish Dholakia	3f6b194b71	raise better exception if llm provider isn't passed in or inferred	2023-09-12 11:28:50 -07:00
ishaan-jaff	074e900485	try/catch for model_cost_map	2023-09-10 16:04:25 -07:00
Krrish Dholakia	88263faf76	update budget manager	2023-09-09 20:06:09 -07:00
ishaan-jaff	8d784b2751	make succes_callback in Callable	2023-09-09 19:05:19 -07:00
Krrish Dholakia	9c715deb57	rename apimanager to budget manager	2023-09-09 16:10:41 -07:00
Krrish Dholakia	4319b1011c	add api manager	2023-09-09 15:55:38 -07:00
Krrish Dholakia	312e3e9cb5	add check_valid_key helper function	2023-09-08 20:36:39 -07:00
Krrish Dholakia	d69f2a9bcd	expose validate environment function	2023-09-08 17:53:04 -07:00
ishaan-jaff	7151c78740	fix supported LLM on docs	2023-09-08 15:07:14 -07:00
Krrish Dholakia	7290a972e5	adding support for vllm	2023-09-06 18:07:44 -07:00
ishaan-jaff	955ba98093	rename max_tokens.json	2023-09-06 16:28:17 -07:00
ishaan-jaff	41aea86271	better documentation on __init__	2023-09-06 11:31:52 -07:00
ishaan-jaff	e52ce4030b	add support for flant5	2023-09-06 11:28:43 -07:00
ishaan-jaff	e4623a25ad	fix replicate supported llms	2023-09-06 10:28:03 -07:00
ishaan-jaff	b4d1992b20	custom api base	2023-09-05 16:50:32 -07:00
Krrish Dholakia	d99b544a5a	update init with comments	2023-09-05 09:14:57 -07:00
Krrish Dholakia	3147bf1d99	fix linting errors	2023-09-04 15:16:13 -07:00
Krrish Dholakia	5ae420317e	adding first-party + custom prompt templates for huggingface	2023-09-04 14:54:09 -07:00
ishaan-jaff	f5931a7235	v0 bedrock support	2023-09-04 12:40:40 -07:00
Krrish Dholakia	57dcd1fee9	update exception mapping and get model cost map	2023-09-04 11:53:20 -07:00
ishaan-jaff	746001e32a	working sagemaker support	2023-09-04 11:30:34 -07:00
Krrish Dholakia	a972676655	adding support for aleph alpha	2023-09-02 13:15:41 -07:00
Krrish Dholakia	1f2732a835	update model split tests with ui	2023-08-31 16:42:40 -07:00
Krrish Dholakia	894776e1c4	adding additional openai models	2023-08-30 08:30:05 -07:00
Krrish Dholakia	04455d8ea1	adding new openai models	2023-08-30 08:23:35 -07:00
Krrish Dholakia	c790dfe323	adding exception handling for together ai	2023-08-29 12:29:59 -07:00
ishaan-jaff	d0fe961e59	cache improvements	2023-08-28 14:44:42 -07:00
ishaan-jaff	6fa2e578d4	v0 of caching	2023-08-28 13:11:56 -07:00
Krrish Dholakia	3087c904eb	fixes to streaming for ai21, baseten, and openai text completions	2023-08-28 09:42:51 -07:00
ishaan-jaff	a69b7ffcfa	formatting improvements	2023-08-28 09:20:50 -07:00
Krrish Dholakia	d0eb126700	adding ability to turn off litedebugger but still use key manager	2023-08-26 11:03:40 -07:00
Krrish Dholakia	ef95e7adc7	use client opt-in	2023-08-26 10:38:39 -07:00
Krrish Dholakia	3b1086565a	allowing opt-in for litedebugger	2023-08-25 17:18:29 -07:00
Krrish Dholakia	f7f108d230	move baseten to a REST endpoint call	2023-08-24 14:43:49 -07:00
ishaan-jaff	4c081674fe	fix opt-out of litellm client	2023-08-24 12:42:07 -07:00
Krrish Dholakia	2a4cedb1ff	enable litedebugger opt-out	2023-08-24 10:19:10 -07:00
Krrish Dholakia	42b6c01b48	fixing mypy linting errors	2023-08-24 08:26:01 -07:00