122 commits

Author	SHA1	Message	Date
ishaan-jaff	fc10cf5eeb	exception_type work	2023-09-19 21:29:51 -07:00
ishaan-jaff	385640b743	petals fixes	2023-09-19 09:24:34 -07:00
ishaan-jaff	934deab1f7	add petals to init and main	2023-09-19 09:24:34 -07:00
ishaan-jaff	0f88b82c4f	add gpt-3.5-instruct	2023-09-18 12:14:52 -07:00
ishaan-jaff	6b548eeb28	fix linting errors	2023-09-18 10:57:55 -07:00
WilliamEspegren	36bdfba19f	Added Type stubs to __init__.py	2023-09-16 21:35:08 +02:00
ishaan-jaff	3623370c7f	new vert llms	2023-09-15 13:37:58 -07:00
ishaan-jaff	f56ab31044	new init	2023-09-15 09:05:13 -07:00
ishaan-jaff	59771012a0	update utils	2023-09-15 08:34:36 -07:00
Krrish Dholakia	f7e92bb0db	make max budget work for openai streaming	2023-09-14 16:22:52 -07:00
Krrish Dholakia	73a084c19c	exposing a litellm.max budget	2023-09-14 14:20:06 -07:00
ishaan-jaff	38bdb9335c	add bedrock to main and init	2023-09-14 13:51:09 -07:00
Toni Engelhardt	6d998ea541	fix openai completion model names ... The model names are wrong, they need to be prefixed with `text-`.	2023-09-14 18:57:48 +01:00
Krrish Dholakia	f98da9f13c	adding support for nlp cloud	2023-09-14 09:19:34 -07:00
Krrish Dholakia	baa69734b0	raise better exception if llm provider isn't passed in or inferred	2023-09-12 11:28:50 -07:00
ishaan-jaff	755c19aa0c	try/catch for model_cost_map	2023-09-10 16:04:25 -07:00
Krrish Dholakia	b1ec504421	update budget manager	2023-09-09 20:06:09 -07:00
ishaan-jaff	ff0e5c2967	make succes_callback in Callable	2023-09-09 19:05:19 -07:00
Krrish Dholakia	8ed85b0523	rename apimanager to budget manager	2023-09-09 16:10:41 -07:00
Krrish Dholakia	a39756bfda	add api manager	2023-09-09 15:55:38 -07:00
Krrish Dholakia	679a4f318d	add check_valid_key helper function	2023-09-08 20:36:39 -07:00
Krrish Dholakia	47c1f57a24	expose validate environment function	2023-09-08 17:53:04 -07:00
ishaan-jaff	0cc561bc5d	fix supported LLM on docs	2023-09-08 15:07:14 -07:00
Krrish Dholakia	4cfcabd919	adding support for vllm	2023-09-06 18:07:44 -07:00
ishaan-jaff	bab27634a8	rename max_tokens.json	2023-09-06 16:28:17 -07:00
ishaan-jaff	601a6a4a92	better documentation on __init__	2023-09-06 11:31:52 -07:00
ishaan-jaff	cfe35580e2	add support for flant5	2023-09-06 11:28:43 -07:00
ishaan-jaff	d0b16892e0	fix replicate supported llms	2023-09-06 10:28:03 -07:00
ishaan-jaff	8ecef03f63	custom api base	2023-09-05 16:50:32 -07:00
Krrish Dholakia	5870dabae1	update init with comments	2023-09-05 09:14:57 -07:00
Krrish Dholakia	0864b07616	fix linting errors	2023-09-04 15:16:13 -07:00
Krrish Dholakia	2384806cfd	adding first-party + custom prompt templates for huggingface	2023-09-04 14:54:09 -07:00
ishaan-jaff	2bf9ee4ecf	v0 bedrock support	2023-09-04 12:40:40 -07:00
Krrish Dholakia	73bb1b96e9	update exception mapping and get model cost map	2023-09-04 11:53:20 -07:00
ishaan-jaff	4a4ee51df3	working sagemaker support	2023-09-04 11:30:34 -07:00
Krrish Dholakia	83b8af8567	adding support for aleph alpha	2023-09-02 13:15:41 -07:00
Krrish Dholakia	b44299cce7	update model split tests with ui	2023-08-31 16:42:40 -07:00
Krrish Dholakia	c008a035c8	adding additional openai models	2023-08-30 08:30:05 -07:00
Krrish Dholakia	0fd2d43345	adding new openai models	2023-08-30 08:23:35 -07:00
Krrish Dholakia	88bd1df3e0	adding exception handling for together ai	2023-08-29 12:29:59 -07:00
ishaan-jaff	1799f1bfe9	cache improvements	2023-08-28 14:44:42 -07:00
ishaan-jaff	8b43917792	v0 of caching	2023-08-28 13:11:56 -07:00
Krrish Dholakia	d542066d4b	fixes to streaming for ai21, baseten, and openai text completions	2023-08-28 09:42:51 -07:00
ishaan-jaff	b713acb0a4	formatting improvements	2023-08-28 09:20:50 -07:00
Krrish Dholakia	9008973826	adding ability to turn off litedebugger but still use key manager	2023-08-26 11:03:40 -07:00
Krrish Dholakia	ff7b4ffcf1	use client opt-in	2023-08-26 10:38:39 -07:00
Krrish Dholakia	fa53f7033b	allowing opt-in for litedebugger	2023-08-25 17:18:29 -07:00
Krrish Dholakia	6e30b234ac	move baseten to a REST endpoint call	2023-08-24 14:43:49 -07:00
ishaan-jaff	01a399f8b5	fix opt-out of litellm client	2023-08-24 12:42:07 -07:00
Krrish Dholakia	efbb476020	enable litedebugger opt-out	2023-08-24 10:19:10 -07:00