136 commits

Author	SHA1	Message	Date
Krrish Dholakia	0e6ace7875	fixes to streaming	2023-09-15 17:23:10 -07:00
Krrish Dholakia	ec559e854d	streaming fixes	2023-09-15 15:49:20 -07:00
Krrish Dholakia	8892b50e2a	update streaming	2023-09-15 15:25:14 -07:00
Krrish Dholakia	e7b31bb7fc	fix streaming error	2023-09-15 15:21:15 -07:00
Krrish Dholakia	47253018bb	fixes to streaming	2023-09-14 19:27:12 -07:00
Krrish Dholakia	8b5a90aac7	fix streaming objects	2023-09-14 17:16:43 -07:00
Krrish Dholakia	b65a1d4c9c	bug fixes	2023-09-14 16:32:06 -07:00
Krrish Dholakia	d9eb7a248f	make max budget work for openai streaming	2023-09-14 16:22:52 -07:00
Krrish Dholakia	e3293ee264	exposing a litellm.max budget	2023-09-14 14:20:06 -07:00
Krrish Dholakia	22fb574009	move cohere to http endpoint	2023-09-14 11:17:38 -07:00
Krrish Dholakia	52a02c719a	fixes to mock completion	2023-09-14 10:03:57 -07:00
Krrish Dholakia	bd01f70257	adding support for nlp cloud	2023-09-14 09:19:34 -07:00
Krrish Dholakia	3496bebdc5	map finish reason	2023-09-13 19:22:38 -07:00
Krrish Dholakia	9b71bfb2b5	allow updating budget manager cost by passing in text	2023-09-13 15:12:47 -07:00
Krrish Dholakia	f493779a97	huggingface conversational task support	2023-09-13 13:45:23 -07:00
Krrish Dholakia	6cd950a031	return model name as part of streaming object	2023-09-13 09:48:49 -07:00
Krrish Dholakia	7ebf97637c	add reset budget on duration end to budget manager	2023-09-12 13:01:55 -07:00
Krrish Dholakia	f015cd908a	doc cleanup for custom prompt templates	2023-09-12 12:16:47 -07:00
Krrish Dholakia	abc595998d	fix get llm provider	2023-09-12 11:48:44 -07:00
Krrish Dholakia	3f6b194b71	raise better exception if llm provider isn't passed in or inferred	2023-09-12 11:28:50 -07:00
Krrish Dholakia	0defdc8634	work for hf inference endpoint	2023-09-11 18:37:55 -07:00
Krrish Dholakia	355c2ed00c	improvements to exception mapping	2023-09-11 18:33:57 -07:00
Krrish Dholakia	f944eaee4b	mock responses for streaming	2023-09-11 16:30:29 -07:00
Krrish Dholakia	9f7c1d3885	add mock request to docs	2023-09-11 12:19:13 -07:00
Krrish Dholakia	2564bb8fb3	updating budget manager	2023-09-11 10:58:09 -07:00
Krrish Dholakia	7b6836bb4f	don't fail pytest due to timeout error in batch completions	2023-09-10 08:46:27 -07:00
Krrish Dholakia	88263faf76	update budget manager	2023-09-09 20:06:09 -07:00
Krrish Dholakia	10e4a06799	fix circle ci testing	2023-09-09 16:36:45 -07:00
Krrish Dholakia	1dd77ff176	update testing	2023-09-09 16:35:38 -07:00
Krrish Dholakia	9c715deb57	rename apimanager to budget manager	2023-09-09 16:10:41 -07:00
Krrish Dholakia	4319b1011c	add api manager	2023-09-09 15:55:38 -07:00
Krrish Dholakia	848660be9a	fix exception	2023-09-09 11:24:10 -07:00
Krrish Dholakia	f7dbdb52bd	improve error message returned if model not passed in	2023-09-09 11:18:10 -07:00
Krrish Dholakia	c177267d51	bump version	2023-09-08 19:26:41 -07:00
Krrish Dholakia	c054f22f10	update exception logic	2023-09-08 18:55:11 -07:00
Krrish Dholakia	e69863f91b	fix exception mapping	2023-09-08 18:45:18 -07:00
Krrish Dholakia	a89a491c10	fix exception mapping error	2023-09-08 18:20:07 -07:00
Krrish Dholakia	b60049b030	fix litedebugger double logging error	2023-09-07 18:02:24 -07:00
Krrish Dholakia	b8358da425	bump version	2023-09-07 17:00:20 -07:00
Krrish Dholakia	d20214f99c	fix litellm client	2023-09-07 16:22:00 -07:00
Krrish Dholakia	14fa57c185	batch completions for vllm now works too	2023-09-06 19:26:19 -07:00
Krrish Dholakia	7290a972e5	adding support for vllm	2023-09-06 18:07:44 -07:00
Krrish Dholakia	e24e60cd74	commenting out flaky circle ci test	2023-09-06 12:07:47 -07:00
Krrish Dholakia	311bfb7bb7	logging replicate response logs	2023-09-06 11:28:40 -07:00
Krrish Dholakia	8189a16188	updates	2023-09-06 11:21:48 -07:00
Krrish Dholakia	548b419005	test async streaming	2023-09-04 15:42:24 -07:00
Krrish Dholakia	3147bf1d99	fix linting errors	2023-09-04 15:16:13 -07:00
Krrish Dholakia	5ae420317e	adding first-party + custom prompt templates for huggingface	2023-09-04 14:54:09 -07:00
Krrish Dholakia	57dcd1fee9	update exception mapping and get model cost map	2023-09-04 11:53:20 -07:00
Krrish Dholakia	a07251a514	fix azure streaming	2023-09-02 16:10:19 -07:00