165 commits

Author	SHA1	Message	Date
Krrish Dholakia	cb8fb8a19d	fix anthropic json location bug	2023-09-22 15:21:28 -07:00
Krrish Dholakia	9876393355	adding support for cohere, anthropic, llama2 tokenizers	2023-09-22 14:03:52 -07:00
Krrish Dholakia	f3b6bd1beb	add token trimming to adapt to prompt flag in config	2023-09-21 17:47:52 -07:00
Krrish Dholakia	e2ad738969	bump version	2023-09-21 17:15:33 -07:00
Krrish Dholakia	9434237cbf	add docs on using completion with configs	2023-09-21 17:03:36 -07:00
Krrish Dholakia	4d63211e68	add adapt to prompt size to config	2023-09-21 15:08:05 -07:00
Krrish Dholakia	f3c334f27c	support default fallback models	2023-09-21 14:28:07 -07:00
Krrish Dholakia	a3a36b80e9	add completion configs	2023-09-21 14:00:11 -07:00
Krrish Dholakia	fdcfca7699	add metadata logging to promptlayer	2023-09-21 10:45:02 -07:00
Krrish Dholakia	88e2641416	fix openrouter issue	2023-09-20 20:38:31 -07:00
Krrish Dholakia	0a6f072471	bump litellm version	2023-09-20 20:20:34 -07:00
Krrish Dholakia	7e831bed15	add response ms to response object	2023-09-20 19:50:38 -07:00
Krrish Dholakia	f075646dee	fix multithreading issue with response objects	2023-09-20 19:36:08 -07:00
Krrish Dholakia	4401d00ea0	return all best of sequences	2023-09-20 14:43:25 -07:00
Krrish Dholakia	4509b62cf8	add oobabooga text web api support	2023-09-19 18:56:53 -07:00
Krrish Dholakia	6f4641ac47	handle llama 2 eos tokens in streaming	2023-09-18 13:44:19 -07:00
Krrish Dholakia	df8aeeed02	bump version	2023-09-18 12:27:18 -07:00
Krrish Dholakia	3d2ffcb28b	add support for litellm proxy calls	2023-09-18 12:15:21 -07:00
Krrish Dholakia	78d579b04b	fix hf conversational task bug	2023-09-18 11:46:36 -07:00
Krrish Dholakia	1260c466b5	update readme with contributing.md information	2023-09-18 09:30:30 -07:00
Krrish Dholakia	b45bb78bee	bump pyproject version	2023-09-16 20:45:16 -07:00
Krrish Dholakia	e7974d95d5	fix streaming formatting for non-openai models	2023-09-16 19:20:07 -07:00
Krrish Dholakia	1ac316cc0a	bug fixes	2023-09-16 16:32:12 -07:00
Krrish Dholakia	d80fe482ce	except custom openai proxy	2023-09-16 16:15:44 -07:00
Krrish Dholakia	8df2916078	bump version	2023-09-16 12:28:57 -07:00
Krrish Dholakia	925ec2ded9	fixes to testing	2023-09-16 11:40:01 -07:00
Krrish Dholakia	38e443a1b4	moving open interpreter tests	2023-09-16 11:04:35 -07:00
Krrish Dholakia	1e2d6846ac	improvements to streaming	2023-09-16 11:02:06 -07:00
Krrish Dholakia	0a1f3af840	ensure streaming format is exactly the same as openai	2023-09-16 10:35:20 -07:00
Krrish Dholakia	0e6ace7875	fixes to streaming	2023-09-15 17:23:10 -07:00
Krrish Dholakia	ec559e854d	streaming fixes	2023-09-15 15:49:20 -07:00
Krrish Dholakia	8892b50e2a	update streaming	2023-09-15 15:25:14 -07:00
Krrish Dholakia	e7b31bb7fc	fix streaming error	2023-09-15 15:21:15 -07:00
Krrish Dholakia	47253018bb	fixes to streaming	2023-09-14 19:27:12 -07:00
Krrish Dholakia	8b5a90aac7	fix streaming objects	2023-09-14 17:16:43 -07:00
Krrish Dholakia	b65a1d4c9c	bug fixes	2023-09-14 16:32:06 -07:00
Krrish Dholakia	d9eb7a248f	make max budget work for openai streaming	2023-09-14 16:22:52 -07:00
Krrish Dholakia	e3293ee264	exposing a litellm.max budget	2023-09-14 14:20:06 -07:00
Krrish Dholakia	22fb574009	move cohere to http endpoint	2023-09-14 11:17:38 -07:00
Krrish Dholakia	52a02c719a	fixes to mock completion	2023-09-14 10:03:57 -07:00
Krrish Dholakia	bd01f70257	adding support for nlp cloud	2023-09-14 09:19:34 -07:00
Krrish Dholakia	3496bebdc5	map finish reason	2023-09-13 19:22:38 -07:00
Krrish Dholakia	9b71bfb2b5	allow updating budget manager cost by passing in text	2023-09-13 15:12:47 -07:00
Krrish Dholakia	f493779a97	huggingface conversational task support	2023-09-13 13:45:23 -07:00
Krrish Dholakia	6cd950a031	return model name as part of streaming object	2023-09-13 09:48:49 -07:00
Krrish Dholakia	7ebf97637c	add reset budget on duration end to budget manager	2023-09-12 13:01:55 -07:00
Krrish Dholakia	f015cd908a	doc cleanup for custom prompt templates	2023-09-12 12:16:47 -07:00
Krrish Dholakia	abc595998d	fix get llm provider	2023-09-12 11:48:44 -07:00
Krrish Dholakia	3f6b194b71	raise better exception if llm provider isn't passed in or inferred	2023-09-12 11:28:50 -07:00
Krrish Dholakia	0defdc8634	work for hf inference endpoint	2023-09-11 18:37:55 -07:00