3353 commits

Author	SHA1	Message	Date
ishaan-jaff	2b9e3434ff	fix async import error	2023-09-21 11:16:50 -07:00
ishaan-jaff	e354f39cc1	ollama improvements + version bump	2023-09-21 11:09:57 -07:00
ishaan-jaff	ac90c5286f	conditional import async_generator	2023-09-21 11:09:57 -07:00
Krrish Dholakia	b76372cee0	add metadata logging to promptlayer	2023-09-21 10:45:02 -07:00
ishaan-jaff	cf97a9441a	new ollama test	2023-09-21 10:39:48 -07:00
ishaan-jaff	35bb6f5a50	support acompletion + stream for ollama	2023-09-21 10:39:48 -07:00
ishaan-jaff	4fa9b19af7	add ollama to providers	2023-09-21 10:39:48 -07:00
Krrish Dholakia	9ec8ea89bb	fixing huggingface tgi index issue for best of	2023-09-21 10:05:22 -07:00
ishaan-jaff	8a21e75700	open router fixes	2023-09-20 21:14:12 -07:00
Krrish Dholakia	a8711dc5c2	fix hf tgi best of bug	2023-09-20 20:53:32 -07:00
Krrish Dholakia	35fda2cd05	add latency to docs	2023-09-20 20:47:05 -07:00
ishaan-jaff	04abf986fc	new or tests	2023-09-20 20:40:21 -07:00
Krrish Dholakia	e48e1a4597	fix openrouter issue	2023-09-20 20:38:31 -07:00
Krrish Dholakia	86f9991412	bump litellm version	2023-09-20 20:20:34 -07:00
Ishaan Jaff	a669f5a738	Merge pull request #416 from BerriAI/ishaan/error-logging ... Add Dashboard for showing error logs on exception	2023-09-20 20:17:18 -07:00
ishaan-jaff	20e86e6a05	fix test completion	2023-09-20 20:14:18 -07:00
ishaan-jaff	c844d26ff1	fix azure	2023-09-20 20:12:26 -07:00
ishaan-jaff	7b386ee4d8	fix test_completion	2023-09-20 20:11:32 -07:00
ishaan-jaff	2ba8e9bc02	only show error log dashboard on fail	2023-09-20 20:09:02 -07:00
Krrish Dholakia	39c3f2d6ec	add response ms to response object	2023-09-20 19:50:38 -07:00
Krrish Dholakia	fc922bc300	fix multithreading issue with response objects	2023-09-20 19:36:08 -07:00
Krrish Dholakia	c63db48652	return all best of sequences	2023-09-20 14:43:25 -07:00
Krrish Dholakia	93c41e8f6d	decouple model list from hardcoded package variables	2023-09-20 14:16:56 -07:00
Krrish Dholakia	5079909142	updating model cost map with new models	2023-09-20 13:39:22 -07:00
ishaan-jaff	b81f8d2ddd	remove cuda from petals	2023-09-20 09:23:39 -07:00
ishaan-jaff	eeeb95a6ac	add batch testing	2023-09-20 08:17:48 -07:00
ishaan-jaff	4b636a3578	new test for batch_completion_models_all_responses	2023-09-20 08:02:59 -07:00
ishaan-jaff	41a934a99c	add batch_completion_models_all_responses	2023-09-20 08:01:53 -07:00
ishaan-jaff	fb1ac94756	test fix	2023-09-19 22:18:27 -07:00
ishaan-jaff	f9476b7a52	fix moderation	2023-09-19 22:18:02 -07:00
ishaan-jaff	0ca08b1545	bump v	2023-09-19 21:57:35 -07:00
ishaan-jaff	d15d876b02	add moderation	2023-09-19 21:44:04 -07:00
ishaan-jaff	fc10cf5eeb	exception_type work	2023-09-19 21:29:51 -07:00
Krrish Dholakia	ecad921b01	add oobabooga text web api support	2023-09-19 18:56:53 -07:00
ishaan-jaff	a230d08795	test batch_completion_models	2023-09-19 13:29:41 -07:00
ishaan-jaff	2c30855389	new batch completion function	2023-09-19 13:29:41 -07:00
ishaan-jaff	85862c1066	petals remove print statement	2023-09-19 10:56:30 -07:00
ishaan-jaff	946c81626d	fix petals imports	2023-09-19 09:27:40 -07:00
ishaan-jaff	5f808f9f87	petals on main	2023-09-19 09:27:28 -07:00
ishaan-jaff	9c37619e5c	test petals	2023-09-19 09:24:34 -07:00
ishaan-jaff	bee1224aa2	dev4	2023-09-19 09:24:34 -07:00
ishaan-jaff	385640b743	petals fixes	2023-09-19 09:24:34 -07:00
ishaan-jaff	f6ccadabc8	fix petals import	2023-09-19 09:24:34 -07:00
ishaan-jaff	a107b7b3ec	add petals file for completion	2023-09-19 09:24:34 -07:00
ishaan-jaff	934deab1f7	add petals to init and main	2023-09-19 09:24:34 -07:00
ishaan-jaff	e546aa1c76	bump v	2023-09-18 21:38:37 -07:00
Krrish Dholakia	45293613ba	fix meta llama prompt template mapping bug	2023-09-18 21:24:41 -07:00
Krrish Dholakia	5acd1c9d47	update budget manager	2023-09-18 15:48:29 -07:00
Krrish Dholakia	633e36de42	handle llama 2 eos tokens in streaming	2023-09-18 13:44:19 -07:00
Krrish Dholakia	f134de1287	bug fix for litellm proxy implementation	2023-09-18 12:54:56 -07:00