1591 commits

Author	SHA1	Message	Date
Krrish Dholakia	e0c2bd7cf1	add docs on using completion with configs	2023-09-21 17:03:36 -07:00
ishaan-jaff	6add152818	sagemaker streaming	2023-09-21 16:14:44 -07:00
ishaan-jaff	a8c0f46111	fix j2-light test	2023-09-21 15:57:05 -07:00
ishaan-jaff	373371d2f8	test for response_ms	2023-09-21 15:45:47 -07:00
Krrish Dholakia	9ef783e062	fix linting errors	2023-09-21 15:30:02 -07:00
Krrish Dholakia	be00dd6367	add adapt to prompt size to config	2023-09-21 15:08:05 -07:00
Krrish Dholakia	ebd763287a	support default fallback models	2023-09-21 14:28:07 -07:00
Krrish Dholakia	2f44191642	add completion configs	2023-09-21 14:00:11 -07:00
ishaan-jaff	0c895b76fe	fix tests	2023-09-21 11:29:41 -07:00
ishaan-jaff	e354f39cc1	ollama improvements + version bump	2023-09-21 11:09:57 -07:00
Krrish Dholakia	b76372cee0	add metadata logging to promptlayer	2023-09-21 10:45:02 -07:00
ishaan-jaff	cf97a9441a	new ollama test	2023-09-21 10:39:48 -07:00
ishaan-jaff	8a21e75700	open router fixes	2023-09-20 21:14:12 -07:00
Krrish Dholakia	35fda2cd05	add latency to docs	2023-09-20 20:47:05 -07:00
ishaan-jaff	04abf986fc	new or tests	2023-09-20 20:40:21 -07:00
Krrish Dholakia	e48e1a4597	fix openrouter issue	2023-09-20 20:38:31 -07:00
Ishaan Jaff	a669f5a738	Merge pull request #416 from BerriAI/ishaan/error-logging ... Add Dashboard for showing error logs on exception	2023-09-20 20:17:18 -07:00
ishaan-jaff	20e86e6a05	fix test completion	2023-09-20 20:14:18 -07:00
ishaan-jaff	c844d26ff1	fix azure	2023-09-20 20:12:26 -07:00
ishaan-jaff	7b386ee4d8	fix test_completion	2023-09-20 20:11:32 -07:00
Krrish Dholakia	39c3f2d6ec	add response ms to response object	2023-09-20 19:50:38 -07:00
Krrish Dholakia	fc922bc300	fix multithreading issue with response objects	2023-09-20 19:36:08 -07:00
Krrish Dholakia	c63db48652	return all best of sequences	2023-09-20 14:43:25 -07:00
Krrish Dholakia	93c41e8f6d	decouple model list from hardcoded package variables	2023-09-20 14:16:56 -07:00
ishaan-jaff	eeeb95a6ac	add batch testing	2023-09-20 08:17:48 -07:00
ishaan-jaff	4b636a3578	new test for batch_completion_models_all_responses	2023-09-20 08:02:59 -07:00
ishaan-jaff	fb1ac94756	test fix	2023-09-19 22:18:27 -07:00
ishaan-jaff	0ca08b1545	bump v	2023-09-19 21:57:35 -07:00
ishaan-jaff	d15d876b02	add moderation	2023-09-19 21:44:04 -07:00
ishaan-jaff	fc10cf5eeb	exception_type work	2023-09-19 21:29:51 -07:00
Krrish Dholakia	ecad921b01	add oobabooga text web api support	2023-09-19 18:56:53 -07:00
ishaan-jaff	a230d08795	test batch_completion_models	2023-09-19 13:29:41 -07:00
ishaan-jaff	9c37619e5c	test petals	2023-09-19 09:24:34 -07:00
ishaan-jaff	e546aa1c76	bump v	2023-09-18 21:38:37 -07:00
Krrish Dholakia	45293613ba	fix meta llama prompt template mapping bug	2023-09-18 21:24:41 -07:00
Krrish Dholakia	633e36de42	handle llama 2 eos tokens in streaming	2023-09-18 13:44:19 -07:00
Krrish Dholakia	9067ec3b43	add support for litellm proxy calls	2023-09-18 12:15:21 -07:00
ishaan-jaff	0f88b82c4f	add gpt-3.5-instruct	2023-09-18 12:14:52 -07:00
Krrish Dholakia	5b294c704e	fix hf conversational task bug	2023-09-18 11:46:36 -07:00
ishaan-jaff	071e77ccad	hf non conv + tgi llms	2023-09-18 10:43:40 -07:00
WilliamEspegren	518deae394	resolve merge conflicts	2023-09-18 09:15:03 +02:00
WilliamEspegren	63a8614a14	Added function_call support to stream_chunk_builder	2023-09-17 19:42:55 +02:00
WilliamEspegren	404af1be0f	if "function_call" find name	2023-09-17 19:02:50 +02:00
Krrish Dholakia	abe3286ec6	bump version	2023-09-17 08:07:19 -07:00
WilliamEspegren	5544a9251f	rebuild chunks to openAI response ... Rebuild the cunks, but does not include the "usage"	2023-09-17 13:07:54 +02:00
WilliamEspegren	e07b3f5bfe	append chunk to chunks	2023-09-17 10:29:09 +02:00
WilliamEspegren	fe37f97423	add empty chunks list	2023-09-17 10:28:37 +02:00
WilliamEspegren	a39a204457	import stream_chunk_builder	2023-09-17 10:28:01 +02:00
WilliamEspegren	71afdbc0e5	add max_tokens	2023-09-17 10:27:32 +02:00
WilliamEspegren	43a18b9528	add stream_chunk_builder function	2023-09-17 10:26:34 +02:00