302 commits

Author	SHA1	Message	Date
Krrish Dholakia	cf5060f136	add token trimming to adapt to prompt flag in config	2023-09-21 17:47:52 -07:00
Krrish Dholakia	e0c2bd7cf1	add docs on using completion with configs	2023-09-21 17:03:36 -07:00
ishaan-jaff	6add152818	sagemaker streaming	2023-09-21 16:14:44 -07:00
ishaan-jaff	aa6f5e13f3	response_ms fix	2023-09-21 15:44:50 -07:00
Krrish Dholakia	be00dd6367	add adapt to prompt size to config	2023-09-21 15:08:05 -07:00
Krrish Dholakia	ebd763287a	support default fallback models	2023-09-21 14:28:07 -07:00
Krrish Dholakia	31c995a1a4	fix linting errors	2023-09-21 14:10:27 -07:00
Krrish Dholakia	2f44191642	add completion configs	2023-09-21 14:00:11 -07:00
ishaan-jaff	935d148423	ollama exception mapping + new cookbook	2023-09-21 12:00:04 -07:00
Krrish Dholakia	b76372cee0	add metadata logging to promptlayer	2023-09-21 10:45:02 -07:00
Krrish Dholakia	86f9991412	bump litellm version	2023-09-20 20:20:34 -07:00
Ishaan Jaff	a669f5a738	Merge pull request #416 from BerriAI/ishaan/error-logging ... Add Dashboard for showing error logs on exception	2023-09-20 20:17:18 -07:00
ishaan-jaff	2ba8e9bc02	only show error log dashboard on fail	2023-09-20 20:09:02 -07:00
Krrish Dholakia	39c3f2d6ec	add response ms to response object	2023-09-20 19:50:38 -07:00
Krrish Dholakia	fc922bc300	fix multithreading issue with response objects	2023-09-20 19:36:08 -07:00
Krrish Dholakia	c63db48652	return all best of sequences	2023-09-20 14:43:25 -07:00
ishaan-jaff	fc10cf5eeb	exception_type work	2023-09-19 21:29:51 -07:00
ishaan-jaff	85862c1066	petals remove print statement	2023-09-19 10:56:30 -07:00
ishaan-jaff	385640b743	petals fixes	2023-09-19 09:24:34 -07:00
Krrish Dholakia	633e36de42	handle llama 2 eos tokens in streaming	2023-09-18 13:44:19 -07:00
Krrish Dholakia	9067ec3b43	add support for litellm proxy calls	2023-09-18 12:15:21 -07:00
ishaan-jaff	4a17a6c2b3	add doc string for completion_cost	2023-09-18 08:44:40 -07:00
Krrish Dholakia	4daaa1cf91	clean out print statements	2023-09-17 05:52:19 -07:00
Krrish Dholakia	66a3c59ebe	bump pyproject version	2023-09-16 20:45:16 -07:00
Krrish Dholakia	e44c218c1b	fix streaming formatting for non-openai models	2023-09-16 19:20:07 -07:00
Krrish Dholakia	d2f8a7b2ae	bug fixes	2023-09-16 16:32:12 -07:00
Krrish Dholakia	122c993e6f	except custom openai proxy	2023-09-16 16:15:44 -07:00
Krrish Dholakia	ce827faa93	fixes to testing	2023-09-16 11:40:01 -07:00
ishaan-jaff	7afa3841e5	fix print stement in sent_first_chunk	2023-09-16 11:20:32 -07:00
Krrish Dholakia	5470bc6fd0	improvements to streaming	2023-09-16 11:02:06 -07:00
Krrish Dholakia	21cd55ab26	ensure streaming format is exactly the same as openai	2023-09-16 10:35:20 -07:00
ishaan-jaff	c714372b9d	streaming for amazon titan bedrock	2023-09-16 09:57:16 -07:00
ishaan-jaff	d2574e67b7	new bedroc ai21 test	2023-09-16 09:27:34 -07:00
ishaan-jaff	29e3b4fdd2	support optional params for bedrock amazon	2023-09-16 09:19:07 -07:00
ishaan-jaff	ab58e32e90	streaming fixes	2023-09-15 17:49:27 -07:00
Krrish Dholakia	5b38f04524	fixes to streaming	2023-09-15 17:23:10 -07:00
Krrish Dholakia	7b19d62564	streaming fixes	2023-09-15 15:49:20 -07:00
Krrish Dholakia	fa441e9a3e	update streaming	2023-09-15 15:25:14 -07:00
Krrish Dholakia	8fbaf14509	fix merge conflict	2023-09-15 15:22:30 -07:00
Krrish Dholakia	34c676a8ec	fix streaming error	2023-09-15 15:21:15 -07:00
ishaan-jaff	b966baa1f0	undo change to always setting role to assistant	2023-09-15 15:16:58 -07:00
Krrish Dholakia	bad1f7ead1	fix streaming error	2023-09-15 14:50:14 -07:00
ishaan-jaff	0bbe85c743	bump version	2023-09-15 14:49:03 -07:00
ishaan-jaff	5ec1fc5048	bump version	2023-09-15 14:15:09 -07:00
Krrish Dholakia	be69b42428	bump version	2023-09-15 12:24:09 -07:00
ishaan-jaff	59771012a0	update utils	2023-09-15 08:34:36 -07:00
ishaan-jaff	b75b4bcf21	add top_k + stop to litellm utils	2023-09-15 08:34:36 -07:00
Krrish Dholakia	c0e464a2f6	bump version	2023-09-14 20:01:53 -07:00
Krrish Dholakia	46e86b7433	fixes to streaming	2023-09-14 19:27:12 -07:00
Krrish Dholakia	722958a4cc	fix linting errors	2023-09-14 17:24:43 -07:00