1456 commits

Author	SHA1	Message	Date
Krrish Dholakia	633e36de42	handle llama 2 eos tokens in streaming	2023-09-18 13:44:19 -07:00
Krrish Dholakia	9067ec3b43	add support for litellm proxy calls	2023-09-18 12:15:21 -07:00
ishaan-jaff	0f88b82c4f	add gpt-3.5-instruct	2023-09-18 12:14:52 -07:00
Krrish Dholakia	5b294c704e	fix hf conversational task bug	2023-09-18 11:46:36 -07:00
ishaan-jaff	071e77ccad	hf non conv + tgi llms	2023-09-18 10:43:40 -07:00
WilliamEspegren	518deae394	resolve merge conflicts	2023-09-18 09:15:03 +02:00
WilliamEspegren	63a8614a14	Added function_call support to stream_chunk_builder	2023-09-17 19:42:55 +02:00
WilliamEspegren	404af1be0f	if "function_call" find name	2023-09-17 19:02:50 +02:00
Krrish Dholakia	abe3286ec6	bump version	2023-09-17 08:07:19 -07:00
WilliamEspegren	5544a9251f	rebuild chunks to openAI response ... Rebuild the cunks, but does not include the "usage"	2023-09-17 13:07:54 +02:00
WilliamEspegren	e07b3f5bfe	append chunk to chunks	2023-09-17 10:29:09 +02:00
WilliamEspegren	fe37f97423	add empty chunks list	2023-09-17 10:28:37 +02:00
WilliamEspegren	a39a204457	import stream_chunk_builder	2023-09-17 10:28:01 +02:00
WilliamEspegren	71afdbc0e5	add max_tokens	2023-09-17 10:27:32 +02:00
WilliamEspegren	43a18b9528	add stream_chunk_builder function	2023-09-17 10:26:34 +02:00
Krrish Dholakia	66a3c59ebe	bump pyproject version	2023-09-16 20:45:16 -07:00
Krrish Dholakia	d2f8a7b2ae	bug fixes	2023-09-16 16:32:12 -07:00
Krrish Dholakia	122c993e6f	except custom openai proxy	2023-09-16 16:15:44 -07:00
Krrish Dholakia	15bc5f2bdc	check function call + streaming format	2023-09-16 13:31:18 -07:00
Krrish Dholakia	265f966cab	bump version and fix testing	2023-09-16 13:04:59 -07:00
Krrish Dholakia	01978c6ec1	bump version	2023-09-16 12:28:57 -07:00
Krrish Dholakia	ce827faa93	fixes to testing	2023-09-16 11:40:01 -07:00
ishaan-jaff	09d63a6e73	add extensive oi test	2023-09-16 11:27:22 -07:00
Krrish Dholakia	8a3844692c	moving open interpreter tests	2023-09-16 11:04:35 -07:00
Krrish Dholakia	5470bc6fd0	improvements to streaming	2023-09-16 11:02:06 -07:00
ishaan-jaff	63f3386dd0	add new open - int test	2023-09-16 10:52:18 -07:00
Krrish Dholakia	21cd55ab26	ensure streaming format is exactly the same as openai	2023-09-16 10:35:20 -07:00
ishaan-jaff	c714372b9d	streaming for amazon titan bedrock	2023-09-16 09:57:16 -07:00
ishaan-jaff	93fbe4a733	test	2023-09-16 09:27:39 -07:00
ishaan-jaff	4a975a6fd0	test	2023-09-16 09:24:49 -07:00
ishaan-jaff	2993324a34	try test again	2023-09-16 09:24:03 -07:00
ishaan-jaff	105f58b678	test	2023-09-16 09:19:07 -07:00
ishaan-jaff	29e3b4fdd2	support optional params for bedrock amazon	2023-09-16 09:19:07 -07:00
ishaan-jaff	775932a4cc	fix streaming	2023-09-15 18:30:38 -07:00
ishaan-jaff	58568d51e8	fix streaming stuff	2023-09-15 18:18:55 -07:00
ishaan-jaff	4e294ad8db	fix streaming test	2023-09-15 18:04:52 -07:00
ishaan-jaff	3dbaba5af5	stream testing fixes	2023-09-15 17:57:05 -07:00
ishaan-jaff	712c39cc55	testing fixes	2023-09-15 17:49:27 -07:00
Krrish Dholakia	e1c1493db2	update testing	2023-09-15 17:32:10 -07:00
Krrish Dholakia	5b38f04524	fixes to streaming	2023-09-15 17:23:10 -07:00
Krrish Dholakia	7b19d62564	streaming fixes	2023-09-15 15:49:20 -07:00
Krrish Dholakia	34c676a8ec	fix streaming error	2023-09-15 15:21:15 -07:00
ishaan-jaff	de37c99021	add test cases for checking role in streaming reqs	2023-09-15 14:57:26 -07:00
ishaan-jaff	f1d18f1637	added vertex ai streaming	2023-09-15 14:15:09 -07:00
ishaan-jaff	abb3793e50	tests	2023-09-15 13:38:26 -07:00
Krrish Dholakia	46e86b7433	fixes to streaming	2023-09-14 19:27:12 -07:00
Krrish Dholakia	0b436cf767	fix streaming objects	2023-09-14 17:16:43 -07:00
Krrish Dholakia	f7e92bb0db	make max budget work for openai streaming	2023-09-14 16:22:52 -07:00
ishaan-jaff	b290577748	testing update	2023-09-14 14:22:29 -07:00
Krrish Dholakia	73a084c19c	exposing a litellm.max budget	2023-09-14 14:20:06 -07:00