479 commits

Author	SHA1	Message	Date
Krrish Dholakia	66a3c59ebe	bump pyproject version	2023-09-16 20:45:16 -07:00
Krrish Dholakia	e44c218c1b	fix streaming formatting for non-openai models	2023-09-16 19:20:07 -07:00
Krrish Dholakia	d2f8a7b2ae	bug fixes	2023-09-16 16:32:12 -07:00
Krrish Dholakia	122c993e6f	except custom openai proxy	2023-09-16 16:15:44 -07:00
Krrish Dholakia	ce827faa93	fixes to testing	2023-09-16 11:40:01 -07:00
ishaan-jaff	7afa3841e5	fix print stement in sent_first_chunk	2023-09-16 11:20:32 -07:00
Krrish Dholakia	5470bc6fd0	improvements to streaming	2023-09-16 11:02:06 -07:00
Krrish Dholakia	21cd55ab26	ensure streaming format is exactly the same as openai	2023-09-16 10:35:20 -07:00
ishaan-jaff	c714372b9d	streaming for amazon titan bedrock	2023-09-16 09:57:16 -07:00
ishaan-jaff	d2574e67b7	new bedroc ai21 test	2023-09-16 09:27:34 -07:00
ishaan-jaff	29e3b4fdd2	support optional params for bedrock amazon	2023-09-16 09:19:07 -07:00
ishaan-jaff	ab58e32e90	streaming fixes	2023-09-15 17:49:27 -07:00
Krrish Dholakia	5b38f04524	fixes to streaming	2023-09-15 17:23:10 -07:00
Krrish Dholakia	7b19d62564	streaming fixes	2023-09-15 15:49:20 -07:00
Krrish Dholakia	fa441e9a3e	update streaming	2023-09-15 15:25:14 -07:00
Krrish Dholakia	8fbaf14509	fix merge conflict	2023-09-15 15:22:30 -07:00
Krrish Dholakia	34c676a8ec	fix streaming error	2023-09-15 15:21:15 -07:00
ishaan-jaff	b966baa1f0	undo change to always setting role to assistant	2023-09-15 15:16:58 -07:00
Krrish Dholakia	bad1f7ead1	fix streaming error	2023-09-15 14:50:14 -07:00
ishaan-jaff	0bbe85c743	bump version	2023-09-15 14:49:03 -07:00
ishaan-jaff	5ec1fc5048	bump version	2023-09-15 14:15:09 -07:00
Krrish Dholakia	be69b42428	bump version	2023-09-15 12:24:09 -07:00
ishaan-jaff	59771012a0	update utils	2023-09-15 08:34:36 -07:00
ishaan-jaff	b75b4bcf21	add top_k + stop to litellm utils	2023-09-15 08:34:36 -07:00
Krrish Dholakia	c0e464a2f6	bump version	2023-09-14 20:01:53 -07:00
Krrish Dholakia	46e86b7433	fixes to streaming	2023-09-14 19:27:12 -07:00
Krrish Dholakia	722958a4cc	fix linting errors	2023-09-14 17:24:43 -07:00
Krrish Dholakia	0b436cf767	fix streaming objects	2023-09-14 17:16:43 -07:00
Krrish Dholakia	29c3247753	bug fixes	2023-09-14 16:32:06 -07:00
Krrish Dholakia	f7e92bb0db	make max budget work for openai streaming	2023-09-14 16:22:52 -07:00
Krrish Dholakia	73a084c19c	exposing a litellm.max budget	2023-09-14 14:20:06 -07:00
Krrish Dholakia	3b4064a58f	move cohere to http endpoint	2023-09-14 11:17:38 -07:00
Krrish Dholakia	e2ea4adb84	fixes to mock completion	2023-09-14 10:03:57 -07:00
Krrish Dholakia	f98da9f13c	adding support for nlp cloud	2023-09-14 09:19:34 -07:00
Krrish Dholakia	aaa57abddd	map finish reason	2023-09-13 19:22:38 -07:00
Krrish Dholakia	5b6b9a9fab	huggingface conversational task support	2023-09-13 13:45:23 -07:00
Krrish Dholakia	b1fbe515fe	return model name as part of streaming object	2023-09-13 09:48:49 -07:00
Krrish Dholakia	e80457013b	doc cleanup for custom prompt templates	2023-09-12 12:16:47 -07:00
ishaan-jaff	8b60440b4b	update check_valid_key	2023-09-12 11:50:30 -07:00
Krrish Dholakia	05f2f3dde7	fix get llm provider	2023-09-12 11:48:44 -07:00
Ishaan Jaff	60e3e42fba	Merge branch 'main' into main	2023-09-12 11:43:03 -07:00
Krrish Dholakia	c5df95c560	fix linting error	2023-09-12 11:38:00 -07:00
ishaan-jaff	4d253f45d8	fix linting error	2023-09-12 11:36:20 -07:00
ishaan-jaff	57f15b379d	add valid models in utils.py	2023-09-12 11:29:18 -07:00
Krrish Dholakia	baa69734b0	raise better exception if llm provider isn't passed in or inferred	2023-09-12 11:28:50 -07:00
William Espegren	b26933301d	renamed and added test_good_key()	2023-09-12 19:02:55 +02:00
William Espegren	261db15bcf	util: verify_access_key ... Verify that the user provided a valid openai token by creating a request to the openAI endpoint.	2023-09-12 18:48:23 +02:00
ishaan-jaff	dda87a55ff	rename safe_messages to trim_messages	2023-09-11 18:54:18 -07:00
Krrish Dholakia	f946f61b4c	improvements to exception mapping	2023-09-11 18:33:57 -07:00
ishaan-jaff	d70cff8713	fix linting	2023-09-11 18:11:06 -07:00