2083 commits

Author	SHA1	Message	Date
Krrish Dholakia	6f4641ac47	handle llama 2 eos tokens in streaming	2023-09-18 13:44:19 -07:00
Krrish Dholakia	3d2ffcb28b	add support for litellm proxy calls	2023-09-18 12:15:21 -07:00
ishaan-jaff	58fe19204e	add doc string for completion_cost	2023-09-18 08:44:40 -07:00
Krrish Dholakia	f4e674b41b	clean out print statements	2023-09-17 05:52:19 -07:00
Krrish Dholakia	b45bb78bee	bump pyproject version	2023-09-16 20:45:16 -07:00
Krrish Dholakia	e7974d95d5	fix streaming formatting for non-openai models	2023-09-16 19:20:07 -07:00
Krrish Dholakia	1ac316cc0a	bug fixes	2023-09-16 16:32:12 -07:00
Krrish Dholakia	d80fe482ce	except custom openai proxy	2023-09-16 16:15:44 -07:00
Krrish Dholakia	925ec2ded9	fixes to testing	2023-09-16 11:40:01 -07:00
ishaan-jaff	296961a19b	fix print stement in sent_first_chunk	2023-09-16 11:20:32 -07:00
Krrish Dholakia	1e2d6846ac	improvements to streaming	2023-09-16 11:02:06 -07:00
Krrish Dholakia	0a1f3af840	ensure streaming format is exactly the same as openai	2023-09-16 10:35:20 -07:00
ishaan-jaff	9ee3faed5b	streaming for amazon titan bedrock	2023-09-16 09:57:16 -07:00
ishaan-jaff	1dc6be8895	new bedroc ai21 test	2023-09-16 09:27:34 -07:00
ishaan-jaff	8a1a090fba	support optional params for bedrock amazon	2023-09-16 09:19:07 -07:00
ishaan-jaff	9638cfff3a	streaming fixes	2023-09-15 17:49:27 -07:00
Krrish Dholakia	0e6ace7875	fixes to streaming	2023-09-15 17:23:10 -07:00
Krrish Dholakia	ec559e854d	streaming fixes	2023-09-15 15:49:20 -07:00
Krrish Dholakia	8892b50e2a	update streaming	2023-09-15 15:25:14 -07:00
Krrish Dholakia	205cac5f26	fix merge conflict	2023-09-15 15:22:30 -07:00
Krrish Dholakia	e7b31bb7fc	fix streaming error	2023-09-15 15:21:15 -07:00
ishaan-jaff	0e6460e4f0	undo change to always setting role to assistant	2023-09-15 15:16:58 -07:00
Krrish Dholakia	4278f81a62	fix streaming error	2023-09-15 14:50:14 -07:00
ishaan-jaff	a68e31a967	bump version	2023-09-15 14:49:03 -07:00
ishaan-jaff	75de6a3516	bump version	2023-09-15 14:15:09 -07:00
Krrish Dholakia	97d9bf17c0	bump version	2023-09-15 12:24:09 -07:00
ishaan-jaff	d7972c7ed6	update utils	2023-09-15 08:34:36 -07:00
ishaan-jaff	04fc1007c8	add top_k + stop to litellm utils	2023-09-15 08:34:36 -07:00
Krrish Dholakia	d87988d42f	bump version	2023-09-14 20:01:53 -07:00
Krrish Dholakia	47253018bb	fixes to streaming	2023-09-14 19:27:12 -07:00
Krrish Dholakia	90af4e2808	fix linting errors	2023-09-14 17:24:43 -07:00
Krrish Dholakia	8b5a90aac7	fix streaming objects	2023-09-14 17:16:43 -07:00
Krrish Dholakia	b65a1d4c9c	bug fixes	2023-09-14 16:32:06 -07:00
Krrish Dholakia	d9eb7a248f	make max budget work for openai streaming	2023-09-14 16:22:52 -07:00
Krrish Dholakia	e3293ee264	exposing a litellm.max budget	2023-09-14 14:20:06 -07:00
Krrish Dholakia	22fb574009	move cohere to http endpoint	2023-09-14 11:17:38 -07:00
Krrish Dholakia	52a02c719a	fixes to mock completion	2023-09-14 10:03:57 -07:00
Krrish Dholakia	bd01f70257	adding support for nlp cloud	2023-09-14 09:19:34 -07:00
Krrish Dholakia	3496bebdc5	map finish reason	2023-09-13 19:22:38 -07:00
Krrish Dholakia	f493779a97	huggingface conversational task support	2023-09-13 13:45:23 -07:00
Krrish Dholakia	6cd950a031	return model name as part of streaming object	2023-09-13 09:48:49 -07:00
Krrish Dholakia	f015cd908a	doc cleanup for custom prompt templates	2023-09-12 12:16:47 -07:00
ishaan-jaff	e6595d7e6f	update check_valid_key	2023-09-12 11:50:30 -07:00
Krrish Dholakia	abc595998d	fix get llm provider	2023-09-12 11:48:44 -07:00
Ishaan Jaff	5cec386ae2	Merge branch 'main' into main	2023-09-12 11:43:03 -07:00
Krrish Dholakia	01564578ce	fix linting error	2023-09-12 11:38:00 -07:00
ishaan-jaff	6dfe6bca2e	fix linting error	2023-09-12 11:36:20 -07:00
ishaan-jaff	385a5a0d2b	add valid models in utils.py	2023-09-12 11:29:18 -07:00
Krrish Dholakia	3f6b194b71	raise better exception if llm provider isn't passed in or inferred	2023-09-12 11:28:50 -07:00
William Espegren	e6cd8963e8	renamed and added test_good_key()	2023-09-12 19:02:55 +02:00