462 commits

Author	SHA1	Message	Date
ishaan-jaff	b966baa1f0	undo change to always setting role to assistant	2023-09-15 15:16:58 -07:00
Krrish Dholakia	bad1f7ead1	fix streaming error	2023-09-15 14:50:14 -07:00
ishaan-jaff	0bbe85c743	bump version	2023-09-15 14:49:03 -07:00
ishaan-jaff	5ec1fc5048	bump version	2023-09-15 14:15:09 -07:00
Krrish Dholakia	be69b42428	bump version	2023-09-15 12:24:09 -07:00
ishaan-jaff	59771012a0	update utils	2023-09-15 08:34:36 -07:00
ishaan-jaff	b75b4bcf21	add top_k + stop to litellm utils	2023-09-15 08:34:36 -07:00
Krrish Dholakia	c0e464a2f6	bump version	2023-09-14 20:01:53 -07:00
Krrish Dholakia	46e86b7433	fixes to streaming	2023-09-14 19:27:12 -07:00
Krrish Dholakia	722958a4cc	fix linting errors	2023-09-14 17:24:43 -07:00
Krrish Dholakia	0b436cf767	fix streaming objects	2023-09-14 17:16:43 -07:00
Krrish Dholakia	29c3247753	bug fixes	2023-09-14 16:32:06 -07:00
Krrish Dholakia	f7e92bb0db	make max budget work for openai streaming	2023-09-14 16:22:52 -07:00
Krrish Dholakia	73a084c19c	exposing a litellm.max budget	2023-09-14 14:20:06 -07:00
Krrish Dholakia	3b4064a58f	move cohere to http endpoint	2023-09-14 11:17:38 -07:00
Krrish Dholakia	e2ea4adb84	fixes to mock completion	2023-09-14 10:03:57 -07:00
Krrish Dholakia	f98da9f13c	adding support for nlp cloud	2023-09-14 09:19:34 -07:00
Krrish Dholakia	aaa57abddd	map finish reason	2023-09-13 19:22:38 -07:00
Krrish Dholakia	5b6b9a9fab	huggingface conversational task support	2023-09-13 13:45:23 -07:00
Krrish Dholakia	b1fbe515fe	return model name as part of streaming object	2023-09-13 09:48:49 -07:00
Krrish Dholakia	e80457013b	doc cleanup for custom prompt templates	2023-09-12 12:16:47 -07:00
ishaan-jaff	8b60440b4b	update check_valid_key	2023-09-12 11:50:30 -07:00
Krrish Dholakia	05f2f3dde7	fix get llm provider	2023-09-12 11:48:44 -07:00
Ishaan Jaff	60e3e42fba	Merge branch 'main' into main	2023-09-12 11:43:03 -07:00
Krrish Dholakia	c5df95c560	fix linting error	2023-09-12 11:38:00 -07:00
ishaan-jaff	4d253f45d8	fix linting error	2023-09-12 11:36:20 -07:00
ishaan-jaff	57f15b379d	add valid models in utils.py	2023-09-12 11:29:18 -07:00
Krrish Dholakia	baa69734b0	raise better exception if llm provider isn't passed in or inferred	2023-09-12 11:28:50 -07:00
William Espegren	b26933301d	renamed and added test_good_key()	2023-09-12 19:02:55 +02:00
William Espegren	261db15bcf	util: verify_access_key ... Verify that the user provided a valid openai token by creating a request to the openAI endpoint.	2023-09-12 18:48:23 +02:00
ishaan-jaff	dda87a55ff	rename safe_messages to trim_messages	2023-09-11 18:54:18 -07:00
Krrish Dholakia	f946f61b4c	improvements to exception mapping	2023-09-11 18:33:57 -07:00
ishaan-jaff	d70cff8713	fix linting	2023-09-11 18:11:06 -07:00
ishaan-jaff	be5a92c40a	add safe_message trimmer	2023-09-11 17:58:37 -07:00
Krrish Dholakia	6da500c6e0	add mock request to docs	2023-09-11 12:19:13 -07:00
Krrish Dholakia	a99080fe0d	update url	2023-09-11 08:07:46 -07:00
ishaan-jaff	4fde7d655b	bump litellm v + default finish_reason to None	2023-09-09 19:44:05 -07:00
ishaan-jaff	0f769c5417	add finish reason to streamed responses	2023-09-09 19:36:38 -07:00
ishaan-jaff	eaaede608e	custom_logger for litellm - callback_func	2023-09-09 18:41:41 -07:00
ishaan-jaff	7dc694c704	try/except completion_cost + custom logger func	2023-09-09 18:36:22 -07:00
Krrish Dholakia	511793f8ac	fix circle ci testing	2023-09-09 16:36:45 -07:00
Krrish Dholakia	beecb60f51	update testing	2023-09-09 16:35:38 -07:00
Krrish Dholakia	a39756bfda	add api manager	2023-09-09 15:55:38 -07:00
ishaan-jaff	56bd8c1c52	olla upgrades, fix streaming, add non streaming resp	2023-09-09 14:07:13 -07:00
Krrish Dholakia	6cb03d7c63	modification to arg checking	2023-09-09 13:17:51 -07:00
Krrish Dholakia	263704e942	fix exception	2023-09-09 11:24:10 -07:00
Krrish Dholakia	a9cab12a47	improve error message returned if model not passed in	2023-09-09 11:18:10 -07:00
ishaan-jaff	26773a5d14	safe get_or_generate_uuid	2023-09-08 21:34:09 -07:00
Krrish Dholakia	59d6703b0c	bump version	2023-09-08 19:26:41 -07:00
Krrish Dholakia	d02ab9bfcd	update exception logic	2023-09-08 18:55:11 -07:00