456 commits

Author	SHA1	Message	Date
ishaan-jaff	04fc1007c8	add top_k + stop to litellm utils	2023-09-15 08:34:36 -07:00
Krrish Dholakia	d87988d42f	bump version	2023-09-14 20:01:53 -07:00
Krrish Dholakia	47253018bb	fixes to streaming	2023-09-14 19:27:12 -07:00
Krrish Dholakia	90af4e2808	fix linting errors	2023-09-14 17:24:43 -07:00
Krrish Dholakia	8b5a90aac7	fix streaming objects	2023-09-14 17:16:43 -07:00
Krrish Dholakia	b65a1d4c9c	bug fixes	2023-09-14 16:32:06 -07:00
Krrish Dholakia	d9eb7a248f	make max budget work for openai streaming	2023-09-14 16:22:52 -07:00
Krrish Dholakia	e3293ee264	exposing a litellm.max budget	2023-09-14 14:20:06 -07:00
Krrish Dholakia	22fb574009	move cohere to http endpoint	2023-09-14 11:17:38 -07:00
Krrish Dholakia	52a02c719a	fixes to mock completion	2023-09-14 10:03:57 -07:00
Krrish Dholakia	bd01f70257	adding support for nlp cloud	2023-09-14 09:19:34 -07:00
Krrish Dholakia	3496bebdc5	map finish reason	2023-09-13 19:22:38 -07:00
Krrish Dholakia	f493779a97	huggingface conversational task support	2023-09-13 13:45:23 -07:00
Krrish Dholakia	6cd950a031	return model name as part of streaming object	2023-09-13 09:48:49 -07:00
Krrish Dholakia	f015cd908a	doc cleanup for custom prompt templates	2023-09-12 12:16:47 -07:00
ishaan-jaff	e6595d7e6f	update check_valid_key	2023-09-12 11:50:30 -07:00
Krrish Dholakia	abc595998d	fix get llm provider	2023-09-12 11:48:44 -07:00
Ishaan Jaff	5cec386ae2	Merge branch 'main' into main	2023-09-12 11:43:03 -07:00
Krrish Dholakia	01564578ce	fix linting error	2023-09-12 11:38:00 -07:00
ishaan-jaff	6dfe6bca2e	fix linting error	2023-09-12 11:36:20 -07:00
ishaan-jaff	385a5a0d2b	add valid models in utils.py	2023-09-12 11:29:18 -07:00
Krrish Dholakia	3f6b194b71	raise better exception if llm provider isn't passed in or inferred	2023-09-12 11:28:50 -07:00
William Espegren	e6cd8963e8	renamed and added test_good_key()	2023-09-12 19:02:55 +02:00
William Espegren	09022ad61d	util: verify_access_key ... Verify that the user provided a valid openai token by creating a request to the openAI endpoint.	2023-09-12 18:48:23 +02:00
ishaan-jaff	9f1a8844cd	rename safe_messages to trim_messages	2023-09-11 18:54:18 -07:00
Krrish Dholakia	355c2ed00c	improvements to exception mapping	2023-09-11 18:33:57 -07:00
ishaan-jaff	5343827af5	fix linting	2023-09-11 18:11:06 -07:00
ishaan-jaff	d0984d8c60	add safe_message trimmer	2023-09-11 17:58:37 -07:00
Krrish Dholakia	9f7c1d3885	add mock request to docs	2023-09-11 12:19:13 -07:00
Krrish Dholakia	8459d3c261	update url	2023-09-11 08:07:46 -07:00
ishaan-jaff	5b687548e0	bump litellm v + default finish_reason to None	2023-09-09 19:44:05 -07:00
ishaan-jaff	995b0b525e	add finish reason to streamed responses	2023-09-09 19:36:38 -07:00
ishaan-jaff	41d90f0ef7	custom_logger for litellm - callback_func	2023-09-09 18:41:41 -07:00
ishaan-jaff	b377655d8f	try/except completion_cost + custom logger func	2023-09-09 18:36:22 -07:00
Krrish Dholakia	10e4a06799	fix circle ci testing	2023-09-09 16:36:45 -07:00
Krrish Dholakia	1dd77ff176	update testing	2023-09-09 16:35:38 -07:00
Krrish Dholakia	4319b1011c	add api manager	2023-09-09 15:55:38 -07:00
ishaan-jaff	b8538fea34	olla upgrades, fix streaming, add non streaming resp	2023-09-09 14:07:13 -07:00
Krrish Dholakia	7b11a5beb6	modification to arg checking	2023-09-09 13:17:51 -07:00
Krrish Dholakia	848660be9a	fix exception	2023-09-09 11:24:10 -07:00
Krrish Dholakia	f7dbdb52bd	improve error message returned if model not passed in	2023-09-09 11:18:10 -07:00
ishaan-jaff	0568a263e6	safe get_or_generate_uuid	2023-09-08 21:34:09 -07:00
Krrish Dholakia	c177267d51	bump version	2023-09-08 19:26:41 -07:00
Krrish Dholakia	c054f22f10	update exception logic	2023-09-08 18:55:11 -07:00
Krrish Dholakia	e69863f91b	fix exception mapping	2023-09-08 18:45:18 -07:00
Krrish Dholakia	a89a491c10	fix exception mapping error	2023-09-08 18:20:07 -07:00
ishaan-jaff	da87721a20	caching updates	2023-09-08 18:06:47 -07:00
ishaan-jaff	9352c81dd4	better exception raising for package not imported	2023-09-08 17:42:01 -07:00
ishaan-jaff	80047aedc8	fix exception handling	2023-09-08 15:42:27 -07:00
Krrish Dholakia	75336a7dc8	bump version	2023-09-08 13:12:27 -07:00