2067 commits

Author	SHA1	Message	Date
Krrish Dholakia	0e6ace7875	fixes to streaming	2023-09-15 17:23:10 -07:00
Krrish Dholakia	ec559e854d	streaming fixes	2023-09-15 15:49:20 -07:00
Krrish Dholakia	8892b50e2a	update streaming	2023-09-15 15:25:14 -07:00
Krrish Dholakia	205cac5f26	fix merge conflict	2023-09-15 15:22:30 -07:00
Krrish Dholakia	e7b31bb7fc	fix streaming error	2023-09-15 15:21:15 -07:00
ishaan-jaff	0e6460e4f0	undo change to always setting role to assistant	2023-09-15 15:16:58 -07:00
Krrish Dholakia	4278f81a62	fix streaming error	2023-09-15 14:50:14 -07:00
ishaan-jaff	a68e31a967	bump version	2023-09-15 14:49:03 -07:00
ishaan-jaff	75de6a3516	bump version	2023-09-15 14:15:09 -07:00
Krrish Dholakia	97d9bf17c0	bump version	2023-09-15 12:24:09 -07:00
ishaan-jaff	d7972c7ed6	update utils	2023-09-15 08:34:36 -07:00
ishaan-jaff	04fc1007c8	add top_k + stop to litellm utils	2023-09-15 08:34:36 -07:00
Krrish Dholakia	d87988d42f	bump version	2023-09-14 20:01:53 -07:00
Krrish Dholakia	47253018bb	fixes to streaming	2023-09-14 19:27:12 -07:00
Krrish Dholakia	90af4e2808	fix linting errors	2023-09-14 17:24:43 -07:00
Krrish Dholakia	8b5a90aac7	fix streaming objects	2023-09-14 17:16:43 -07:00
Krrish Dholakia	b65a1d4c9c	bug fixes	2023-09-14 16:32:06 -07:00
Krrish Dholakia	d9eb7a248f	make max budget work for openai streaming	2023-09-14 16:22:52 -07:00
Krrish Dholakia	e3293ee264	exposing a litellm.max budget	2023-09-14 14:20:06 -07:00
Krrish Dholakia	22fb574009	move cohere to http endpoint	2023-09-14 11:17:38 -07:00
Krrish Dholakia	52a02c719a	fixes to mock completion	2023-09-14 10:03:57 -07:00
Krrish Dholakia	bd01f70257	adding support for nlp cloud	2023-09-14 09:19:34 -07:00
Krrish Dholakia	3496bebdc5	map finish reason	2023-09-13 19:22:38 -07:00
Krrish Dholakia	f493779a97	huggingface conversational task support	2023-09-13 13:45:23 -07:00
Krrish Dholakia	6cd950a031	return model name as part of streaming object	2023-09-13 09:48:49 -07:00
Krrish Dholakia	f015cd908a	doc cleanup for custom prompt templates	2023-09-12 12:16:47 -07:00
ishaan-jaff	e6595d7e6f	update check_valid_key	2023-09-12 11:50:30 -07:00
Krrish Dholakia	abc595998d	fix get llm provider	2023-09-12 11:48:44 -07:00
Ishaan Jaff	5cec386ae2	Merge branch 'main' into main	2023-09-12 11:43:03 -07:00
Krrish Dholakia	01564578ce	fix linting error	2023-09-12 11:38:00 -07:00
ishaan-jaff	6dfe6bca2e	fix linting error	2023-09-12 11:36:20 -07:00
ishaan-jaff	385a5a0d2b	add valid models in utils.py	2023-09-12 11:29:18 -07:00
Krrish Dholakia	3f6b194b71	raise better exception if llm provider isn't passed in or inferred	2023-09-12 11:28:50 -07:00
William Espegren	e6cd8963e8	renamed and added test_good_key()	2023-09-12 19:02:55 +02:00
William Espegren	09022ad61d	util: verify_access_key ... Verify that the user provided a valid openai token by creating a request to the openAI endpoint.	2023-09-12 18:48:23 +02:00
ishaan-jaff	9f1a8844cd	rename safe_messages to trim_messages	2023-09-11 18:54:18 -07:00
Krrish Dholakia	355c2ed00c	improvements to exception mapping	2023-09-11 18:33:57 -07:00
ishaan-jaff	5343827af5	fix linting	2023-09-11 18:11:06 -07:00
ishaan-jaff	d0984d8c60	add safe_message trimmer	2023-09-11 17:58:37 -07:00
Krrish Dholakia	9f7c1d3885	add mock request to docs	2023-09-11 12:19:13 -07:00
Krrish Dholakia	8459d3c261	update url	2023-09-11 08:07:46 -07:00
ishaan-jaff	5b687548e0	bump litellm v + default finish_reason to None	2023-09-09 19:44:05 -07:00
ishaan-jaff	995b0b525e	add finish reason to streamed responses	2023-09-09 19:36:38 -07:00
ishaan-jaff	41d90f0ef7	custom_logger for litellm - callback_func	2023-09-09 18:41:41 -07:00
ishaan-jaff	b377655d8f	try/except completion_cost + custom logger func	2023-09-09 18:36:22 -07:00
Krrish Dholakia	10e4a06799	fix circle ci testing	2023-09-09 16:36:45 -07:00
Krrish Dholakia	1dd77ff176	update testing	2023-09-09 16:35:38 -07:00
Krrish Dholakia	4319b1011c	add api manager	2023-09-09 15:55:38 -07:00
ishaan-jaff	b8538fea34	olla upgrades, fix streaming, add non streaming resp	2023-09-09 14:07:13 -07:00
Krrish Dholakia	7b11a5beb6	modification to arg checking	2023-09-09 13:17:51 -07:00