123 commits

Author	SHA1	Message	Date
Krrish Dholakia	546ad43b15	adding context window exceeded error to huggingface	2023-08-29 16:46:04 -07:00
Krrish Dholakia	ad493a3109	adding contextwindow exceeded error mapping for replicate	2023-08-29 16:36:31 -07:00
Krrish Dholakia	509120bf61	add context window exceeded error for anthropic	2023-08-29 16:28:07 -07:00
Krrish Dholakia	f7955d52b5	add context window exceeded error mapping to openai	2023-08-29 16:08:00 -07:00
Krrish Dholakia	5bcf612724	adding coverage for openrouter in exception mapping	2023-08-29 15:30:24 -07:00
Krrish Dholakia	436e8eadb2	adding coverage for ai21	2023-08-29 13:32:20 -07:00
Krrish Dholakia	f11599e50c	add coverage for rate limit errors to togetherai	2023-08-29 12:54:56 -07:00
Krrish Dholakia	88bd1df3e0	adding exception handling for together ai	2023-08-29 12:29:59 -07:00
Krrish Dholakia	80fa61cc0e	bug fixes to logging	2023-08-28 15:36:59 -07:00
Krrish Dholakia	2462791f65	bug fixes to client	2023-08-28 15:09:14 -07:00
Krrish Dholakia	e8eb92c108	new logger client	2023-08-28 14:59:00 -07:00
Krrish Dholakia	d542066d4b	fixes to streaming for ai21, baseten, and openai text completions	2023-08-28 09:42:51 -07:00
Krrish Dholakia	60873abb41	further fixes to together ai streaming	2023-08-26 19:30:54 -07:00
Krrish Dholakia	bb3c2fefdb	anthropic and together ai streaming no longer waits till completion to return response	2023-08-26 19:00:53 -07:00
Krrish Dholakia	0ac17646d9	fix anthropic streaming	2023-08-26 18:54:51 -07:00
Krrish Dholakia	9155ba068f	fix anthropic and together ai streaming	2023-08-26 16:05:43 -07:00
Krrish Dholakia	9008973826	adding ability to turn off litedebugger but still use key manager	2023-08-26 11:03:40 -07:00
Krrish Dholakia	1192640fb9	show litedebugger for streaming objects	2023-08-26 10:28:27 -07:00
Krrish Dholakia	acccf17e44	updates to get model list	2023-08-24 19:06:44 -07:00
Krrish Dholakia	7d16df98ac	updates to logging	2023-08-24 18:58:12 -07:00
Krrish Dholakia	6e30b234ac	move baseten to a REST endpoint call	2023-08-24 14:43:49 -07:00
Krrish Dholakia	67d6527217	accept model alias	2023-08-24 08:20:21 -07:00
Krrish Dholakia	c8d2a5ed5e	adding support for completion with retries	2023-08-23 14:09:08 -07:00
Krrish Dholakia	d183dc8269	updates to litedebugger dashboard	2023-08-23 11:51:16 -07:00
Krrish Dholakia	b47cb95b90	get keys if auth error	2023-08-22 18:01:49 -07:00
Krrish Dholakia	46e1bc24b7	updates	2023-08-22 16:13:09 -07:00
Krrish Dholakia	1f98f38f13	change get to post request	2023-08-22 15:39:24 -07:00
Krrish Dholakia	f980c8450d	fixing lite debugger error	2023-08-22 15:15:47 -07:00
Krrish Dholakia	c8130f9fe0	cache the model list response	2023-08-22 07:21:24 -07:00
Krrish Dholakia	4b34eb1414	adding hosted get model list	2023-08-22 07:11:49 -07:00
Krrish Dholakia	3d9518abbb	acreate thin-client	2023-08-21 16:04:15 -07:00
Krrish Dholakia	b506e147cf	fixing azure bug	2023-08-21 14:20:29 -07:00
Krrish Dholakia	3286a708fe	simplifying calling litellm debugger	2023-08-21 11:37:09 -07:00
Krrish Dholakia	a1ad773667	adding lite debugger integration	2023-08-20 15:06:50 -07:00
Krrish Dholakia	d792be89de	making logging a class - adding input-callbacks	2023-08-19 20:03:31 -07:00
Krrish Dholakia	6cee3b22ab	allow custom provider via model name	2023-08-19 16:35:04 -07:00
Krrish Dholakia	8543d89418	automatically log data to sentry if it's present in the environment variables	2023-08-18 06:20:19 -07:00
Krrish Dholakia	ee20e6a1e6	have response type inherit from openaiobject	2023-08-18 05:13:30 -07:00
Krrish Dholakia	f0b104f37f	bug fixes for response object	2023-08-17 20:24:38 -07:00
Krrish Dholakia	16589d1892	return llm_provider as part of the exception	2023-08-17 11:41:47 -07:00
Krrish Dholakia	acbb611e89	adding exact match caching	2023-08-16 21:44:52 -07:00
Krrish Dholakia	77e4acc7fa	add testing module	2023-08-16 09:03:33 -07:00
Krrish Dholakia	6aff47083b	adding support for meta-llama-2	2023-08-14 14:35:21 -07:00
Krrish Dholakia	15944eb0f3	error handling for huggingface endpoints	2023-08-14 10:21:59 -07:00
Krrish Dholakia	a4cf7e1edd	added exception mapping to anthropic class	2023-08-12 17:39:11 -07:00
Krrish Dholakia	bc767cc42a	adding anthropic llm class - handles sync + stream	2023-08-12 16:34:32 -07:00
Krrish Dholakia	80d77fed71	coverage for custom api scenario in load testing	2023-08-11 18:20:24 -07:00
Krrish Dholakia	211e1edfcb	add model load testing functionality	2023-08-11 17:59:51 -07:00
Krrish Dholakia	a84af42dca	update version	2023-08-10 19:20:28 -07:00
Krrish Dholakia	24e51ec75c	allow custom base to openai	2023-08-10 18:01:52 -07:00