87 commits

Author	SHA1	Message	Date
Krrish Dholakia	a07251a514	fix azure streaming	2023-09-02 16:10:19 -07:00
Krrish Dholakia	78cd8d6e27	update to logging	2023-09-02 15:45:45 -07:00
Krrish Dholakia	a972676655	adding support for aleph alpha	2023-09-02 13:15:41 -07:00
Krrish Dholakia	5cd84b709e	fix streaming cache logic	2023-09-01 16:56:07 -07:00
Krrish Dholakia	a2c76eb614	update to litedebugger testing	2023-09-01 16:13:45 -07:00
Krrish Dholakia	455794c628	updates to logging	2023-09-01 14:38:52 -07:00
Krrish Dholakia	db5e7a3515	fixes to litedebugger	2023-09-01 13:22:16 -07:00
Krrish Dholakia	bfa79ea3c0	fixes to core logging	2023-09-01 11:51:49 -07:00
Krrish Dholakia	1f2732a835	update model split tests with ui	2023-08-31 16:42:40 -07:00
Krrish Dholakia	4927e5879f	update baseten handler to handle TGI calls	2023-08-30 19:14:48 -07:00
Krrish Dholakia	fd7b7b998b	add huggingface	2023-08-30 16:05:33 -07:00
Krrish Dholakia	1385c26aff	return logprobs for hf models	2023-08-30 15:16:26 -07:00
Krrish Dholakia	581221339e	updates	2023-08-30 09:55:45 -07:00
Krrish Dholakia	eb33e1fa71	adding testing to make sure litedebugger is opt-in only	2023-08-30 09:55:33 -07:00
Krrish Dholakia	259de2d117	adding context window exceeded error to huggingface	2023-08-29 16:46:04 -07:00
Krrish Dholakia	7c4cc5942d	adding contextwindow exceeded error mapping for replicate	2023-08-29 16:36:31 -07:00
Krrish Dholakia	c00cb299fc	add context window exceeded error for anthropic	2023-08-29 16:28:07 -07:00
Krrish Dholakia	b40d9f79b5	add context window exceeded error mapping to openai	2023-08-29 16:08:00 -07:00
Krrish Dholakia	efbde50a03	adding coverage for openrouter in exception mapping	2023-08-29 15:30:24 -07:00
Krrish Dholakia	9646c03fe5	adding coverage for ai21	2023-08-29 13:32:20 -07:00
Krrish Dholakia	342fece93d	add coverage for rate limit errors to togetherai	2023-08-29 12:54:56 -07:00
Krrish Dholakia	c790dfe323	adding exception handling for together ai	2023-08-29 12:29:59 -07:00
Krrish Dholakia	ddd583efb1	bug fixes to logging	2023-08-28 15:36:59 -07:00
Krrish Dholakia	0158e12701	bug fixes to client	2023-08-28 15:09:14 -07:00
Krrish Dholakia	a0f882d507	new logger client	2023-08-28 14:59:00 -07:00
Krrish Dholakia	3087c904eb	fixes to streaming for ai21, baseten, and openai text completions	2023-08-28 09:42:51 -07:00
Krrish Dholakia	345a8888e9	further fixes to together ai streaming	2023-08-26 19:30:54 -07:00
Krrish Dholakia	320fe89a24	anthropic and together ai streaming no longer waits till completion to return response	2023-08-26 19:00:53 -07:00
Krrish Dholakia	95ce560f6d	fix anthropic streaming	2023-08-26 18:54:51 -07:00
Krrish Dholakia	4c754d29b0	fix anthropic and together ai streaming	2023-08-26 16:05:43 -07:00
Krrish Dholakia	d0eb126700	adding ability to turn off litedebugger but still use key manager	2023-08-26 11:03:40 -07:00
Krrish Dholakia	47917edef4	show litedebugger for streaming objects	2023-08-26 10:28:27 -07:00
Krrish Dholakia	d5e8d8234a	updates to get model list	2023-08-24 19:06:44 -07:00
Krrish Dholakia	5aa3bd67ca	updates to logging	2023-08-24 18:58:12 -07:00
Krrish Dholakia	f7f108d230	move baseten to a REST endpoint call	2023-08-24 14:43:49 -07:00
Krrish Dholakia	63a226d8ba	accept model alias	2023-08-24 08:20:21 -07:00
Krrish Dholakia	0955f9d53d	adding support for completion with retries	2023-08-23 14:09:08 -07:00
Krrish Dholakia	e659c66a75	updates to litedebugger dashboard	2023-08-23 11:51:16 -07:00
Krrish Dholakia	a34b613a7c	get keys if auth error	2023-08-22 18:01:49 -07:00
Krrish Dholakia	b481a66c7f	updates	2023-08-22 16:13:09 -07:00
Krrish Dholakia	d01017256a	change get to post request	2023-08-22 15:39:24 -07:00
Krrish Dholakia	2246bf6264	fixing lite debugger error	2023-08-22 15:15:47 -07:00
Krrish Dholakia	c4a4db2b34	cache the model list response	2023-08-22 07:21:24 -07:00
Krrish Dholakia	fd2eeaa6bc	adding hosted get model list	2023-08-22 07:11:49 -07:00
Krrish Dholakia	1bbec66b57	acreate thin-client	2023-08-21 16:04:15 -07:00
Krrish Dholakia	a156fa1e1f	fixing azure bug	2023-08-21 14:20:29 -07:00
Krrish Dholakia	4835a36cd8	simplifying calling litellm debugger	2023-08-21 11:37:09 -07:00
Krrish Dholakia	16a87afc80	adding lite debugger integration	2023-08-20 15:06:50 -07:00
Krrish Dholakia	7c33d1157a	making logging a class - adding input-callbacks	2023-08-19 20:03:31 -07:00
Krrish Dholakia	5e53c9664c	allow custom provider via model name	2023-08-19 16:35:04 -07:00