306 commits

Author	SHA1	Message	Date
Krrish Dholakia	14d4c7ead2	update baseten handler to handle TGI calls	2023-08-30 19:14:48 -07:00
Krrish Dholakia	daa949a539	return logprobs for hf models	2023-08-30 15:16:26 -07:00
Krrish Dholakia	b90e5ed6db	adding testing to make sure litedebugger is opt-in only	2023-08-30 09:55:33 -07:00
Ishaan Jaff	6651cabd69	Merge pull request #240 from estill01/async_iterator_fix ... Add async iterator to fix/enable streaming responses	2023-08-29 19:08:35 -07:00
Krrish Dholakia	546ad43b15	adding context window exceeded error to huggingface	2023-08-29 16:46:04 -07:00
Krrish Dholakia	ad493a3109	adding contextwindow exceeded error mapping for replicate	2023-08-29 16:36:31 -07:00
Krrish Dholakia	509120bf61	add context window exceeded error for anthropic	2023-08-29 16:28:07 -07:00
Krrish Dholakia	f7955d52b5	add context window exceeded error mapping to openai	2023-08-29 16:08:00 -07:00
estill01	4d009a94b9	Add async iterator to fix/enable streaming responses	2023-08-29 15:44:44 -07:00
Krrish Dholakia	d7fe4f6c90	adding new exception mapping details to documentation	2023-08-29 15:40:16 -07:00
Krrish Dholakia	5bcf612724	adding coverage for openrouter in exception mapping	2023-08-29 15:30:24 -07:00
Krrish Dholakia	436e8eadb2	adding coverage for ai21	2023-08-29 13:32:20 -07:00
Krrish Dholakia	f11599e50c	add coverage for rate limit errors to togetherai	2023-08-29 12:54:56 -07:00
Krrish Dholakia	88bd1df3e0	adding exception handling for together ai	2023-08-29 12:29:59 -07:00
Ishaan Jaff	79524dbd5b	Merge pull request #235 from vincelwt/main ... fix llmonitorLogger undefined	2023-08-29 09:49:53 -07:00
Krish Dholakia	34346aa839	Merge pull request #227 from nirga/main ... feat: traceloop docs	2023-08-29 09:19:34 -07:00
Vince Lwt	67bb8307b0	fix llmonitorLogger undefined	2023-08-29 15:19:27 +02:00
ishaan-jaff	3726270d95	with new caching	2023-08-28 21:57:00 -07:00
ishaan-jaff	fbef73d043	add streaming_caching support	2023-08-28 19:17:53 -07:00
ishaan-jaff	8af6d967eb	working write to cache with streaming	2023-08-28 18:46:26 -07:00
ishaan-jaff	648330ce64	openai streaming	2023-08-28 15:44:15 -07:00
Krrish Dholakia	80fa61cc0e	bug fixes to logging	2023-08-28 15:36:59 -07:00
ishaan-jaff	f84b7d5c0f	add customstreapwrapper for openai streaming	2023-08-28 15:32:53 -07:00
Nir Gazit	c470ebf615	feat: traceloop docs	2023-08-29 00:13:07 +02:00
Krrish Dholakia	2462791f65	bug fixes to client	2023-08-28 15:09:14 -07:00
Krrish Dholakia	e8eb92c108	new logger client	2023-08-28 14:59:00 -07:00
ishaan-jaff	1799f1bfe9	cache improvements	2023-08-28 14:44:42 -07:00
ishaan-jaff	71ff0c69ab	working with embeddings	2023-08-28 14:07:51 -07:00
ishaan-jaff	8b43917792	v0 of caching	2023-08-28 13:11:56 -07:00
Krrish Dholakia	d542066d4b	fixes to streaming for ai21, baseten, and openai text completions	2023-08-28 09:42:51 -07:00
ishaan-jaff	b713acb0a4	formatting improvements	2023-08-28 09:20:50 -07:00
Krrish Dholakia	9497175a97	update get secret logic	2023-08-28 07:21:02 -07:00
ishaan-jaff	d4fd0b2010	fix caching	2023-08-26 21:05:35 -07:00
Krrish Dholakia	60873abb41	further fixes to together ai streaming	2023-08-26 19:30:54 -07:00
Krrish Dholakia	bb3c2fefdb	anthropic and together ai streaming no longer waits till completion to return response	2023-08-26 19:00:53 -07:00
Krrish Dholakia	9155ba068f	fix anthropic and together ai streaming	2023-08-26 16:05:43 -07:00
ishaan-jaff	b2e72e52e4	with prompt layer test	2023-08-26 11:51:55 -07:00
Krrish Dholakia	9008973826	adding ability to turn off litedebugger but still use key manager	2023-08-26 11:03:40 -07:00
Krrish Dholakia	ff7b4ffcf1	use client opt-in	2023-08-26 10:38:39 -07:00
Krrish Dholakia	fa53f7033b	allowing opt-in for litedebugger	2023-08-25 17:18:29 -07:00
Krrish Dholakia	c423db29f3	updates to litedebugger logging	2023-08-25 16:21:01 -07:00
Krrish Dholakia	acccf17e44	updates to get model list	2023-08-24 19:06:44 -07:00
Krrish Dholakia	7d16df98ac	updates to logging	2023-08-24 18:58:12 -07:00
ishaan-jaff	0d24bf9221	fix get all keys problem	2023-08-24 18:54:26 -07:00
ishaan-jaff	dc1575d790	after loading model list init env variables	2023-08-24 18:16:38 -07:00
Krrish Dholakia	6e30b234ac	move baseten to a REST endpoint call	2023-08-24 14:43:49 -07:00
ishaan-jaff	01a399f8b5	fix opt-out of litellm client	2023-08-24 12:42:07 -07:00
Krrish Dholakia	efbb476020	enable litedebugger opt-out	2023-08-24 10:19:10 -07:00
Krrish Dholakia	67d6527217	accept model alias	2023-08-24 08:20:21 -07:00
ishaan-jaff	76bf07b347	with litellm.token	2023-08-23 21:00:06 -07:00