2113 commits

Author	SHA1	Message	Date
Krrish Dholakia	1f2732a835	update model split tests with ui	2023-08-31 16:42:40 -07:00
Krrish Dholakia	0f973402ee	add completion call id	2023-08-31 12:54:38 -07:00
ishaan-jaff	4f72dbc69c	add langfuse integration	2023-08-31 11:04:17 -07:00
ishaan-jaff	98e0010df1	litellm call id's in responses when client true	2023-08-31 10:09:10 -07:00
ishaan-jaff	7d5d6751dc	write to tmp dir	2023-08-31 08:55:19 -07:00
yujong-lee	e969358656	Cleanup test, at least pass with openai	2023-08-31 20:33:34 +09:00
yujong-lee	3f9c710ef4	Fix!	2023-08-31 20:18:17 +09:00
Krrish Dholakia	4927e5879f	update baseten handler to handle TGI calls	2023-08-30 19:14:48 -07:00
Krrish Dholakia	1385c26aff	return logprobs for hf models	2023-08-30 15:16:26 -07:00
Krrish Dholakia	eb33e1fa71	adding testing to make sure litedebugger is opt-in only	2023-08-30 09:55:33 -07:00
Ishaan Jaff	19f77b7ac4	Merge pull request #240 from estill01/async_iterator_fix ... Add async iterator to fix/enable streaming responses	2023-08-29 19:08:35 -07:00
Krrish Dholakia	259de2d117	adding context window exceeded error to huggingface	2023-08-29 16:46:04 -07:00
Krrish Dholakia	7c4cc5942d	adding contextwindow exceeded error mapping for replicate	2023-08-29 16:36:31 -07:00
Krrish Dholakia	c00cb299fc	add context window exceeded error for anthropic	2023-08-29 16:28:07 -07:00
Krrish Dholakia	b40d9f79b5	add context window exceeded error mapping to openai	2023-08-29 16:08:00 -07:00
estill01	53c2d7b3f9	Add async iterator to fix/enable streaming responses	2023-08-29 15:44:44 -07:00
Krrish Dholakia	be271b58e8	adding new exception mapping details to documentation	2023-08-29 15:40:16 -07:00
Krrish Dholakia	efbde50a03	adding coverage for openrouter in exception mapping	2023-08-29 15:30:24 -07:00
Krrish Dholakia	9646c03fe5	adding coverage for ai21	2023-08-29 13:32:20 -07:00
Krrish Dholakia	342fece93d	add coverage for rate limit errors to togetherai	2023-08-29 12:54:56 -07:00
Krrish Dholakia	c790dfe323	adding exception handling for together ai	2023-08-29 12:29:59 -07:00
Ishaan Jaff	f7ffaa6163	Merge pull request #235 from vincelwt/main ... fix llmonitorLogger undefined	2023-08-29 09:49:53 -07:00
Krish Dholakia	4c4a43573d	Merge pull request #227 from nirga/main ... feat: traceloop docs	2023-08-29 09:19:34 -07:00
Vince Lwt	16026976ac	fix llmonitorLogger undefined	2023-08-29 15:19:27 +02:00
ishaan-jaff	309e5e7046	with new caching	2023-08-28 21:57:00 -07:00
ishaan-jaff	d26df210f6	add streaming_caching support	2023-08-28 19:17:53 -07:00
ishaan-jaff	8454e2d436	working write to cache with streaming	2023-08-28 18:46:26 -07:00
ishaan-jaff	84b1b525a9	openai streaming	2023-08-28 15:44:15 -07:00
Krrish Dholakia	ddd583efb1	bug fixes to logging	2023-08-28 15:36:59 -07:00
ishaan-jaff	69f9c40d80	add customstreapwrapper for openai streaming	2023-08-28 15:32:53 -07:00
Nir Gazit	06338b4aa2	feat: traceloop docs	2023-08-29 00:13:07 +02:00
Krrish Dholakia	0158e12701	bug fixes to client	2023-08-28 15:09:14 -07:00
Krrish Dholakia	a0f882d507	new logger client	2023-08-28 14:59:00 -07:00
ishaan-jaff	d0fe961e59	cache improvements	2023-08-28 14:44:42 -07:00
ishaan-jaff	c93f5e3def	working with embeddings	2023-08-28 14:07:51 -07:00
ishaan-jaff	6fa2e578d4	v0 of caching	2023-08-28 13:11:56 -07:00
Krrish Dholakia	3087c904eb	fixes to streaming for ai21, baseten, and openai text completions	2023-08-28 09:42:51 -07:00
ishaan-jaff	a69b7ffcfa	formatting improvements	2023-08-28 09:20:50 -07:00
Krrish Dholakia	c9957fff25	update get secret logic	2023-08-28 07:21:02 -07:00
ishaan-jaff	467009076b	fix caching	2023-08-26 21:05:35 -07:00
Krrish Dholakia	345a8888e9	further fixes to together ai streaming	2023-08-26 19:30:54 -07:00
Krrish Dholakia	320fe89a24	anthropic and together ai streaming no longer waits till completion to return response	2023-08-26 19:00:53 -07:00
Krrish Dholakia	4c754d29b0	fix anthropic and together ai streaming	2023-08-26 16:05:43 -07:00
ishaan-jaff	e171c9b3eb	with prompt layer test	2023-08-26 11:51:55 -07:00
Krrish Dholakia	d0eb126700	adding ability to turn off litedebugger but still use key manager	2023-08-26 11:03:40 -07:00
Krrish Dholakia	ef95e7adc7	use client opt-in	2023-08-26 10:38:39 -07:00
Krrish Dholakia	3b1086565a	allowing opt-in for litedebugger	2023-08-25 17:18:29 -07:00
Krrish Dholakia	a35deee5a1	updates to litedebugger logging	2023-08-25 16:21:01 -07:00
Krrish Dholakia	d5e8d8234a	updates to get model list	2023-08-24 19:06:44 -07:00
Krrish Dholakia	5aa3bd67ca	updates to logging	2023-08-24 18:58:12 -07:00