343 commits

Author	SHA1	Message	Date
Krrish Dholakia	711ec580c6	updates	2023-08-28 20:48:03 -07:00
ishaan-jaff	fbef73d043	add streaming_caching support	2023-08-28 19:17:53 -07:00
ishaan-jaff	8af6d967eb	working write to cache with streaming	2023-08-28 18:46:26 -07:00
ishaan-jaff	648330ce64	openai streaming	2023-08-28 15:44:15 -07:00
Krrish Dholakia	80fa61cc0e	bug fixes to logging	2023-08-28 15:36:59 -07:00
ishaan-jaff	f5257e6eff	test updates with streaming	2023-08-28 15:32:53 -07:00
ishaan-jaff	f84b7d5c0f	add customstreapwrapper for openai streaming	2023-08-28 15:32:53 -07:00
Krrish Dholakia	2462791f65	bug fixes to client	2023-08-28 15:09:14 -07:00
Krrish Dholakia	e8eb92c108	new logger client	2023-08-28 14:59:00 -07:00
ishaan-jaff	83aa304c34	fix caching	2023-08-28 14:53:41 -07:00
ishaan-jaff	1799f1bfe9	cache improvements	2023-08-28 14:44:42 -07:00
ishaan-jaff	43fea52d7c	fix import	2023-08-28 14:21:25 -07:00
ishaan-jaff	ecec028f38	fix redis import	2023-08-28 14:13:03 -07:00
ishaan-jaff	71ff0c69ab	working with embeddings	2023-08-28 14:07:51 -07:00
ishaan-jaff	53018e4b23	linting fix	2023-08-28 13:14:58 -07:00
ishaan-jaff	8b43917792	v0 of caching	2023-08-28 13:11:56 -07:00
Krrish Dholakia	d542066d4b	fixes to streaming for ai21, baseten, and openai text completions	2023-08-28 09:42:51 -07:00
ishaan-jaff	b713acb0a4	formatting improvements	2023-08-28 09:20:50 -07:00
ishaan-jaff	70b323e0f5	anthropic fixes	2023-08-28 09:17:29 -07:00
ishaan-jaff	65941644dc	anthropic py fixes	2023-08-28 09:15:29 -07:00
Ishaan Jaff	8c35ffe884	Merge branch 'main' into fix-streaming-anthropic-2	2023-08-28 09:05:51 -07:00
Ishaan Jaff	69beeba025	Merge branch 'main' into dev/openai_api_base	2023-08-28 08:41:46 -07:00
ishaan-jaff	fedd16361f	add text_completion	2023-08-28 08:20:20 -07:00
ishaan-jaff	dfdf47ddd0	add text completion format support	2023-08-28 08:04:06 -07:00
Ishaan Jaff	09598dfc70	Merge pull request #224 from galkleinman/main ... fix: context propagation on acompletion method	2023-08-28 07:36:48 -07:00
Krrish Dholakia	9497175a97	update get secret logic	2023-08-28 07:21:02 -07:00
Gal Kleinman	fe4184962c	fix: context propagation on acompletion method	2023-08-28 17:05:21 +03:00
Krrish Dholakia	841ac5ab20	adding support for openai api base	2023-08-28 06:53:27 -07:00
Erik Bjäreholt	ae52856a62	feat: added support for OPENAI_API_BASE	2023-08-28 14:57:34 +02:00
ishaan-jaff	d4fd0b2010	fix caching	2023-08-26 21:05:35 -07:00
Krrish Dholakia	60873abb41	further fixes to together ai streaming	2023-08-26 19:30:54 -07:00
Krrish Dholakia	bb3c2fefdb	anthropic and together ai streaming no longer waits till completion to return response	2023-08-26 19:00:53 -07:00
Krrish Dholakia	0ac17646d9	fix anthropic streaming	2023-08-26 18:54:51 -07:00
ishaan-jaff	4e8bfeb6f1	move caching	2023-08-26 16:16:58 -07:00
ishaan-jaff	77436cbcf4	add litellm caching	2023-08-26 16:08:48 -07:00
Krrish Dholakia	9155ba068f	fix anthropic and together ai streaming	2023-08-26 16:05:43 -07:00
ishaan-jaff	93e897da48	failing gpt cache test	2023-08-26 15:43:00 -07:00
ishaan-jaff	04281aaf2a	gpt_cache integration v0	2023-08-26 15:35:36 -07:00
ishaan-jaff	5a53909a0d	fix linting tests	2023-08-26 11:56:52 -07:00
ishaan-jaff	b2e72e52e4	with prompt layer test	2023-08-26 11:51:55 -07:00
ishaan-jaff	7d99e09a4a	add prompt layer integration	2023-08-26 11:28:20 -07:00
Krrish Dholakia	03d023e372	update testing for streaming to catch empty responses	2023-08-26 11:20:06 -07:00
Krrish Dholakia	9008973826	adding ability to turn off litedebugger but still use key manager	2023-08-26 11:03:40 -07:00
Krrish Dholakia	e223fbbb9e	update model alias map	2023-08-26 10:39:50 -07:00
Krrish Dholakia	ff7b4ffcf1	use client opt-in	2023-08-26 10:38:39 -07:00
Krrish Dholakia	1192640fb9	show litedebugger for streaming objects	2023-08-26 10:28:27 -07:00
Krrish Dholakia	fa53f7033b	allowing opt-in for litedebugger	2023-08-25 17:18:29 -07:00
Krrish Dholakia	198b95d7a0	update docs	2023-08-25 17:02:43 -07:00
Krrish Dholakia	c423db29f3	updates to litedebugger logging	2023-08-25 16:21:01 -07:00
Krrish Dholakia	acccf17e44	updates to get model list	2023-08-24 19:06:44 -07:00