3262 commits

Author	SHA1	Message	Date
Krrish Dholakia	bb3c2fefdb	anthropic and together ai streaming no longer waits till completion to return response	2023-08-26 19:00:53 -07:00
Krrish Dholakia	0ac17646d9	fix anthropic streaming	2023-08-26 18:54:51 -07:00
ishaan-jaff	4e8bfeb6f1	move caching	2023-08-26 16:16:58 -07:00
ishaan-jaff	77436cbcf4	add litellm caching	2023-08-26 16:08:48 -07:00
Krrish Dholakia	9155ba068f	fix anthropic and together ai streaming	2023-08-26 16:05:43 -07:00
ishaan-jaff	93e897da48	failing gpt cache test	2023-08-26 15:43:00 -07:00
ishaan-jaff	04281aaf2a	gpt_cache integration v0	2023-08-26 15:35:36 -07:00
ishaan-jaff	5a53909a0d	fix linting tests	2023-08-26 11:56:52 -07:00
ishaan-jaff	b2e72e52e4	with prompt layer test	2023-08-26 11:51:55 -07:00
ishaan-jaff	7d99e09a4a	add prompt layer integration	2023-08-26 11:28:20 -07:00
Krrish Dholakia	03d023e372	update testing for streaming to catch empty responses	2023-08-26 11:20:06 -07:00
Krrish Dholakia	9008973826	adding ability to turn off litedebugger but still use key manager	2023-08-26 11:03:40 -07:00
Krrish Dholakia	e223fbbb9e	update model alias map	2023-08-26 10:39:50 -07:00
Krrish Dholakia	ff7b4ffcf1	use client opt-in	2023-08-26 10:38:39 -07:00
Krrish Dholakia	1192640fb9	show litedebugger for streaming objects	2023-08-26 10:28:27 -07:00
Krrish Dholakia	fa53f7033b	allowing opt-in for litedebugger	2023-08-25 17:18:29 -07:00
Krrish Dholakia	198b95d7a0	update docs	2023-08-25 17:02:43 -07:00
Krrish Dholakia	c423db29f3	updates to litedebugger logging	2023-08-25 16:21:01 -07:00
Krrish Dholakia	acccf17e44	updates to get model list	2023-08-24 19:06:44 -07:00
Krrish Dholakia	7d16df98ac	updates to logging	2023-08-24 18:58:12 -07:00
ishaan-jaff	0d24bf9221	fix get all keys problem	2023-08-24 18:54:26 -07:00
Krrish Dholakia	c23bf54e27	adding coverage for additional baseten output formats	2023-08-24 18:20:43 -07:00
ishaan-jaff	dc1575d790	after loading model list init env variables	2023-08-24 18:16:38 -07:00
ishaan-jaff	9f93793351	accept tg ai api keys - tg_ai_api_key	2023-08-24 18:11:54 -07:00
Krrish Dholakia	6e30b234ac	move baseten to a REST endpoint call	2023-08-24 14:43:49 -07:00
ishaan-jaff	01a399f8b5	fix opt-out of litellm client	2023-08-24 12:42:07 -07:00
Krrish Dholakia	efbb476020	enable litedebugger opt-out	2023-08-24 10:19:10 -07:00
Krrish Dholakia	c4e869a15e	fixing mypy linting errors	2023-08-24 08:26:01 -07:00
Krrish Dholakia	67d6527217	accept model alias	2023-08-24 08:20:21 -07:00
ishaan-jaff	6047b84423	add litellm dashboard	2023-08-23 21:22:33 -07:00
ishaan-jaff	76bf07b347	with litellm.token	2023-08-23 21:00:06 -07:00
ishaan-jaff	aaf63f64c3	fix provider list bug	2023-08-23 16:31:30 -07:00
ishaan-jaff	562a991b0c	format fix	2023-08-23 15:42:13 -07:00
ishaan-jaff	79de8bb12e	use prod logger not local	2023-08-23 15:10:53 -07:00
ishaan-jaff	a36593dfbd	bump model list fix	2023-08-23 14:50:51 -07:00
ishaan-jaff	21eb00278d	undo provider list formatting	2023-08-23 14:26:11 -07:00
ishaan-jaff	e9f284c65c	improve formatiing of providers	2023-08-23 14:12:00 -07:00
Krrish Dholakia	c8d2a5ed5e	adding support for completion with retries	2023-08-23 14:09:08 -07:00
ishaan-jaff	9d1c6eec3d	always fetch latest models	2023-08-23 11:55:03 -07:00
Krrish Dholakia	d183dc8269	updates to litedebugger dashboard	2023-08-23 11:51:16 -07:00
Krrish Dholakia	84754da801	log embedding success/failure as well	2023-08-23 10:38:46 -07:00
Krrish Dholakia	14ab99c3c4	adding support for finetuned completion models	2023-08-23 10:02:16 -07:00
Vince Lwt	dcbf5e2444	Merge branch 'main' into main	2023-08-23 18:39:09 +02:00
ishaan-jaff	5ea256baae	add krrish changes	2023-08-23 08:40:37 -07:00
adriensas	1f3aeeb6d4	fix linting	2023-08-23 11:07:45 +02:00
adriensas	a0cb56efd5	fix	2023-08-23 10:59:36 +02:00
Krrish Dholakia	b47cb95b90	get keys if auth error	2023-08-22 18:01:49 -07:00
ishaan-jaff	b1ff03d947	remove v import in init	2023-08-22 16:34:50 -07:00
ishaan-jaff	3e79d1523f	make version check try except	2023-08-22 16:31:00 -07:00
Krrish Dholakia	1689cf14c6	fixing linting issues	2023-08-22 16:18:11 -07:00