1424 commits

Author	SHA1	Message	Date
ishaan-jaff	489a31adb7	use importlib_metadata	2023-08-17 11:18:43 -07:00
ishaan-jaff	a2ea39818d	test_proxy_stream	2023-08-17 07:54:56 -07:00
ishaan-jaff	33f31eb38a	bump v litellm	2023-08-16 21:56:31 -07:00
Krrish Dholakia	54f2350773	return failed response status for batch testing	2023-08-16 12:42:16 -07:00
Krrish Dholakia	f263e223b8	update model load testing	2023-08-16 12:28:47 -07:00
Krrish Dholakia	c58c52db04	fixes to batch testing	2023-08-16 11:46:53 -07:00
Krrish Dholakia	fd6367ca25	adding additional ways of doing testing	2023-08-16 11:19:05 -07:00
Krrish Dholakia	77e4acc7fa	add testing module	2023-08-16 09:03:33 -07:00
ishaan-jaff	a5aa6228e4	bump toml v	2023-08-15 14:22:04 -07:00
ishaan-jaff	93a0316ab7	working petals implementation	2023-08-15 14:02:29 -07:00
ishaan-jaff	3e09743173	baseten cannot read api keys from .env well	2023-08-15 13:41:23 -07:00
ishaan-jaff	4a91424ed4	fix failing tests	2023-08-15 13:02:01 -07:00
ishaan-jaff	b18b12afb1	fix failing hf test	2023-08-15 12:39:48 -07:00
ishaan-jaff	02a666ee02	add baseten support	2023-08-15 12:15:41 -07:00
ishaan-jaff	9edece7d61	bump v	2023-08-15 11:02:18 -07:00
ishaan-jaff	8075e96d92	with petals	2023-08-15 10:42:00 -07:00
ishaan-jaff	e354b71df0	fix request_timeout_extra arg	2023-08-14 19:57:11 -07:00
ishaan-jaff	952e994ad1	fixed get_secret	2023-08-14 17:34:28 -07:00
ishaan-jaff	f5b6c04de4	allow setting litellm.api_key	2023-08-14 17:17:20 -07:00
ishaan-jaff	b5875cc4bd	bump v	2023-08-14 11:41:39 -07:00
ishaan-jaff	828f4e7bf8	new v bump	2023-08-14 10:57:14 -07:00
Krrish Dholakia	15944eb0f3	error handling for huggingface endpoints	2023-08-14 10:21:59 -07:00
Krrish Dholakia	9d607eb5ba	bumping version	2023-08-12 20:04:23 -07:00
ishaan-jaff	406290b9e4	fix yield + version number	2023-08-12 15:05:11 -07:00
ishaan-jaff	fcecb30d29	bump v for ollama	2023-08-12 14:54:28 -07:00
Krrish Dholakia	80d77fed71	coverage for custom api scenario in load testing	2023-08-11 18:20:24 -07:00
Krrish Dholakia	211e1edfcb	add model load testing functionality	2023-08-11 17:59:51 -07:00
Krrish Dholakia	fb285c8c9f	update	2023-08-11 09:51:14 -07:00
Krrish Dholakia	a84af42dca	update version	2023-08-10 19:20:28 -07:00
Krrish Dholakia	13a5a8f10e	allowing dynamic api base to be set for openai	2023-08-10 18:40:35 -07:00
ishaan-jaff	70d7a5e348	new v	2023-08-10 18:38:00 -07:00
Krrish Dholakia	24e51ec75c	allow custom base to openai	2023-08-10 18:01:52 -07:00
Krrish Dholakia	695d777ee5	logging improvements	2023-08-10 17:40:17 -07:00
ishaan-jaff	a1b64832a7	with caching	2023-08-10 15:14:58 -07:00
Krrish Dholakia	09fcd88799	updating crash monitoring	2023-08-10 11:13:30 -07:00
Krrish Dholakia	0fc4d9e29c	clean up print statements	2023-08-09 19:49:27 -07:00
ishaan-jaff	6aec2884af	new pypi version	2023-08-09 17:59:10 -07:00
Krrish Dholakia	8da3d382ff	bumping version	2023-08-09 14:24:02 -07:00
ishaan-jaff	cf5c3c61db	fix	2023-08-09 14:08:13 -07:00
ishaan-jaff	3a6b72ad2f	with fixed streaming	2023-08-09 13:56:42 -07:00
Krrish Dholakia	a9186dc40c	add token usage	2023-08-08 21:11:06 -07:00
Krrish Dholakia	39efc57d84	add helper functions for token usage calculation	2023-08-08 20:47:02 -07:00
ishaan-jaff	ef99c616af	bump package version	2023-08-08 17:54:29 -07:00
ishaan-jaff	c55adebcfd	with cohere streaming	2023-08-08 17:02:34 -07:00
ishaan-jaff	5bff56c7dc	anthropic streaming	2023-08-08 16:10:52 -07:00
ishaan-jaff	644ea8822c	fix model response	2023-08-08 13:58:58 -07:00
ishaan-jaff	4b9bae1ac3	new version toml	2023-08-08 13:45:50 -07:00
ishaan-jaff	1223fed6ba	new version toml	2023-08-08 11:35:20 -07:00
ishaan-jaff	294a896422	remove pytest as a package dep	2023-08-08 11:34:43 -07:00
ishaan-jaff	3edcf8c7d8	remove deps datalib, pytest, tenacity, infisical	2023-08-08 10:58:43 -07:00