13483 commits

Author	SHA1	Message	Date
ishaan-jaff	ca72ebd2df	store llm costs in budget manager	2023-09-09 19:11:35 -07:00
ishaan-jaff	ff0e5c2967	make succes_callback in Callable	2023-09-09 19:05:19 -07:00
ishaan-jaff	eaaede608e	custom_logger for litellm - callback_func	2023-09-09 18:41:41 -07:00
ishaan-jaff	7dc694c704	try/except completion_cost + custom logger func	2023-09-09 18:36:22 -07:00
Krrish Dholakia	511793f8ac	fix circle ci testing	2023-09-09 16:36:45 -07:00
Krrish Dholakia	beecb60f51	update testing	2023-09-09 16:35:38 -07:00
Krrish Dholakia	8ed85b0523	rename apimanager to budget manager	2023-09-09 16:10:41 -07:00
Krrish Dholakia	a39756bfda	add api manager	2023-09-09 15:55:38 -07:00
ishaan-jaff	5ab3ca2018	tests	2023-09-09 15:47:38 -07:00
ishaan-jaff	bc1ad908c0	add support for calling openai proxy using lite	2023-09-09 15:47:29 -07:00
ishaan-jaff	56bd8c1c52	olla upgrades, fix streaming, add non streaming resp	2023-09-09 14:07:13 -07:00
Krrish Dholakia	6cb03d7c63	modification to arg checking	2023-09-09 13:17:51 -07:00
Krrish Dholakia	0609fd43d7	gorilla endpoint is flaky, commenting out for now	2023-09-09 12:48:11 -07:00
Krrish Dholakia	263704e942	fix exception	2023-09-09 11:24:10 -07:00
Krrish Dholakia	a9cab12a47	improve error message returned if model not passed in	2023-09-09 11:18:10 -07:00
ishaan-jaff	5ca8b23e22	bump version	2023-09-08 21:37:38 -07:00
ishaan-jaff	26773a5d14	safe get_or_generate_uuid	2023-09-08 21:34:09 -07:00
ishaan-jaff	ba70ad766d	fix redis caching test	2023-09-08 20:58:44 -07:00
Krrish Dholakia	679a4f318d	add check_valid_key helper function	2023-09-08 20:36:39 -07:00
Krrish Dholakia	c556a51139	fix test exceptions	2023-09-08 20:27:44 -07:00
ishaan-jaff	9f7d397014	add cache params	2023-09-08 20:18:12 -07:00
ishaan-jaff	8180ba273b	updating caching tests	2023-09-08 20:15:15 -07:00
Krrish Dholakia	59d6703b0c	bump version	2023-09-08 19:26:41 -07:00
Krrish Dholakia	d02ab9bfcd	update exception logic	2023-09-08 18:55:11 -07:00
Krrish Dholakia	93fb247b1d	fix exception mapping	2023-09-08 18:45:18 -07:00
Krrish Dholakia	323e095688	fix exception mapping error	2023-09-08 18:20:07 -07:00
ishaan-jaff	0ab62f13e8	caching updates	2023-09-08 18:06:47 -07:00
Krrish Dholakia	47c1f57a24	expose validate environment function	2023-09-08 17:53:04 -07:00
ishaan-jaff	4de44a691f	bump v	2023-09-08 17:47:03 -07:00
ishaan-jaff	7158ea3ab8	bump version to 0.1.564	2023-09-08 17:46:30 -07:00
ishaan-jaff	c5ae0147d0	better exception raising for package not imported	2023-09-08 17:42:01 -07:00
ishaan-jaff	a9cb373d04	fix exception handling	2023-09-08 15:42:27 -07:00
ishaan-jaff	599be6a374	raise vllm error	2023-09-08 15:27:01 -07:00
ishaan-jaff	1c9169e563	raise cohere, vertex, tenacity import errors	2023-09-08 15:26:09 -07:00
ishaan-jaff	0cc561bc5d	fix supported LLM on docs	2023-09-08 15:07:14 -07:00
ishaan-jaff	632d928bfb	comments about using hosted vllm	2023-09-08 14:06:52 -07:00
ishaan-jaff	c45e2ed48c	hosted vllm usage	2023-09-08 13:58:06 -07:00
ishaan-jaff	c05606b587	custom base with openai completion	2023-09-08 13:21:43 -07:00
Krrish Dholakia	8acf959430	bump version	2023-09-08 13:12:27 -07:00
ishaan-jaff	b0a2e57a8a	fix:completion fails when client=True&no email set	2023-09-08 12:36:33 -07:00
Krrish Dholakia	554b05015e	fix litedebugger double logging error	2023-09-07 18:02:24 -07:00
Krrish Dholakia	147a877aca	bump version	2023-09-07 17:00:20 -07:00
Krrish Dholakia	81ac07644d	bump version	2023-09-07 16:24:05 -07:00
Krrish Dholakia	e452ceb21e	fix litellm client	2023-09-07 16:22:00 -07:00
ishaan-jaff	8f5e2d0013	bug fix - issue 277	2023-09-07 14:11:10 -07:00
ishaan-jaff	3e5c972e91	bump version litellm	2023-09-07 14:03:37 -07:00
Ishaan Jaff	19b78c3f6f	Merge pull request #294 from shauryr/patch-1 ... added import aiohttp	2023-09-07 13:58:34 -07:00
ishaan-jaff	301eb36095	cleanup async func test	2023-09-07 13:56:46 -07:00
ishaan-jaff	a611409e0f	async streaming generator	2023-09-07 13:53:40 -07:00
Krrish Dholakia	c7e34bce5f	update get model list	2023-09-07 13:15:50 -07:00