573 commits

Author	SHA1	Message	Date
William Espegren	1b51016680	Raise exception if bad key is not detected	2023-09-12 18:51:50 +02:00
William Espegren	261db15bcf	util: verify_access_key ... Verify that the user provided a valid openai token by creating a request to the openAI endpoint.	2023-09-12 18:48:23 +02:00
ishaan-jaff	dda87a55ff	rename safe_messages to trim_messages	2023-09-11 18:54:18 -07:00
Krrish Dholakia	8d517f84c9	completion test cleanup	2023-09-11 18:39:16 -07:00
Krrish Dholakia	bab36c2c6f	work for hf inference endpoint	2023-09-11 18:37:55 -07:00
Krrish Dholakia	f946f61b4c	improvements to exception mapping	2023-09-11 18:33:57 -07:00
ishaan-jaff	d70cff8713	fix linting	2023-09-11 18:11:06 -07:00
ishaan-jaff	be5a92c40a	add safe_message trimmer	2023-09-11 17:58:37 -07:00
ishaan-jaff	bcb89dcf4a	add test cases for token trimmer	2023-09-11 17:58:37 -07:00
Ishaan Jaff	fdddd00bfd	Merge pull request #330 from Taik/main ... Add support for overriding API type for Azure calls	2023-09-11 17:04:25 -07:00
Krrish Dholakia	9d1a28c7ed	update mock_completion docs	2023-09-11 16:35:25 -07:00
Krrish Dholakia	cc1313492b	code cleanup	2023-09-11 16:32:17 -07:00
Krrish Dholakia	cbc7e6dbc2	mock responses for streaming	2023-09-11 16:30:29 -07:00
Thinh Nguyen	8801f71a52	Add support for overriding API type for Azure calls	2023-09-11 16:28:00 -07:00
Krrish Dholakia	5f496f7d2a	save budget manager data threaded	2023-09-11 15:53:34 -07:00
Krrish Dholakia	34c6f3a25b	updates to budget manager naming schema	2023-09-11 15:22:52 -07:00
Krrish Dholakia	ee07cb9657	adding budget manager to docs	2023-09-11 14:51:01 -07:00
Krrish Dholakia	817798c692	return user list from budget manager	2023-09-11 14:15:00 -07:00
Krrish Dholakia	32fff1e462	fix linting issues	2023-09-11 13:54:03 -07:00
Krrish Dholakia	9f504a4ff5	update budget manager with hosted client	2023-09-11 13:46:27 -07:00
Krrish Dholakia	6da500c6e0	add mock request to docs	2023-09-11 12:19:13 -07:00
Krrish Dholakia	d4806cd686	updating budget manager	2023-09-11 10:58:09 -07:00
ishaan-jaff	578ad50547	update test_caching to use mock redis	2023-09-11 10:36:17 -07:00
ishaan-jaff	7ee86453dc	bump version	2023-09-11 08:47:37 -07:00
Krrish Dholakia	08132975f4	update test_batch_completions	2023-09-11 08:44:23 -07:00
ishaan-jaff	7a7e39587a	cache pip deps	2023-09-11 08:27:09 -07:00
ishaan-jaff	19d26b944e	parallelism tests	2023-09-11 08:21:07 -07:00
ishaan-jaff	e37c2f19f4	fix linting	2023-09-11 08:19:38 -07:00
ishaan-jaff	60729a9f6f	fix circle ci test	2023-09-11 08:14:04 -07:00
Krrish Dholakia	a99080fe0d	update url	2023-09-11 08:07:46 -07:00
ishaan-jaff	1909444285	fix redis cache testing and add new test for azure	2023-09-11 08:01:02 -07:00
ishaan-jaff	edde9ad15b	test for litellm.api_key	2023-09-11 07:55:01 -07:00
ishaan-jaff	1ef80c9a2a	begin using litellm.api_key	2023-09-11 07:32:20 -07:00
ishaan-jaff	755c19aa0c	try/catch for model_cost_map	2023-09-10 16:04:25 -07:00
Krrish Dholakia	fb8f2bac37	don't fail pytest due to timeout error in batch completions	2023-09-10 08:46:27 -07:00
Krrish Dholakia	c12ceb69ae	update test	2023-09-09 22:19:34 -07:00
Krrish Dholakia	274640b3ef	fix linting issues	2023-09-09 20:23:18 -07:00
Krrish Dholakia	b1ec504421	update budget manager	2023-09-09 20:06:09 -07:00
ishaan-jaff	4fde7d655b	bump litellm v + default finish_reason to None	2023-09-09 19:44:05 -07:00
ishaan-jaff	0f769c5417	add finish reason to streamed responses	2023-09-09 19:36:38 -07:00
ishaan-jaff	ca72ebd2df	store llm costs in budget manager	2023-09-09 19:11:35 -07:00
ishaan-jaff	ff0e5c2967	make succes_callback in Callable	2023-09-09 19:05:19 -07:00
ishaan-jaff	eaaede608e	custom_logger for litellm - callback_func	2023-09-09 18:41:41 -07:00
ishaan-jaff	7dc694c704	try/except completion_cost + custom logger func	2023-09-09 18:36:22 -07:00
Krrish Dholakia	511793f8ac	fix circle ci testing	2023-09-09 16:36:45 -07:00
Krrish Dholakia	beecb60f51	update testing	2023-09-09 16:35:38 -07:00
Krrish Dholakia	8ed85b0523	rename apimanager to budget manager	2023-09-09 16:10:41 -07:00
Krrish Dholakia	a39756bfda	add api manager	2023-09-09 15:55:38 -07:00
ishaan-jaff	5ab3ca2018	tests	2023-09-09 15:47:38 -07:00
ishaan-jaff	bc1ad908c0	add support for calling openai proxy using lite	2023-09-09 15:47:29 -07:00