597 commits

Author	SHA1	Message	Date
Krrish Dholakia	53b10e4372	allow updating budget manager cost by passing in text	2023-09-13 15:12:47 -07:00
Krrish Dholakia	5b6b9a9fab	huggingface conversational task support	2023-09-13 13:45:23 -07:00
ishaan-jaff	1913d36e05	fix promptlayer logging	2023-09-13 13:22:43 -07:00
Krrish Dholakia	b1fbe515fe	return model name as part of streaming object	2023-09-13 09:48:49 -07:00
Krrish Dholakia	041817124f	fix testing	2023-09-12 22:03:51 -07:00
Krrish Dholakia	2a555eddfa	update budget manager docs	2023-09-12 20:25:59 -07:00
Krrish Dholakia	27f1051792	fix testing for budget manager	2023-09-12 16:11:51 -07:00
Krrish Dholakia	e1c91903da	add reset budget on duration end to budget manager	2023-09-12 13:01:55 -07:00
Krrish Dholakia	e80457013b	doc cleanup for custom prompt templates	2023-09-12 12:16:47 -07:00
ishaan-jaff	e6d48d91ce	bump version + check_valid_key	2023-09-12 11:56:04 -07:00
ishaan-jaff	e3fa1d686e	remove verify_access_key from main	2023-09-12 11:50:30 -07:00
ishaan-jaff	33f0da2d69	update testing key	2023-09-12 11:50:30 -07:00
ishaan-jaff	8b60440b4b	update check_valid_key	2023-09-12 11:50:30 -07:00
Krrish Dholakia	05f2f3dde7	fix get llm provider	2023-09-12 11:48:44 -07:00
ishaan-jaff	ff36b9c6da	add test_valid_key to utils	2023-09-12 11:45:55 -07:00
Ishaan Jaff	60e3e42fba	Merge branch 'main' into main	2023-09-12 11:43:03 -07:00
Krrish Dholakia	c5df95c560	fix linting error	2023-09-12 11:38:00 -07:00
ishaan-jaff	4d253f45d8	fix linting error	2023-09-12 11:36:20 -07:00
ishaan-jaff	a48cb49820	add test for test_get_valid_models	2023-09-12 11:29:18 -07:00
ishaan-jaff	57f15b379d	add valid models in utils.py	2023-09-12 11:29:18 -07:00
Krrish Dholakia	baa69734b0	raise better exception if llm provider isn't passed in or inferred	2023-09-12 11:28:50 -07:00
ishaan-jaff	0ffcf51445	fix azure logging	2023-09-12 10:35:47 -07:00
ishaan-jaff	0f89636b47	use api_version for azure completion call	2023-09-12 10:35:24 -07:00
William Espegren	b26933301d	renamed and added test_good_key()	2023-09-12 19:02:55 +02:00
William Espegren	1b51016680	Raise exception if bad key is not detected	2023-09-12 18:51:50 +02:00
William Espegren	261db15bcf	util: verify_access_key ... Verify that the user provided a valid openai token by creating a request to the openAI endpoint.	2023-09-12 18:48:23 +02:00
ishaan-jaff	dda87a55ff	rename safe_messages to trim_messages	2023-09-11 18:54:18 -07:00
Krrish Dholakia	8d517f84c9	completion test cleanup	2023-09-11 18:39:16 -07:00
Krrish Dholakia	bab36c2c6f	work for hf inference endpoint	2023-09-11 18:37:55 -07:00
Krrish Dholakia	f946f61b4c	improvements to exception mapping	2023-09-11 18:33:57 -07:00
ishaan-jaff	d70cff8713	fix linting	2023-09-11 18:11:06 -07:00
ishaan-jaff	be5a92c40a	add safe_message trimmer	2023-09-11 17:58:37 -07:00
ishaan-jaff	bcb89dcf4a	add test cases for token trimmer	2023-09-11 17:58:37 -07:00
Ishaan Jaff	fdddd00bfd	Merge pull request #330 from Taik/main ... Add support for overriding API type for Azure calls	2023-09-11 17:04:25 -07:00
Krrish Dholakia	9d1a28c7ed	update mock_completion docs	2023-09-11 16:35:25 -07:00
Krrish Dholakia	cc1313492b	code cleanup	2023-09-11 16:32:17 -07:00
Krrish Dholakia	cbc7e6dbc2	mock responses for streaming	2023-09-11 16:30:29 -07:00
Thinh Nguyen	8801f71a52	Add support for overriding API type for Azure calls	2023-09-11 16:28:00 -07:00
Krrish Dholakia	5f496f7d2a	save budget manager data threaded	2023-09-11 15:53:34 -07:00
Krrish Dholakia	34c6f3a25b	updates to budget manager naming schema	2023-09-11 15:22:52 -07:00
Krrish Dholakia	ee07cb9657	adding budget manager to docs	2023-09-11 14:51:01 -07:00
Krrish Dholakia	817798c692	return user list from budget manager	2023-09-11 14:15:00 -07:00
Krrish Dholakia	32fff1e462	fix linting issues	2023-09-11 13:54:03 -07:00
Krrish Dholakia	9f504a4ff5	update budget manager with hosted client	2023-09-11 13:46:27 -07:00
Krrish Dholakia	6da500c6e0	add mock request to docs	2023-09-11 12:19:13 -07:00
Krrish Dholakia	d4806cd686	updating budget manager	2023-09-11 10:58:09 -07:00
ishaan-jaff	578ad50547	update test_caching to use mock redis	2023-09-11 10:36:17 -07:00
ishaan-jaff	7ee86453dc	bump version	2023-09-11 08:47:37 -07:00
Krrish Dholakia	08132975f4	update test_batch_completions	2023-09-11 08:44:23 -07:00
ishaan-jaff	7a7e39587a	cache pip deps	2023-09-11 08:27:09 -07:00