77 commits

Author	SHA1	Message	Date
ishaan-jaff	126830f08a	allow users to set AWS_REGION_NAME	2023-09-04 11:57:22 -07:00
ishaan-jaff	e03d442e8f	add optional params for llama-2	2023-09-04 11:41:20 -07:00
ishaan-jaff	4a4ee51df3	working sagemaker support	2023-09-04 11:30:34 -07:00
ishaan-jaff	315cac619b	bump version	2023-09-02 22:01:49 -07:00
Krrish Dholakia	83b8af8567	adding support for aleph alpha	2023-09-02 13:15:41 -07:00
ishaan-jaff	beac62b8fe	litellm call id's in responses when client true	2023-08-31 10:09:10 -07:00
Krrish Dholakia	14d4c7ead2	update baseten handler to handle TGI calls	2023-08-30 19:14:48 -07:00
Krrish Dholakia	fcaf514546	updates	2023-08-30 16:05:42 -07:00
Krrish Dholakia	0ea59702fd	add huggingface	2023-08-30 16:05:33 -07:00
Krrish Dholakia	daa949a539	return logprobs for hf models	2023-08-30 15:16:26 -07:00
Krrish Dholakia	f3d8445ff1	updates	2023-08-30 09:55:45 -07:00
Krrish Dholakia	b90e5ed6db	adding testing to make sure litedebugger is opt-in only	2023-08-30 09:55:33 -07:00
ishaan-jaff	38828ae705	remove flaky petals test	2023-08-29 21:20:57 -07:00
Krrish Dholakia	506dd9eaaa	commenting out flaky openrouter tests.	2023-08-29 18:46:47 -07:00
Krrish Dholakia	697092edf5	updates	2023-08-29 18:23:34 -07:00
Krrish Dholakia	4435a231f1	clean up tests	2023-08-29 16:50:31 -07:00
Krrish Dholakia	5bcf612724	adding coverage for openrouter in exception mapping	2023-08-29 15:30:24 -07:00
ishaan-jaff	b2e860cc82	test fixes	2023-08-28 22:33:09 -07:00
Krrish Dholakia	711ec580c6	updates	2023-08-28 20:48:03 -07:00
ishaan-jaff	b713acb0a4	formatting improvements	2023-08-28 09:20:50 -07:00
ishaan-jaff	fedd16361f	add text_completion	2023-08-28 08:20:20 -07:00
ishaan-jaff	dfdf47ddd0	add text completion format support	2023-08-28 08:04:06 -07:00
Krrish Dholakia	efbb476020	enable litedebugger opt-out	2023-08-24 10:19:10 -07:00
ishaan-jaff	f3334a9634	linting fixes	2023-08-22 15:17:38 -07:00
ishaan-jaff	72414919dd	test fallbacks	2023-08-22 15:07:07 -07:00
ishaan-jaff	ccf875f84b	formatting fixes	2023-08-22 15:07:07 -07:00
Krrish Dholakia	7f3b90db3c	fixing azure bug	2023-08-21 14:05:25 -07:00
Krrish Dholakia	6cee3b22ab	allow custom provider via model name	2023-08-19 16:35:04 -07:00
ishaan-jaff	abfc286c20	add logit bias	2023-08-19 16:29:14 -07:00
ishaan-jaff	15b1da9dc8	add linting	2023-08-18 11:05:05 -07:00
yujong-lee	701ff22b56	better testing	2023-08-18 17:41:31 +09:00
ishaan-jaff	7abde6f008	fix Open router	2023-08-17 18:19:50 -07:00
ishaan-jaff	2ea36c49e3	fix tg computer	2023-08-17 18:01:12 -07:00
ishaan-jaff	ba6df5fbb9	updates TG_AI	2023-08-17 16:06:32 -07:00
ishaan-jaff	d394c77623	use Model response types	2023-08-17 13:10:22 -07:00
ishaan-jaff	32a3b98c0a	hot fix litellm import	2023-08-17 11:39:28 -07:00
ishaan-jaff	6e540fee7f	create model response object	2023-08-17 11:13:01 -07:00
ishaan-jaff	35fd82fd3f	fix text-003 bug	2023-08-17 10:48:23 -07:00
ishaan-jaff	fbbb285037	fix tg ai	2023-08-17 09:57:21 -07:00
ishaan-jaff	9262f0857a	fixed tg ai test	2023-08-17 08:17:13 -07:00
ishaan-jaff	afc26df28f	fix tg ai streaming	2023-08-16 21:53:39 -07:00
Krrish Dholakia	acbb611e89	adding exact match caching	2023-08-16 21:44:52 -07:00
Krrish Dholakia	d6fb6ea897	updates to testing	2023-08-16 09:33:12 -07:00
ishaan-jaff	93a0316ab7	working petals implementation	2023-08-15 14:02:29 -07:00
ishaan-jaff	f336dafd04	fix import baseten + petals test	2023-08-15 13:57:13 -07:00
ishaan-jaff	3e09743173	baseten cannot read api keys from .env well	2023-08-15 13:41:23 -07:00
ishaan-jaff	4a91424ed4	fix failing tests	2023-08-15 13:02:01 -07:00
ishaan-jaff	b18b12afb1	fix failing hf test	2023-08-15 12:39:48 -07:00
ishaan-jaff	02a666ee02	add baseten support	2023-08-15 12:15:41 -07:00
ishaan-jaff	e354b71df0	fix request_timeout_extra arg	2023-08-14 19:57:11 -07:00