102 commits

Author	SHA1	Message	Date
Krrish Dholakia	57efebb1c4	fix replicate edge case for custom provider in model name	2023-08-19 16:46:15 -07:00
Krrish Dholakia	5e53c9664c	allow custom provider via model name	2023-08-19 16:35:04 -07:00
Krrish Dholakia	8b7a0425d8	update exception mapping	2023-08-18 14:37:09 -07:00
ishaan-jaff	b283005e7b	all fixes to linting	2023-08-18 11:56:44 -07:00
ishaan-jaff	441f69d63a	linting type fixes	2023-08-18 11:36:06 -07:00
ishaan-jaff	2c7ffb7c75	add linting	2023-08-18 11:05:05 -07:00
Krish Dholakia	c9aee67210	Merge pull request #144 from yujonglee/fix-modelresponse-typing ... Fix ModelResponse typing	2023-08-18 04:46:42 -07:00
Krrish Dholakia	c20ba023c2	clean up print statements	2023-08-17 20:07:03 -07:00
Krrish Dholakia	669199a51b	bug fix	2023-08-17 19:56:37 -07:00
yujong-lee	47cb945ad6	Fix typing	2023-08-18 10:30:47 +09:00
ishaan-jaff	7630cc5bdb	fix Open router	2023-08-17 18:19:50 -07:00
ishaan-jaff	11ea802759	with verbose secretmanager	2023-08-17 17:36:08 -07:00
ishaan-jaff	78b5fd7a42	updates TG_AI	2023-08-17 16:06:32 -07:00
ishaan-jaff	e3ef8af694	add support for keys	2023-08-17 15:30:40 -07:00
ishaan-jaff	99f5db769b	refactor setting keys	2023-08-17 15:14:25 -07:00
ishaan-jaff	46e24c3f82	test ci/cd	2023-08-17 13:35:29 -07:00
ishaan-jaff	5b3a9cb59a	use Model response types	2023-08-17 13:10:22 -07:00
ishaan-jaff	224ccad8f9	create model response object	2023-08-17 11:13:01 -07:00
ishaan-jaff	b5f8d0f60d	fix tg ai stream check	2023-08-17 10:49:48 -07:00
ishaan-jaff	a13d15755b	fix text-003 bug	2023-08-17 10:48:23 -07:00
ishaan-jaff	9a31de520a	fix tg ai streaming	2023-08-16 21:53:39 -07:00
ishaan-jaff	66492ecab7	working petals implementation	2023-08-15 14:02:29 -07:00
ishaan-jaff	1140010413	fix import baseten + petals test	2023-08-15 13:57:13 -07:00
ishaan-jaff	9ce2a42d0c	add baseten support	2023-08-15 12:15:41 -07:00
ishaan-jaff	b2a02e99ce	with petals	2023-08-15 10:42:00 -07:00
ishaan-jaff	33fbf3d701	fix request_timeout_extra arg	2023-08-14 19:57:11 -07:00
ishaan-jaff	a3adcde8cc	ai21 models	2023-08-14 16:41:50 -07:00
Krrish Dholakia	e642483eaf	adding support for meta-llama-2	2023-08-14 14:35:21 -07:00
ishaan-jaff	27c9cd0256	check if json has error	2023-08-14 11:41:12 -07:00
ishaan-jaff	6f1749ac9e	with text-bison	2023-08-14 10:34:01 -07:00
Krrish Dholakia	fb07d6b389	error handling for huggingface endpoints	2023-08-14 10:21:59 -07:00
Krish Dholakia	e90aed6def	Merge branch 'main' into multi-class-krrish	2023-08-12 17:47:37 -07:00
Krrish Dholakia	eb89d92e5b	adding azure flag back - prevent regressions	2023-08-12 17:41:25 -07:00
Krrish Dholakia	1c909707ad	added exception mapping to anthropic class	2023-08-12 17:39:11 -07:00
Krrish Dholakia	b96f7aff07	code cleanup	2023-08-12 17:12:57 -07:00
Krrish Dholakia	209d1e4e1e	replacing individual provider flags with 'custom_llm_provider'	2023-08-12 16:40:36 -07:00
Krrish Dholakia	411ba6a827	adding anthropic llm class - handles sync + stream	2023-08-12 16:34:32 -07:00
ishaan-jaff	be44a9b6b6	ollama with streaming	2023-08-12 14:49:50 -07:00
Krrish Dholakia	8052b86de8	coverage for custom api scenario in load testing	2023-08-11 18:20:24 -07:00
Krrish Dholakia	386536ce88	add model load testing functionality	2023-08-11 17:59:51 -07:00
ishaan-jaff	ad56d3d032	add config	2023-08-11 10:18:13 -07:00
Krrish Dholakia	0dc9c2a4c3	update	2023-08-11 09:51:14 -07:00
Krrish Dholakia	7fac7111f8	update version	2023-08-10 19:20:28 -07:00
Krrish Dholakia	7908e43645	allowing dynamic api base to be set for openai	2023-08-10 18:40:35 -07:00
ishaan-jaff	6224589611	add vertex AI	2023-08-10 18:37:25 -07:00
Krrish Dholakia	c2ecdf657f	allow custom base to openai	2023-08-10 18:01:52 -07:00
Krrish Dholakia	91170fddcf	code cleanup	2023-08-10 17:57:57 -07:00
Krrish Dholakia	6594bd8477	logging improvements	2023-08-10 17:40:17 -07:00
ishaan-jaff	8f38f61b76	add caching with chromDB - not a dependency	2023-08-10 13:21:06 -07:00
ishaan-jaff	ea34a26a65	add streaming for together-ai	2023-08-09 17:58:54 -07:00