96 commits

Author	SHA1	Message	Date
Krrish Dholakia	35cf6ef0a1	batch completions for vllm now works too	2023-09-06 19:26:19 -07:00
Krrish Dholakia	4cfcabd919	adding support for vllm	2023-09-06 18:07:44 -07:00
Krrish Dholakia	4bcfa71e11	commenting out flaky circle ci test	2023-09-06 12:07:47 -07:00
Krrish Dholakia	44f71aa321	logging replicate response logs	2023-09-06 11:28:40 -07:00
Krrish Dholakia	48ee4a08ac	updates	2023-09-06 11:21:48 -07:00
Krrish Dholakia	e2c143dfbc	test async streaming	2023-09-04 15:42:24 -07:00
Krrish Dholakia	0864b07616	fix linting errors	2023-09-04 15:16:13 -07:00
Krrish Dholakia	2384806cfd	adding first-party + custom prompt templates for huggingface	2023-09-04 14:54:09 -07:00
Krrish Dholakia	73bb1b96e9	update exception mapping and get model cost map	2023-09-04 11:53:20 -07:00
Krrish Dholakia	56853aca53	fix azure streaming	2023-09-02 16:10:19 -07:00
Krrish Dholakia	895e3c1a94	update to logging	2023-09-02 15:45:45 -07:00
Krrish Dholakia	83b8af8567	adding support for aleph alpha	2023-09-02 13:15:41 -07:00
Krrish Dholakia	0e445e6e69	fix streaming cache logic	2023-09-01 16:56:07 -07:00
Krrish Dholakia	e0a7db3666	update to litedebugger testing	2023-09-01 16:13:45 -07:00
Krrish Dholakia	34ed4cc23c	updates to logging	2023-09-01 14:38:52 -07:00
Krrish Dholakia	0ff4515f20	fixes to litedebugger	2023-09-01 13:22:16 -07:00
Krrish Dholakia	fda6dba1ec	fixes to core logging	2023-09-01 11:51:49 -07:00
Krrish Dholakia	b44299cce7	update model split tests with ui	2023-08-31 16:42:40 -07:00
Krrish Dholakia	14d4c7ead2	update baseten handler to handle TGI calls	2023-08-30 19:14:48 -07:00
Krrish Dholakia	0ea59702fd	add huggingface	2023-08-30 16:05:33 -07:00
Krrish Dholakia	daa949a539	return logprobs for hf models	2023-08-30 15:16:26 -07:00
Krrish Dholakia	f3d8445ff1	updates	2023-08-30 09:55:45 -07:00
Krrish Dholakia	b90e5ed6db	adding testing to make sure litedebugger is opt-in only	2023-08-30 09:55:33 -07:00
Krrish Dholakia	546ad43b15	adding context window exceeded error to huggingface	2023-08-29 16:46:04 -07:00
Krrish Dholakia	ad493a3109	adding contextwindow exceeded error mapping for replicate	2023-08-29 16:36:31 -07:00
Krrish Dholakia	509120bf61	add context window exceeded error for anthropic	2023-08-29 16:28:07 -07:00
Krrish Dholakia	f7955d52b5	add context window exceeded error mapping to openai	2023-08-29 16:08:00 -07:00
Krrish Dholakia	5bcf612724	adding coverage for openrouter in exception mapping	2023-08-29 15:30:24 -07:00
Krrish Dholakia	436e8eadb2	adding coverage for ai21	2023-08-29 13:32:20 -07:00
Krrish Dholakia	f11599e50c	add coverage for rate limit errors to togetherai	2023-08-29 12:54:56 -07:00
Krrish Dholakia	88bd1df3e0	adding exception handling for together ai	2023-08-29 12:29:59 -07:00
Krrish Dholakia	80fa61cc0e	bug fixes to logging	2023-08-28 15:36:59 -07:00
Krrish Dholakia	2462791f65	bug fixes to client	2023-08-28 15:09:14 -07:00
Krrish Dholakia	e8eb92c108	new logger client	2023-08-28 14:59:00 -07:00
Krrish Dholakia	d542066d4b	fixes to streaming for ai21, baseten, and openai text completions	2023-08-28 09:42:51 -07:00
Krrish Dholakia	60873abb41	further fixes to together ai streaming	2023-08-26 19:30:54 -07:00
Krrish Dholakia	bb3c2fefdb	anthropic and together ai streaming no longer waits till completion to return response	2023-08-26 19:00:53 -07:00
Krrish Dholakia	0ac17646d9	fix anthropic streaming	2023-08-26 18:54:51 -07:00
Krrish Dholakia	9155ba068f	fix anthropic and together ai streaming	2023-08-26 16:05:43 -07:00
Krrish Dholakia	9008973826	adding ability to turn off litedebugger but still use key manager	2023-08-26 11:03:40 -07:00
Krrish Dholakia	1192640fb9	show litedebugger for streaming objects	2023-08-26 10:28:27 -07:00
Krrish Dholakia	acccf17e44	updates to get model list	2023-08-24 19:06:44 -07:00
Krrish Dholakia	7d16df98ac	updates to logging	2023-08-24 18:58:12 -07:00
Krrish Dholakia	6e30b234ac	move baseten to a REST endpoint call	2023-08-24 14:43:49 -07:00
Krrish Dholakia	67d6527217	accept model alias	2023-08-24 08:20:21 -07:00
Krrish Dholakia	c8d2a5ed5e	adding support for completion with retries	2023-08-23 14:09:08 -07:00
Krrish Dholakia	d183dc8269	updates to litedebugger dashboard	2023-08-23 11:51:16 -07:00
Krrish Dholakia	b47cb95b90	get keys if auth error	2023-08-22 18:01:49 -07:00
Krrish Dholakia	46e1bc24b7	updates	2023-08-22 16:13:09 -07:00
Krrish Dholakia	1f98f38f13	change get to post request	2023-08-22 15:39:24 -07:00