123 commits

Author	SHA1	Message	Date
Krrish Dholakia	53b10e4372	allow updating budget manager cost by passing in text	2023-09-13 15:12:47 -07:00
Krrish Dholakia	5b6b9a9fab	huggingface conversational task support	2023-09-13 13:45:23 -07:00
Krrish Dholakia	b1fbe515fe	return model name as part of streaming object	2023-09-13 09:48:49 -07:00
Krrish Dholakia	e1c91903da	add reset budget on duration end to budget manager	2023-09-12 13:01:55 -07:00
Krrish Dholakia	e80457013b	doc cleanup for custom prompt templates	2023-09-12 12:16:47 -07:00
Krrish Dholakia	05f2f3dde7	fix get llm provider	2023-09-12 11:48:44 -07:00
Krrish Dholakia	baa69734b0	raise better exception if llm provider isn't passed in or inferred	2023-09-12 11:28:50 -07:00
Krrish Dholakia	bab36c2c6f	work for hf inference endpoint	2023-09-11 18:37:55 -07:00
Krrish Dholakia	f946f61b4c	improvements to exception mapping	2023-09-11 18:33:57 -07:00
Krrish Dholakia	cbc7e6dbc2	mock responses for streaming	2023-09-11 16:30:29 -07:00
Krrish Dholakia	6da500c6e0	add mock request to docs	2023-09-11 12:19:13 -07:00
Krrish Dholakia	d4806cd686	updating budget manager	2023-09-11 10:58:09 -07:00
Krrish Dholakia	fb8f2bac37	don't fail pytest due to timeout error in batch completions	2023-09-10 08:46:27 -07:00
Krrish Dholakia	b1ec504421	update budget manager	2023-09-09 20:06:09 -07:00
Krrish Dholakia	511793f8ac	fix circle ci testing	2023-09-09 16:36:45 -07:00
Krrish Dholakia	beecb60f51	update testing	2023-09-09 16:35:38 -07:00
Krrish Dholakia	8ed85b0523	rename apimanager to budget manager	2023-09-09 16:10:41 -07:00
Krrish Dholakia	a39756bfda	add api manager	2023-09-09 15:55:38 -07:00
Krrish Dholakia	263704e942	fix exception	2023-09-09 11:24:10 -07:00
Krrish Dholakia	a9cab12a47	improve error message returned if model not passed in	2023-09-09 11:18:10 -07:00
Krrish Dholakia	59d6703b0c	bump version	2023-09-08 19:26:41 -07:00
Krrish Dholakia	d02ab9bfcd	update exception logic	2023-09-08 18:55:11 -07:00
Krrish Dholakia	93fb247b1d	fix exception mapping	2023-09-08 18:45:18 -07:00
Krrish Dholakia	323e095688	fix exception mapping error	2023-09-08 18:20:07 -07:00
Krrish Dholakia	554b05015e	fix litedebugger double logging error	2023-09-07 18:02:24 -07:00
Krrish Dholakia	147a877aca	bump version	2023-09-07 17:00:20 -07:00
Krrish Dholakia	e452ceb21e	fix litellm client	2023-09-07 16:22:00 -07:00
Krrish Dholakia	35cf6ef0a1	batch completions for vllm now works too	2023-09-06 19:26:19 -07:00
Krrish Dholakia	4cfcabd919	adding support for vllm	2023-09-06 18:07:44 -07:00
Krrish Dholakia	4bcfa71e11	commenting out flaky circle ci test	2023-09-06 12:07:47 -07:00
Krrish Dholakia	44f71aa321	logging replicate response logs	2023-09-06 11:28:40 -07:00
Krrish Dholakia	48ee4a08ac	updates	2023-09-06 11:21:48 -07:00
Krrish Dholakia	e2c143dfbc	test async streaming	2023-09-04 15:42:24 -07:00
Krrish Dholakia	0864b07616	fix linting errors	2023-09-04 15:16:13 -07:00
Krrish Dholakia	2384806cfd	adding first-party + custom prompt templates for huggingface	2023-09-04 14:54:09 -07:00
Krrish Dholakia	73bb1b96e9	update exception mapping and get model cost map	2023-09-04 11:53:20 -07:00
Krrish Dholakia	56853aca53	fix azure streaming	2023-09-02 16:10:19 -07:00
Krrish Dholakia	895e3c1a94	update to logging	2023-09-02 15:45:45 -07:00
Krrish Dholakia	83b8af8567	adding support for aleph alpha	2023-09-02 13:15:41 -07:00
Krrish Dholakia	0e445e6e69	fix streaming cache logic	2023-09-01 16:56:07 -07:00
Krrish Dholakia	e0a7db3666	update to litedebugger testing	2023-09-01 16:13:45 -07:00
Krrish Dholakia	34ed4cc23c	updates to logging	2023-09-01 14:38:52 -07:00
Krrish Dholakia	0ff4515f20	fixes to litedebugger	2023-09-01 13:22:16 -07:00
Krrish Dholakia	fda6dba1ec	fixes to core logging	2023-09-01 11:51:49 -07:00
Krrish Dholakia	b44299cce7	update model split tests with ui	2023-08-31 16:42:40 -07:00
Krrish Dholakia	14d4c7ead2	update baseten handler to handle TGI calls	2023-08-30 19:14:48 -07:00
Krrish Dholakia	0ea59702fd	add huggingface	2023-08-30 16:05:33 -07:00
Krrish Dholakia	daa949a539	return logprobs for hf models	2023-08-30 15:16:26 -07:00
Krrish Dholakia	f3d8445ff1	updates	2023-08-30 09:55:45 -07:00
Krrish Dholakia	b90e5ed6db	adding testing to make sure litedebugger is opt-in only	2023-08-30 09:55:33 -07:00