1562 commits

Author	SHA1	Message	Date
ishaan-jaff	fb3983d058	fix timeouts + tests + bump v	2023-09-05 17:17:58 -07:00
ishaan-jaff	8ecef03f63	custom api base	2023-09-05 16:50:32 -07:00
ishaan-jaff	2250d1375e	clean up azure implementation	2023-09-05 15:31:59 -07:00
Krrish Dholakia	9a82bfa4d2	test parallelism on circle ci	2023-09-05 14:47:50 -07:00
Krrish Dholakia	faa78ad543	bump version	2023-09-05 14:30:03 -07:00
Krrish Dholakia	8845938b31	adding support for custom prompt templates to together ai	2023-09-05 12:20:09 -07:00
Krrish Dholakia	64f3d3c56e	prompt formatting for together ai llama2 models	2023-09-05 11:57:13 -07:00
Krrish Dholakia	dc130efac6	update streaming docs to show it working for async completion calls	2023-09-05 09:18:37 -07:00
Krrish Dholakia	e2c143dfbc	test async streaming	2023-09-04 15:42:24 -07:00
ishaan-jaff	79acfb4dab	fix aleph alpha client init	2023-09-04 15:14:09 -07:00
Krrish Dholakia	2384806cfd	adding first-party + custom prompt templates for huggingface	2023-09-04 14:54:09 -07:00
ishaan-jaff	a474b89779	clean up hugging face completion()	2023-09-04 14:41:06 -07:00
ishaan-jaff	f0e2922710	bump version	2023-09-04 12:44:20 -07:00
ishaan-jaff	8f07c80733	boto3 testing + docs	2023-09-04 12:14:24 -07:00
ishaan-jaff	126830f08a	allow users to set AWS_REGION_NAME	2023-09-04 11:57:22 -07:00
Krrish Dholakia	73bb1b96e9	update exception mapping and get model cost map	2023-09-04 11:53:20 -07:00
ishaan-jaff	e03d442e8f	add optional params for llama-2	2023-09-04 11:41:20 -07:00
ishaan-jaff	4a4ee51df3	working sagemaker support	2023-09-04 11:30:34 -07:00
ishaan-jaff	46857577fa	[temp] remove cache streaming flaky test	2023-09-04 09:50:45 -07:00
ishaan-jaff	315cac619b	bump version	2023-09-02 22:01:49 -07:00
ishaan-jaff	09ae510a58	use api_base instead of custom_api_base	2023-09-02 17:11:30 -07:00
ishaan-jaff	e6836985c8	test without id	2023-09-02 16:54:04 -07:00
Krrish Dholakia	1fc2901531	remove token	2023-09-02 15:24:18 -07:00
Krrish Dholakia	607dc322a5	update split test logic	2023-09-02 14:32:18 -07:00
Krrish Dholakia	83b8af8567	adding support for aleph alpha	2023-09-02 13:15:41 -07:00
Krrish Dholakia	0e445e6e69	fix streaming cache logic	2023-09-01 16:56:07 -07:00
Krrish Dholakia	389d50f506	updates to testing	2023-09-01 16:38:11 -07:00
Krrish Dholakia	3091f0f41b	circle ci please don't fail	2023-09-01 16:27:39 -07:00
Krrish Dholakia	e0a7db3666	update to litedebugger testing	2023-09-01 16:13:45 -07:00
Krrish Dholakia	4d17c57373	updates to tests	2023-09-01 16:01:28 -07:00
Krrish Dholakia	ab35fdb635	fix linting error	2023-09-01 15:47:53 -07:00
ishaan-jaff	51e486441d	use dynamic config args	2023-09-01 15:39:30 -07:00
Krrish Dholakia	34ed4cc23c	updates to logging	2023-09-01 14:38:52 -07:00
Krrish Dholakia	0ff4515f20	fixes to litedebugger	2023-09-01 13:22:16 -07:00
Krrish Dholakia	f30cb56b8d	update to logging tests	2023-09-01 12:09:14 -07:00
Krrish Dholakia	1d73f05ae1	cleanup	2023-09-01 12:08:46 -07:00
Krrish Dholakia	fda6dba1ec	fixes to core logging	2023-09-01 11:51:49 -07:00
Krrish Dholakia	b44299cce7	update model split tests with ui	2023-08-31 16:42:40 -07:00
ishaan-jaff	f4b209ca65	default langfuse flush	2023-08-31 11:43:20 -07:00
ishaan-jaff	f466c443fe	add langfuse integration	2023-08-31 11:04:17 -07:00
ishaan-jaff	beac62b8fe	litellm call id's in responses when client true	2023-08-31 10:09:10 -07:00
yujong-lee	2cc9074d09	Cleanup test, at least pass with openai	2023-08-31 20:33:34 +09:00
Krrish Dholakia	14d4c7ead2	update baseten handler to handle TGI calls	2023-08-30 19:14:48 -07:00
Krrish Dholakia	fcaf514546	updates	2023-08-30 16:05:42 -07:00
Krrish Dholakia	0ea59702fd	add huggingface	2023-08-30 16:05:33 -07:00
Krrish Dholakia	daa949a539	return logprobs for hf models	2023-08-30 15:16:26 -07:00
ishaan-jaff	cd9b9abde3	updates to caching tutorial	2023-08-30 11:31:10 -07:00
Krrish Dholakia	f3d8445ff1	updates	2023-08-30 09:55:45 -07:00
Krrish Dholakia	b90e5ed6db	adding testing to make sure litedebugger is opt-in only	2023-08-30 09:55:33 -07:00
ishaan-jaff	38828ae705	remove flaky petals test	2023-08-29 21:20:57 -07:00