844 commits

Author	SHA1	Message	Date
ishaan-jaff	7e6c37962b	(test) update testing streaming for open ai v1.0.0+	2023-11-18 19:04:41 -08:00
ishaan-jaff	e276023462	(test) palm streaming test	2023-11-18 17:32:15 -08:00
ishaan-jaff	9bea4044b0	(test) remove unused tests	2023-11-18 17:25:42 -08:00
ishaan-jaff	2f0304f100	(test) async for chunk	2023-11-18 17:17:39 -08:00
ishaan-jaff	30fcc1f9a0	(test) do nothing if token==None in stream chunk	2023-11-18 17:13:16 -08:00
ishaan-jaff	b2f8f8ed45	(test) openai streaming + function calling	2023-11-18 17:01:46 -08:00
ishaan-jaff	e10c2d0bda	(test) tool/function calling + streaming	2023-11-18 16:23:29 -08:00
ishaan-jaff	b31368ac2f	(test) function calling	2023-11-18 15:15:02 -08:00
Krrish Dholakia	34decba3cf	fix(text_completion): allow either model or engine to be set	2023-11-17 18:25:21 -08:00
Krrish Dholakia	7ea80de2f1	test(test_async_fn.py): catch timeouts	2023-11-17 18:01:52 -08:00
Krrish Dholakia	cf0a9f591c	fix(router.py): introducing usage-based-routing	2023-11-17 17:56:26 -08:00
ishaan-jaff	259c1c7616	(ci/cd) fix timeout error	2023-11-17 17:46:49 -08:00
Krrish Dholakia	7d70bf84a7	test(test_langfuse.py): handle timeouts	2023-11-17 17:05:46 -08:00
ishaan-jaff	1ba32368ef	(test) parallel tool calling	2023-11-17 17:03:24 -08:00
Krrish Dholakia	29906f6320	test(test_completion.py): change tgai model	2023-11-17 16:06:42 -08:00
Krrish Dholakia	237e6a4c32	fix(test_router.py): catch timeouts	2023-11-17 15:56:06 -08:00
ishaan-jaff	6d3248e17f	(test) parallel function calling	2023-11-17 15:51:27 -08:00
Krrish Dholakia	02ed97d0b2	fix(acompletion): support client side timeouts + raise exceptions correctly for async calls	2023-11-17 15:39:47 -08:00
ishaan-jaff	b3e36d0486	(test) test seed, response format, for gpt-3.5-turbo	2023-11-17 14:00:42 -08:00
ishaan-jaff	e9f6741b0b	(v1.0+ breaking change) get_max_tokens -> return int	2023-11-17 10:38:50 -08:00
Krrish Dholakia	81764ca4f6	test: load test router	2023-11-17 08:23:44 -08:00
ishaan-jaff	eb18195424	(ci/cd) re run pipeline	2023-11-17 08:07:02 -08:00
ishaan-jaff	0b051e56ba	(ci/cd) re run pipeline	2023-11-16 21:55:10 -08:00
ishaan-jaff	e5cb8013a1	(test) add --debug to cli tool	2023-11-16 14:46:26 -08:00
Krrish Dholakia	48a508bab6	feat: global client for sync + async calls (openai + Azure only)	2023-11-16 14:44:13 -08:00
Krrish Dholakia	a6e9f147d3	fix(openai.py): handling extra headers	2023-11-16 12:48:21 -08:00
ishaan-jaff	945761c36b	(test) hf streaming	2023-11-16 12:24:31 -08:00
Krrish Dholakia	95642df0a4	test(loadtest_router.py): commenting out of ci/cd	2023-11-16 12:17:25 -08:00
Krrish Dholakia	e54056f0ed	fix(azure.py): use openai client sdk for handling sync+async calling	2023-11-16 12:08:12 -08:00
ishaan-jaff	bef9ead3a6	(test) regular hf tests	2023-11-16 12:00:49 -08:00
ishaan-jaff	d951f849a7	(test) text_completion	2023-11-16 11:37:46 -08:00
ishaan-jaff	521584377d	(test) proxy cli	2023-11-16 11:19:09 -08:00
ishaan-jaff	f2170fa16b	(test) proxy cli test	2023-11-16 11:13:39 -08:00
Krrish Dholakia	f14bd24b46	fix(openai.py): fix linting issues	2023-11-16 11:01:28 -08:00
ishaan-jaff	b2f9cb1387	(test) langfuse logger	2023-11-16 10:45:35 -08:00
Krrish Dholakia	9c7cc84eb0	fix(openai.py): supporting openai client sdk for handling sync + async calls (incl. for openai-compatible apis)	2023-11-16 10:35:03 -08:00
ishaan-jaff	f0c0e71208	(test) add proxy cli testing	2023-11-16 09:51:17 -08:00
Krrish Dholakia	a80c5841b2	fix(openai.py): using openai sdk for completion calls	2023-11-15 20:25:27 -08:00
Krrish Dholakia	6aef9d2db3	perf(openai.py): extending request timeout	2023-11-15 18:45:45 -08:00
ishaan-jaff	0adeb06306	(chore) testing reset callbacks	2023-11-15 18:29:03 -08:00
Krrish Dholakia	4bd471644e	fix(openai.py): switch back to using requests instead of httpx	2023-11-15 18:25:21 -08:00
ishaan-jaff	0eb8ba7089	(chore) ci/cd testing	2023-11-15 18:07:04 -08:00
Krrish Dholakia	081400ecd4	fix(openai.py): fix timeout errors	2023-11-15 18:03:14 -08:00
ishaan-jaff	b397719709	(chore) remove bloat caching tests	2023-11-15 17:58:58 -08:00
Krrish Dholakia	f2020c2284	test: cleanup testing	2023-11-15 17:57:14 -08:00
ishaan-jaff	317104b555	(chore) speed up testing	2023-11-15 17:56:03 -08:00
ishaan-jaff	0e2811d878	(chore) remove bloat	2023-11-15 17:52:57 -08:00
Krrish Dholakia	ef4e5b9636	test: set request timeout at request level	2023-11-15 17:42:31 -08:00
ishaan-jaff	a451db6ac7	(chore) remove bloat testing	2023-11-15 17:40:24 -08:00
ishaan-jaff	563c70dc87	(fix) testing model alias map	2023-11-15 17:40:15 -08:00