3189 commits

Author	SHA1	Message	Date
Krrish Dholakia	d1aef59fbc	fix(utils.py): fix stream chunk builder for sync/async success	2023-12-13 07:52:51 -08:00
Krrish Dholakia	a64bd2ca1e	fix(sagemaker.py): filter out templated prompt if in model response	2023-12-13 07:43:33 -08:00
zeeland	79ea466cf5	refactor: add CustomStreamWrapper return type for completion	2023-12-13 22:57:19 +08:00
Krrish Dholakia	f9dfeb502a	fix(langfuse.py): serialize message for logging	2023-12-12 21:41:05 -08:00
Krrish Dholakia	82d28a8825	fix(factory.py): safely fail prompt template get requests for together ai	2023-12-12 17:28:22 -08:00
Krrish Dholakia	693292a64c	feat(proxy_server.py): add new /key/update endpoint	2023-12-12 17:18:51 -08:00
Krrish Dholakia	8e7116635f	fix(ollama.py): add support for async streaming	2023-12-12 16:44:20 -08:00
Krrish Dholakia	dfdb17ae36	test: refactor testing	2023-12-12 16:21:41 -08:00
Krrish Dholakia	669862643b	fix(utils.py): flush holding chunk for streaming, on stream end	2023-12-12 16:13:31 -08:00
Krrish Dholakia	a266ad0319	refactor(proxy_server.py): code cleanup	2023-12-12 15:49:41 -08:00
Krrish Dholakia	8b07a6c046	fix(main.py): pass user_id + encoding_format for logging + to openai/azure	2023-12-12 15:46:44 -08:00
Krrish Dholakia	35fa176c97	fix(utils.py): fix logging ... n	2023-12-12 15:46:36 -08:00
Krrish Dholakia	1e970841a4	fix(utils.py): more logging	2023-12-12 15:46:27 -08:00
Krrish Dholakia	632d6e0bff	fix(utils.py): add more logging	2023-12-12 15:46:12 -08:00
Krrish Dholakia	6e87d1ca18	fix(utils.py): safe fail complete streaming response	2023-12-12 15:46:12 -08:00
Krrish Dholakia	d6669fe9e3	fix(utils.py): add more logging	2023-12-12 15:46:00 -08:00
Krrish Dholakia	bdf29ca71f	fix(sagemaker.py): debug streaming	2023-12-12 15:45:07 -08:00
ishaan-jaff	a251a52717	(chore) remove junk tkinter import	2023-12-12 13:54:50 -08:00
ishaan-jaff	6d76878382	(fix) pydantic: Field "model_list" has conflict with protected namespace "model_".	2023-12-12 12:38:11 -08:00
ishaan-jaff	b6b88370ca	(fix) from re import T - junk import	2023-12-12 12:26:15 -08:00
ishaan-jaff	eefb2bbf09	(ci/cd) run again	2023-12-12 12:22:14 -08:00
ishaan-jaff	99b48eff17	(fix) tkinter import	2023-12-12 12:18:25 -08:00
Krrish Dholakia	902b68dcbd	bump: version 1.12.5.dev1 → 1.12.5	2023-12-12 11:11:09 -08:00
Krrish Dholakia	edbf97adf2	test: testing fixes	2023-12-12 10:57:51 -08:00
Krrish Dholakia	9cf5ab468f	fix(router.py): deepcopy initial model list, don't mutate it	2023-12-12 09:54:06 -08:00
ishaan-jaff	a5dd8b1d4a	(fix) use deepcopy for model list	2023-12-12 09:53:52 -08:00
ishaan-jaff	f5d64a4992	(fix) test router	2023-12-12 09:50:44 -08:00
Krrish Dholakia	29c579e9ca	test: reinitialize litellm before each test	2023-12-12 07:49:06 -08:00
Max Deichmann	c8585a8983	fix langfuse tests	2023-12-12 12:00:41 +01:00
Krrish Dholakia	dc148c37b0	refactor(custom_logger.py): add async log stream event function	2023-12-12 00:16:48 -08:00
Krrish Dholakia	8bb01422ee	test(test_streaming.py): stricter output format testing	2023-12-12 00:16:48 -08:00
ishaan-jaff	0dd1111cea	(fix) assert streaming response = streamchoices()	2023-12-12 00:12:57 -08:00
ishaan-jaff	01d5875426	(test) reset callbacks in completion()	2023-12-11 23:35:52 -08:00
Krrish Dholakia	1d42967725	test(test_streaming.py): add testing for azure output chunk	2023-12-11 23:32:38 -08:00
ishaan-jaff	c89ed8f4c8	(ci/cd) test	2023-12-11 23:22:40 -08:00
Krrish Dholakia	2c1c75fdf0	fix(ollama.py): enable parallel ollama completion calls	2023-12-11 23:18:37 -08:00
ishaan-jaff	eb8514ddf6	(test) run ci/cd again	2023-12-11 23:17:23 -08:00
ishaan-jaff	e5bc7b338a	(test) stream - cache	2023-12-11 22:57:39 -08:00
ishaan-jaff	e49af2272d	(test) custom logger + cache	2023-12-11 22:46:49 -08:00
ishaan-jaff	ab90a66a8e	(test) cleanup proxy	2023-12-11 22:41:14 -08:00
ishaan-jaff	d563e53948	(ci/cd) reset azure api key	2023-12-11 22:23:11 -08:00
ishaan-jaff	f69653c126	(ci/cd) azure test	2023-12-11 22:22:52 -08:00
ishaan-jaff	f8c7528bff	(fix) proxy : cleanup router	2023-12-11 22:12:22 -08:00
ishaan-jaff	5e7b9658e3	(fix) test proxy	2023-12-11 22:12:22 -08:00
Krrish Dholakia	d3bbf5bdff	test(test_proxy_server_keys.py): use global client	2023-12-11 21:32:57 -08:00
ishaan-jaff	c2b928a286	(test) proxy	2023-12-11 21:31:35 -08:00
ishaan-jaff	f07da60593	(test) proxy - pytest correct usage	2023-12-11 21:30:51 -08:00
Krrish Dholakia	3e7604420e	fix(proxy/utils.py): fix db writes on retry	2023-12-11 21:14:12 -08:00
Krrish Dholakia	b3600e9e8a	test(test_router_fallbacks.py): update to use async logging	2023-12-11 20:12:29 -08:00
ishaan-jaff	da0ec40a9f	(test) proxy: use fixtures	2023-12-11 20:03:46 -08:00