1562 commits

Author	SHA1	Message	Date
Krrish Dholakia	73e5b96d8e	fix(utils.py): support cache logging for async router calls	2023-12-13 19:11:43 -08:00
Krrish Dholakia	cffd190887	test(test_custom_callback_router.py): fix test	2023-12-13 19:06:02 -08:00
Krrish Dholakia	73ecc012a9	docs(embedding.md): add embedding docs to proxy	2023-12-13 18:58:46 -08:00
Krrish Dholakia	8d688b6217	fix(utils.py): support caching for embedding + log cache hits ... n n	2023-12-13 18:37:30 -08:00
Krrish Dholakia	0f29cda8d9	test(test_amazing_vertex_completion.py): fix testing	2023-12-13 16:41:26 -08:00
Krrish Dholakia	e678009695	fix(vertex_ai.py): add exception mapping for acompletion calls	2023-12-13 16:35:50 -08:00
Krrish Dholakia	88d09fc5a7	fix(vertex.md): adding gemini-pro support to docs	2023-12-13 14:38:55 -08:00
Krrish Dholakia	7b8851cce5	fix(ollama.py): fix async completion calls for ollama	2023-12-13 13:10:25 -08:00
Krrish Dholakia	75bcb37cb2	fix(factory.py): fix tgai rendering template	2023-12-13 12:27:31 -08:00
Krrish Dholakia	69c29f8f86	fix(vertex_ai.py): add support for real async streaming + completion calls	2023-12-13 11:53:55 -08:00
Krrish Dholakia	07015843ac	fix(vertex_ai.py): support optional params + enable async calls for gemini	2023-12-13 11:01:23 -08:00
Krrish Dholakia	ef7a6e3ae1	feat(vertex_ai.py): adds support for gemini-pro on vertex ai	2023-12-13 10:26:30 -08:00
Krrish Dholakia	d1aef59fbc	fix(utils.py): fix stream chunk builder for sync/async success	2023-12-13 07:52:51 -08:00
Krrish Dholakia	a64bd2ca1e	fix(sagemaker.py): filter out templated prompt if in model response	2023-12-13 07:43:33 -08:00
Krrish Dholakia	82d28a8825	fix(factory.py): safely fail prompt template get requests for together ai	2023-12-12 17:28:22 -08:00
Krrish Dholakia	693292a64c	feat(proxy_server.py): add new /key/update endpoint	2023-12-12 17:18:51 -08:00
Krrish Dholakia	dfdb17ae36	test: refactor testing	2023-12-12 16:21:41 -08:00
Krrish Dholakia	669862643b	fix(utils.py): flush holding chunk for streaming, on stream end	2023-12-12 16:13:31 -08:00
Krrish Dholakia	8b07a6c046	fix(main.py): pass user_id + encoding_format for logging + to openai/azure	2023-12-12 15:46:44 -08:00
Krrish Dholakia	1e970841a4	fix(utils.py): more logging	2023-12-12 15:46:27 -08:00
Krrish Dholakia	bdf29ca71f	fix(sagemaker.py): debug streaming	2023-12-12 15:45:07 -08:00
ishaan-jaff	eefb2bbf09	(ci/cd) run again	2023-12-12 12:22:14 -08:00
Krrish Dholakia	902b68dcbd	bump: version 1.12.5.dev1 → 1.12.5	2023-12-12 11:11:09 -08:00
Krrish Dholakia	edbf97adf2	test: testing fixes	2023-12-12 10:57:51 -08:00
Krrish Dholakia	9cf5ab468f	fix(router.py): deepcopy initial model list, don't mutate it	2023-12-12 09:54:06 -08:00
ishaan-jaff	f5d64a4992	(fix) test router	2023-12-12 09:50:44 -08:00
Krrish Dholakia	29c579e9ca	test: reinitialize litellm before each test	2023-12-12 07:49:06 -08:00
Max Deichmann	c8585a8983	fix langfuse tests	2023-12-12 12:00:41 +01:00
Krrish Dholakia	8bb01422ee	test(test_streaming.py): stricter output format testing	2023-12-12 00:16:48 -08:00
ishaan-jaff	01d5875426	(test) reset callbacks in completion()	2023-12-11 23:35:52 -08:00
Krrish Dholakia	1d42967725	test(test_streaming.py): add testing for azure output chunk	2023-12-11 23:32:38 -08:00
ishaan-jaff	c89ed8f4c8	(ci/cd) test	2023-12-11 23:22:40 -08:00
ishaan-jaff	eb8514ddf6	(test) run ci/cd again	2023-12-11 23:17:23 -08:00
ishaan-jaff	e5bc7b338a	(test) stream - cache	2023-12-11 22:57:39 -08:00
ishaan-jaff	e49af2272d	(test) custom logger + cache	2023-12-11 22:46:49 -08:00
ishaan-jaff	ab90a66a8e	(test) cleanup proxy	2023-12-11 22:41:14 -08:00
ishaan-jaff	d563e53948	(ci/cd) reset azure api key	2023-12-11 22:23:11 -08:00
ishaan-jaff	f69653c126	(ci/cd) azure test	2023-12-11 22:22:52 -08:00
ishaan-jaff	5e7b9658e3	(fix) test proxy	2023-12-11 22:12:22 -08:00
Krrish Dholakia	d3bbf5bdff	test(test_proxy_server_keys.py): use global client	2023-12-11 21:32:57 -08:00
ishaan-jaff	c2b928a286	(test) proxy	2023-12-11 21:31:35 -08:00
ishaan-jaff	f07da60593	(test) proxy - pytest correct usage	2023-12-11 21:30:51 -08:00
Krrish Dholakia	3e7604420e	fix(proxy/utils.py): fix db writes on retry	2023-12-11 21:14:12 -08:00
Krrish Dholakia	b3600e9e8a	test(test_router_fallbacks.py): update to use async logging	2023-12-11 20:12:29 -08:00
ishaan-jaff	da0ec40a9f	(test) proxy: use fixtures	2023-12-11 20:03:46 -08:00
ishaan-jaff	c2f0a5c76a	(test) proxy use fixtures	2023-12-11 20:03:46 -08:00
Krrish Dholakia	3e908bf507	fix(router.py): reset caching correctly	2023-12-11 19:57:34 -08:00
Krrish Dholakia	6cb4ef5659	test(test_caching.py): reset cache values at the end of test	2023-12-11 18:10:53 -08:00
ishaan-jaff	634d301cae	(test) proxy	2023-12-11 17:57:58 -08:00
ishaan-jaff	b6798c703a	(fix) test proxy	2023-12-11 17:52:32 -08:00