3810 commits

This branch

This branch

All branches

Author	SHA1	Message	Date
ishaan-jaff	8a398a1777	(feat) proxy: add weighted shuffle + set cooldown to 1s	2023-11-29 16:09:31 -08:00
ishaan-jaff	2bbd9c063d	(fix) OpenAI embedding	2023-11-29 16:09:31 -08:00
Krrish Dholakia	3c254cc555	bump: version 1.7.15 → 1.7.16	2023-11-29 16:04:22 -08:00
Krrish Dholakia	96a27ce954	fix(utils.py): stop sequence filtering for amazon titan models	2023-11-29 16:04:14 -08:00
Krrish Dholakia	dccfe1cc3e	bump: version 1.7.14 → 1.7.15	2023-11-29 15:37:21 -08:00
Krrish Dholakia	04a1c20bc5	fix(router.py): skip api key when generating model id for router deployments	2023-11-29 15:37:08 -08:00
Krrish Dholakia	6c98715b94	bump: version 1.7.13 → 1.7.14	2023-11-29 15:19:18 -08:00
Krrish Dholakia	451851e6a4	fix(main.py): have stream_chunk_builder return successful response even if token_counter fails	2023-11-29 15:19:11 -08:00
Krrish Dholakia	e41bd77df4	bump: version 1.7.12 → 1.7.13	2023-11-29 12:22:27 -08:00
Krrish Dholakia	7175cac1de	test(test_custom_logger.py): comment out streaming/success test due to pytest build issues	2023-11-29 12:18:02 -08:00
Krrish Dholakia	2b437a2699	fix(utils.py): return last streaming chunk	2023-11-29 12:11:08 -08:00
Krrish Dholakia	a9ed768991	fix(azure.py): fix error handling for openai/azure streaming	2023-11-29 11:52:24 -08:00
Krrish Dholakia	b6bc75e27a	fix(utils.py): fix parallel tool calling when streaming	2023-11-29 10:56:21 -08:00
Krrish Dholakia	9024a47dc2	fix(utils.py): bedrock/cohere optional params	2023-11-29 08:08:48 -08:00
ishaan-jaff	f307e82a41	(fix) proxy: making receiving data print_verbose	2023-11-29 07:50:52 -08:00
Krrish Dholakia	5fc7cd28d9	bump: version 1.7.11 → 1.7.12	2023-11-28 21:34:56 -08:00
ishaan-jaff	6f71299bb0	(fix) embedding pop out client from params	2023-11-28 21:22:01 -08:00
Krrish Dholakia	383dd53e86	fix(main.py): passing client as a litellm-specific kwarg	2023-11-28 21:20:05 -08:00
Krrish Dholakia	3154cd1758	test(test_exceptions.py): cleanup testing	2023-11-28 21:11:49 -08:00
ishaan-jaff	4c4dde60c7	(ci/cd) test exceptions	2023-11-28 21:11:12 -08:00
ishaan-jaff	afd20098be	(feat) router: init client for OpenAI compatible providers	2023-11-28 17:49:53 -08:00
Krrish Dholakia	b9ae6275ca	bump: version 1.7.10 → 1.7.11	2023-11-28 17:42:57 -08:00
Krrish Dholakia	4e9aa0d338	fix(utils.py): fix bedrock/cohere supported params	2023-11-28 17:42:50 -08:00
Krrish Dholakia	2b06fea4a8	fix(proxy_server.py): ensure /models returns unique model names	2023-11-28 17:32:20 -08:00
Krrish Dholakia	9d4e427250	refactor(requirements.txt): adding google-genai for proxy requirements	2023-11-28 17:27:33 -08:00
Krrish Dholakia	536abe745e	bump: version 1.7.9 → 1.7.10	2023-11-28 17:25:03 -08:00
Krrish Dholakia	bb1267eb07	fix(router.py): fix exponential backoff to use retry-after if present in headers	2023-11-28 17:25:03 -08:00
ishaan-jaff	0f0ddcc0fb	(fix) using AzureOpenAI client	2023-11-28 17:17:40 -08:00
ishaan-jaff	f5b558dde0	(fix) router red api_key, api_base, api_version	2023-11-28 17:10:20 -08:00
ishaan-jaff	8609694b49	(fix) completion:openai-pop out max_retries from completion kwargs	2023-11-28 17:09:58 -08:00
ishaan-jaff	282b9a37e5	(fix) router: passing client	2023-11-28 16:34:16 -08:00
ishaan-jaff	4d06c296e3	(router) re use client across requests	2023-11-28 16:21:16 -08:00
ishaan-jaff	f4a7760ea1	(feat+test) use passed OpenAI client	2023-11-28 16:09:10 -08:00
ishaan-jaff	8ac7801283	(feat) completion:openai pass OpenAI client	2023-11-28 16:05:01 -08:00
ishaan-jaff	01c38d37fa	(test) pass client to Azure completion	2023-11-28 15:57:11 -08:00
ishaan-jaff	400a268934	(feat) completion: Azure allow users to pass client to router	2023-11-28 15:56:52 -08:00
ishaan-jaff	1a0b683a8e	(test) using client: compleition	2023-11-28 15:44:56 -08:00
ishaan-jaff	ee6f5a84db	(test) load test completion	2023-11-28 15:44:56 -08:00
ishaan-jaff	ae7f0ae0b6	(feat) proxy: add logs on router performance	2023-11-28 15:44:56 -08:00
ishaan-jaff	94d35f1ec5	(feat) router: re-use the same client for high trafic	2023-11-28 15:44:56 -08:00
ishaan-jaff	7914623fbc	(feat) allow users to pass azure client for acmompletion	2023-11-28 15:44:56 -08:00
ishaan-jaff	2a69cab550	(feat) router track total, success, failed calls per model	2023-11-28 15:44:56 -08:00
Krrish Dholakia	20380804b3	bump: version 1.7.8 → 1.7.9	2023-11-28 14:05:23 -08:00
Krrish Dholakia	4ea52dd571	fix(proxy_server.py): support reading master key from os environment	2023-11-28 14:05:17 -08:00
Krrish Dholakia	094144de58	fix(router.py): removing model id before making call	2023-11-28 10:09:45 -08:00
Krrish Dholakia	5ed957ebbe	fix(utils.py): bug fix return only non-null responses	2023-11-28 09:43:42 -08:00
Krrish Dholakia	150b91d476	fix(utils.py): fix streaming on-success logging	2023-11-28 09:11:47 -08:00
Krrish Dholakia	cd2883065a	docs(stream.md): add stream chunk builder helper function to docs	2023-11-28 08:58:35 -08:00
ishaan-jaff	30b80afe31	(docs) fix local debugging	2023-11-28 08:49:14 -08:00
ishaan-jaff	224a028ab6	(fix) completion: AZURE_OPENAI_API_KEY	2023-11-28 08:06:06 -08:00