3798 commits

This branch

This branch

All branches

Author	SHA1	Message	Date
Krrish Dholakia	b6bc75e27a	fix(utils.py): fix parallel tool calling when streaming	2023-11-29 10:56:21 -08:00
Krrish Dholakia	9024a47dc2	fix(utils.py): bedrock/cohere optional params	2023-11-29 08:08:48 -08:00
ishaan-jaff	f307e82a41	(fix) proxy: making receiving data print_verbose	2023-11-29 07:50:52 -08:00
Krrish Dholakia	5fc7cd28d9	bump: version 1.7.11 → 1.7.12	2023-11-28 21:34:56 -08:00
ishaan-jaff	6f71299bb0	(fix) embedding pop out client from params	2023-11-28 21:22:01 -08:00
Krrish Dholakia	383dd53e86	fix(main.py): passing client as a litellm-specific kwarg	2023-11-28 21:20:05 -08:00
Krrish Dholakia	3154cd1758	test(test_exceptions.py): cleanup testing	2023-11-28 21:11:49 -08:00
ishaan-jaff	4c4dde60c7	(ci/cd) test exceptions	2023-11-28 21:11:12 -08:00
ishaan-jaff	afd20098be	(feat) router: init client for OpenAI compatible providers	2023-11-28 17:49:53 -08:00
Krrish Dholakia	b9ae6275ca	bump: version 1.7.10 → 1.7.11	2023-11-28 17:42:57 -08:00
Krrish Dholakia	4e9aa0d338	fix(utils.py): fix bedrock/cohere supported params	2023-11-28 17:42:50 -08:00
Krrish Dholakia	2b06fea4a8	fix(proxy_server.py): ensure /models returns unique model names	2023-11-28 17:32:20 -08:00
Krrish Dholakia	9d4e427250	refactor(requirements.txt): adding google-genai for proxy requirements	2023-11-28 17:27:33 -08:00
Krrish Dholakia	536abe745e	bump: version 1.7.9 → 1.7.10	2023-11-28 17:25:03 -08:00
Krrish Dholakia	bb1267eb07	fix(router.py): fix exponential backoff to use retry-after if present in headers	2023-11-28 17:25:03 -08:00
ishaan-jaff	0f0ddcc0fb	(fix) using AzureOpenAI client	2023-11-28 17:17:40 -08:00
ishaan-jaff	f5b558dde0	(fix) router red api_key, api_base, api_version	2023-11-28 17:10:20 -08:00
ishaan-jaff	8609694b49	(fix) completion:openai-pop out max_retries from completion kwargs	2023-11-28 17:09:58 -08:00
ishaan-jaff	282b9a37e5	(fix) router: passing client	2023-11-28 16:34:16 -08:00
ishaan-jaff	4d06c296e3	(router) re use client across requests	2023-11-28 16:21:16 -08:00
ishaan-jaff	f4a7760ea1	(feat+test) use passed OpenAI client	2023-11-28 16:09:10 -08:00
ishaan-jaff	8ac7801283	(feat) completion:openai pass OpenAI client	2023-11-28 16:05:01 -08:00
ishaan-jaff	01c38d37fa	(test) pass client to Azure completion	2023-11-28 15:57:11 -08:00
ishaan-jaff	400a268934	(feat) completion: Azure allow users to pass client to router	2023-11-28 15:56:52 -08:00
ishaan-jaff	1a0b683a8e	(test) using client: compleition	2023-11-28 15:44:56 -08:00
ishaan-jaff	ee6f5a84db	(test) load test completion	2023-11-28 15:44:56 -08:00
ishaan-jaff	ae7f0ae0b6	(feat) proxy: add logs on router performance	2023-11-28 15:44:56 -08:00
ishaan-jaff	94d35f1ec5	(feat) router: re-use the same client for high trafic	2023-11-28 15:44:56 -08:00
ishaan-jaff	7914623fbc	(feat) allow users to pass azure client for acmompletion	2023-11-28 15:44:56 -08:00
ishaan-jaff	2a69cab550	(feat) router track total, success, failed calls per model	2023-11-28 15:44:56 -08:00
Krrish Dholakia	20380804b3	bump: version 1.7.8 → 1.7.9	2023-11-28 14:05:23 -08:00
Krrish Dholakia	4ea52dd571	fix(proxy_server.py): support reading master key from os environment	2023-11-28 14:05:17 -08:00
Krrish Dholakia	094144de58	fix(router.py): removing model id before making call	2023-11-28 10:09:45 -08:00
Krrish Dholakia	5ed957ebbe	fix(utils.py): bug fix return only non-null responses	2023-11-28 09:43:42 -08:00
Krrish Dholakia	150b91d476	fix(utils.py): fix streaming on-success logging	2023-11-28 09:11:47 -08:00
Krrish Dholakia	cd2883065a	docs(stream.md): add stream chunk builder helper function to docs	2023-11-28 08:58:35 -08:00
ishaan-jaff	30b80afe31	(docs) fix local debugging	2023-11-28 08:49:14 -08:00
ishaan-jaff	224a028ab6	(fix) completion: AZURE_OPENAI_API_KEY	2023-11-28 08:06:06 -08:00
Krrish Dholakia	6149642295	refactor(router.py): fix linting errors	2023-11-27 22:11:53 -08:00
Krrish Dholakia	82d79638d4	refactor(router.py): fix linting errors	2023-11-27 22:08:48 -08:00
Krrish Dholakia	c4aea7432f	build: adding debug logs to gitignore	2023-11-27 22:05:07 -08:00
ishaan-jaff	c52861906b	(test) router cooldowns	2023-11-27 22:03:02 -08:00
ishaan-jaff	3ca4487e77	(feat) proxy set num_retries=3	2023-11-27 19:33:59 -08:00
Krrish Dholakia	60a4906505	bump: version 1.7.7 → 1.7.8	2023-11-27 19:11:48 -08:00
Krrish Dholakia	be9fa06da6	fix(main.py): fix linting errors	2023-11-27 19:11:38 -08:00
Krrish Dholakia	e8331a4647	fix(utils.py): azure tool calling streaming	2023-11-27 19:07:38 -08:00
Krrish Dholakia	4cdd930fa2	fix(stream_chunk_builder): adding support for tool calling in completion counting	2023-11-27 18:39:47 -08:00
ishaan-jaff	40d9e8ab23	(test) load test	2023-11-27 18:08:47 -08:00
ishaan-jaff	50733363ee	(feat) use api_base, api_key as model	2023-11-27 18:08:47 -08:00
ishaan-jaff	9cef551623	(feat) raise APIConnectionError error for Azure +OpenAI	2023-11-27 18:08:47 -08:00