3803 commits

This branch

This branch

All branches

Author	SHA1	Message	Date
Krrish Dholakia	e8331a4647	fix(utils.py): azure tool calling streaming	2023-11-27 19:07:38 -08:00
Krrish Dholakia	4cdd930fa2	fix(stream_chunk_builder): adding support for tool calling in completion counting	2023-11-27 18:39:47 -08:00
ishaan-jaff	40d9e8ab23	(test) load test	2023-11-27 18:08:47 -08:00
ishaan-jaff	50733363ee	(feat) use api_base, api_key as model	2023-11-27 18:08:47 -08:00
ishaan-jaff	9cef551623	(feat) raise APIConnectionError error for Azure +OpenAI	2023-11-27 18:08:47 -08:00
Krrish Dholakia	04f745e314	fix(router.py): speed improvements to the router	2023-11-27 17:35:26 -08:00
ishaan-jaff	8560794963	(test) load test router	2023-11-27 16:37:57 -08:00
ishaan-jaff	18d9222945	(test) litellm using uuid for model name	2023-11-27 16:37:39 -08:00
ishaan-jaff	4265f9b2ef	(fix) router: allow same model/name	2023-11-27 16:26:09 -08:00
ishaan-jaff	ba228a9e0a	(fix) proxy set litellm attributes	2023-11-27 13:39:18 -08:00
ishaan-jaff	d7dd9f0307	(docs) health check proxy llms	2023-11-27 12:20:15 -08:00
ishaan-jaff	5e2c13fb11	(test) load test proxy completion	2023-11-27 12:13:21 -08:00
ishaan-jaff	9747cc5aad	(feat) --health for checking config models	2023-11-27 12:13:21 -08:00
Krrish Dholakia	56bb39e52c	fix(acompletion): fix acompletion raise exception issue when custom llm provider is none	2023-11-27 11:34:48 -08:00
ishaan-jaff	37f3b1edd1	(ci/cd) run again	2023-11-27 11:12:11 -08:00
ishaan-jaff	9d259d08e7	(linting) fix	2023-11-27 10:27:51 -08:00
ishaan-jaff	f54c4ee4b8	(docs) sagemaker add chat llms	2023-11-27 10:24:32 -08:00
ishaan-jaff	18ca445bc2	bump: version 1.7.6 → 1.7.7	2023-11-27 10:14:03 -08:00
ishaan-jaff	a4754f9098	(test) competion	2023-11-27 10:13:46 -08:00
ishaan-jaff	26938f697e	(feat) completion:debugging - show raw POST request	2023-11-27 10:13:37 -08:00
ishaan-jaff	90687d51f1	(test) sagemaker add chat models	2023-11-27 10:11:56 -08:00
ishaan-jaff	f7ae01da8a	(feat) completion:sagemaker - support chat models	2023-11-27 10:11:10 -08:00
ishaan-jaff	b732d4c394	(feat) model context json: add sagemaker	2023-11-27 09:55:53 -08:00
ishaan-jaff	e407b185ee	(feat) completion:sagemaker - better debugging	2023-11-27 09:08:20 -08:00
ishaan-jaff	d0538e32c9	(feat) completion: sagemaker debugging - show boto3 request sent	2023-11-27 09:04:50 -08:00
Krrish Dholakia	9b5f52ae63	bump: version 1.7.5 → 1.7.6	2023-11-27 08:04:49 -08:00
Krrish Dholakia	aafba24e84	fix(proxy_server.py): fix user model returned in /models	2023-11-27 08:04:49 -08:00
ishaan-jaff	e9947be7b2	(fix) add timeout to __init__ litellm	2023-11-27 07:49:18 -08:00
Krrish Dholakia	f6d40c2241	bump: version 1.7.4 → 1.7.5	2023-11-25 19:34:39 -08:00
Krrish Dholakia	59ba1560e5	fix(router.py): fix fallbacks	2023-11-25 19:34:20 -08:00
Krrish Dholakia	cc3d7da9a0	bump: version 1.7.3 → 1.7.4	2023-11-25 18:46:57 -08:00
Krrish Dholakia	fa713abfc3	fix(router.py): check for fallbacks in completion params for router	2023-11-25 18:46:45 -08:00
Krrish Dholakia	793d3ecf81	bump: version 1.7.2 → 1.7.3	2023-11-25 18:28:53 -08:00
Krrish Dholakia	e4f302a8e2	fix(proxy_server.py): expose a /health endpoint	2023-11-25 18:28:47 -08:00
ishaan-jaff	2c4f52b6b1	(fix) linting	2023-11-25 15:46:07 -08:00
ishaan-jaff	0b56d584aa	(test) openai exception mapping for openai.AuthenticationError	2023-11-25 15:43:46 -08:00
ishaan-jaff	afaca3f819	(fix) acompletion: Raise same error as completion	2023-11-25 15:33:46 -08:00
Krrish Dholakia	770359d6db	bump: version 1.7.1 → 1.7.2	2023-11-25 14:58:20 -08:00
Krrish Dholakia	ab0bc87427	fix(router.py): check if fallbacks is none	2023-11-25 14:58:07 -08:00
Krrish Dholakia	95579fda7d	fix(utils.py): fix bedrock + cohere calls	2023-11-25 14:45:42 -08:00
Krrish Dholakia	2eb7386095	fix(utils.py): fix embedding response object conversion	2023-11-25 14:25:06 -08:00
Krrish Dholakia	e43e1e9ab1	fix(utils.py): fix linting errors	2023-11-25 14:19:14 -08:00
Krrish Dholakia	ec81b393e2	fix(utils.py): fix linting erros	2023-11-25 14:14:46 -08:00
Krrish Dholakia	a070bee5be	fix(utils.py): fix linting issues	2023-11-25 14:11:40 -08:00
Krrish Dholakia	8970f12780	fix(utils.py): fix linting issues	2023-11-25 13:48:50 -08:00
Krrish Dholakia	6d9f7b8f9d	fix: fix nlp cloud streaming	2023-11-25 13:45:23 -08:00
ishaan-jaff	a688df79b1	(feat) proxy: make chat/completions async	2023-11-25 12:54:03 -08:00
Krrish Dholakia	30f47d3169	bump: version 1.7.0 → 1.7.1	2023-11-25 12:34:28 -08:00
Krrish Dholakia	620633ec28	fix(openai.py): fix linting issues	2023-11-25 12:21:29 -08:00
Krrish Dholakia	69a3b6b8cf	docs(simple_proxy.md): improve loading key from vault example	2023-11-25 12:18:35 -08:00