3262 commits

Author	SHA1	Message	Date
Ishaan Jaff	e5b491b39f	Merge pull request #1413 from BerriAI/litellm_log_cache_hits ... [Feat] Proxy - Log Cache Hits on success callbacks + Testing	2024-01-11 16:39:22 +05:30
ishaan-jaff	1d9dad4af4	(feat) s3 logging - log cache hits	2024-01-11 15:57:54 +05:30
ishaan-jaff	4a1541c485	(fix) retry gemini-pro-vision 3 times	2024-01-11 14:39:08 +05:30
ishaan-jaff	f89385eed8	(fix) acompletion kwargs type hints	2024-01-11 14:22:37 +05:30
Krish Dholakia	40054f89b5	Merge pull request #1415 from BerriAI/litellm_bump_httpx_pool_limits ... fix(router.py): bump httpx pool limits	2024-01-11 13:46:31 +05:30
Krrish Dholakia	40c7400894	fix(router.py): bump httpx pool limits	2024-01-11 12:51:29 +05:30
ishaan-jaff	bd5a14daf6	(fix) acompletion typehints - pass kwargs	2024-01-11 11:49:55 +05:30
ishaan-jaff	cc78e003bf	(test) s3 log cache hits	2024-01-11 11:44:48 +05:30
ishaan-jaff	ce426f8b07	(fix) s3 log cache hits	2024-01-11 11:44:20 +05:30
ishaan-jaff	cf86af46a8	(fix) litellm.acompletion with type hints	2024-01-11 10:47:12 +05:30
Ishaan Jaff	2433d6c613	Merge pull request #1200 from MateoCamara/explicit-args-acomplete ... feat: added explicit args to acomplete	2024-01-11 10:39:05 +05:30
ishaan-jaff	0b20ab7d2b	(feat) proxy - support s3_callback_params	2024-01-11 09:57:47 +05:30
ishaan-jaff	f263cf51ea	(test) s3 logs for /chat/completions	2024-01-11 09:16:06 +05:30
ishaan-jaff	df0f689027	(test) s3 logging	2024-01-11 08:58:03 +05:30
ishaan-jaff	f61d8596e1	(fix) working s3 logging	2024-01-11 08:57:32 +05:30
ishaan-jaff	e04f76ad65	v0	2024-01-11 08:25:40 +05:30
Krrish Dholakia	65928cd5f2	test(test_tpm_rpm_routing.py): add more logging for the test	2024-01-11 00:43:14 +05:30
Krrish Dholakia	969594a4b1	test(test_router.py): handle rate limiting error	2024-01-11 00:00:17 +05:30
Krrish Dholakia	61f2fe5837	fix(main.py): fix streaming completion token counting error	2024-01-10 23:44:35 +05:30
Krrish Dholakia	3080f27b54	fix(utils.py): raise correct error for azure content blocked error	2024-01-10 23:31:51 +05:30
Krrish Dholakia	6a8d518e44	test(test_lowest_latency_routing.py): use the correct cache key	2024-01-10 22:15:01 +05:30
Krrish Dholakia	5bc44353e0	feat(proxy_cli.py): move print statements to show actually deployed port	2024-01-10 22:09:58 +05:30
ishaan-jaff	1ff9785c6b	(fix) test - moved to circe ci dockerfile	2024-01-10 21:54:13 +05:30
Krrish Dholakia	954d1b071c	test: remove invalid arg	2024-01-10 21:53:29 +05:30
Ishaan Jaff	58d0366447	Merge pull request #1399 from BerriAI/litellm_default_use_gunicorn ... LiteLLM Proxy - Use Gunicorn with Uvicorn workers	2024-01-10 21:46:04 +05:30
Krrish Dholakia	9a829ff956	refactor: cleanup duplicates	2024-01-10 21:42:20 +05:30
Krrish Dholakia	31917176ff	fix(lowest_latency.py): fix merge issue	2024-01-10 21:37:46 +05:30
Krish Dholakia	298e937586	Merge branch 'main' into litellm_latency_routing_updates	2024-01-10 21:33:54 +05:30
Krrish Dholakia	7f269e92c5	test(test_completion_with_retries.py): remove duplicate test	2024-01-10 21:17:30 +05:30
Krrish Dholakia	14a65eb730	test(test_proxy_server_keys.py): removing as this is now tested via the docker build job	2024-01-10 21:05:12 +05:30
Krrish Dholakia	162f6f1ed3	refactor: refactor key tests	2024-01-10 20:58:29 +05:30
Krrish Dholakia	0d86c4ce5b	refactor: move proxy server key testing	2024-01-10 20:56:52 +05:30
Krrish Dholakia	990c32a5d6	test(test_router.py): handle image gen timeouts	2024-01-10 20:56:52 +05:30
Krrish Dholakia	fe632c08a4	fix(router.py): allow user to control the latency routing time window	2024-01-10 20:56:52 +05:30
Krrish Dholakia	bb04a340a5	fix(lowest_latency.py): add back tpm/rpm checks, configurable time window	2024-01-10 20:52:01 +05:30
ishaan-jaff	4d8d58f0c9	(test) temp - comment out deployed proxy keygen test	2024-01-10 18:09:59 +05:30
Krrish Dholakia	b06d7f0cb6	build(config.yml): reintroduce mounting config.yaml	2024-01-10 18:03:57 +05:30
ishaan-jaff	2b9174c3d7	(feat) add comments on starting with gunicorn	2024-01-10 17:50:51 +05:30
ishaan-jaff	67dc9adc71	(fix) import gunicorn	2024-01-10 17:47:34 +05:30
ishaan-jaff	873965df22	(chore) remove old uvicorn logic	2024-01-10 17:39:05 +05:30
ishaan-jaff	5136d5980f	(fix) use gunicorn to start proxt	2024-01-10 17:09:03 +05:30
ishaan-jaff	c7fe33202d	v0	2024-01-10 16:29:38 +05:30
ishaan-jaff	f6012124b7	(fix) test for captured caplog	2024-01-10 13:17:34 +05:30
ishaan-jaff	a064786f3d	(ci/cd) retry deployed proxy test 3 times	2024-01-10 13:10:16 +05:30
Krish Dholakia	de7d4e64a4	Merge pull request #1390 from Manouchehri/fix-json-caching-1 ... (caching) Fix incorrect usage of str, which created invalid JSON.	2024-01-10 12:21:25 +05:30
Krrish Dholakia	ebe752fb61	build(pyproject.toml): drop certifi dependency (unused)	2024-01-10 08:09:03 +05:30
David Manouchehri	8a07476524	(caching) Fix incorrect usage of str, which created invalid JSON.	2024-01-09 14:21:41 -05:00
Krrish Dholakia	befbcbb7ac	fix: fix linting issues	2024-01-09 22:55:18 +05:30
Krrish Dholakia	ba7026639d	fix: fix linting errors	2024-01-09 22:16:16 +05:30
Krrish Dholakia	35f9666dc2	feat(proxy_server.py): adds working dynamo db support for key gen	2024-01-09 18:23:34 +05:30