4484 commits

Author	SHA1	Message	Date
Rena Lu	e011f8022a	update private async	2024-02-13 18:33:52 +00:00
Krrish Dholakia	f09c09ace4	docs(pii_masking.md): fix presidio tutorial	2024-02-13 07:42:27 -08:00
ishaan-jaff	d95eb6ca43	(ci/cd) run again	2024-02-13 07:08:26 -08:00
ishaan-jaff	b2d861fa11	(fix) langfuse logging	2024-02-13 07:02:58 -08:00
Krrish Dholakia	afad40b4f8	fix(utils.py): fix streaming rule calling	2024-02-12 22:36:32 -08:00
Krrish Dholakia	3b1cef3e96	refactor(main.py): trigger rebuild	2024-02-12 22:32:36 -08:00
Krrish Dholakia	81bbabdbcf	refactor(main.py): trigger rebuild	2024-02-12 22:26:57 -08:00
ishaan-jaff	899962a5f1	(ci/cd) run again	2024-02-12 22:20:42 -08:00
Krrish Dholakia	2f815705ca	fix(sagemaker.py): use __anext__	2024-02-12 22:13:35 -08:00
Krrish Dholakia	7600c8f41d	feat(utils.py): enable post call rules for streaming	2024-02-12 22:08:04 -08:00
ishaan-jaff	b0815e186b	(ci/cd) run again	2024-02-12 21:58:13 -08:00
ishaan-jaff	b954b56407	(test) bedrock proxy	2024-02-12 21:49:54 -08:00
ishaan-jaff	7aa1c8556d	(test) large request	2024-02-12 21:49:47 -08:00
ishaan-jaff	c7e4432597	(feat) inc default gunicorn timeout	2024-02-12 21:49:32 -08:00
ishaan-jaff	05a9ec2365	(ci/cd) run again	2024-02-12 21:46:48 -08:00
ishaan-jaff	7d27690203	(fix) use correct value for os.environ dynamo	2024-02-12 21:41:13 -08:00
Krrish Dholakia	b1bc30ee16	feat(sagemaker.py): aioboto3 streaming support	2024-02-12 21:18:34 -08:00
ishaan-jaff	c4038e38e5	(fix) dyanmo fixes	2024-02-12 19:54:39 -08:00
Ishaan Jaff	32d702cdd6	Merge pull request #1950 from BerriAI/litellm_ui_show_user_models_when_making_key ... [FEAT] UI show user available models when making a key	2024-02-12 19:09:25 -08:00
ishaan-jaff	79fcd75de6	(ui) update build	2024-02-12 18:53:43 -08:00
Krish Dholakia	c4c1703c44	Merge pull request #1946 from BerriAI/litellm_proxy_routing_fix ... Litellm proxy routing fix	2024-02-12 18:12:52 -08:00
Krrish Dholakia	460b48914e	feat(sagemaker.py): initial commit of working sagemaker with aioboto3	2024-02-12 17:25:57 -08:00
ishaan-jaff	2bdc5a81ec	(feat) ui - show user key when creating key	2024-02-12 16:55:34 -08:00
ishaan-jaff	211a1fcf53	(feat) /model/info add 3rd fallback	2024-02-12 16:40:41 -08:00
Krrish Dholakia	456ce692df	test(test_proxy_exception_mapping.py): fix test	2024-02-12 16:25:35 -08:00
ishaan-jaff	cd1416e39c	(feat) model/info have fallback check	2024-02-12 16:13:36 -08:00
ishaan-jaff	033c8d010c	(fix) allow ui to show /model/info	2024-02-12 15:42:42 -08:00
Rena Lu	60c0bec7b3	refactor to separate private mode with custom mode	2024-02-12 18:20:48 -05:00
Alexandre Sorokine	36360c62ac	Update utils.py: switched from pkg_resources to importlib.resources for filename stored in the os/environ(TIKTOKEN_CACHE_DIR)	2024-02-12 16:28:38 -05:00
Krrish Dholakia	1a452057af	fix(proxy_server.py): fix exception raising	2024-02-12 11:13:02 -08:00
deena	b640ec4dc0	support langfuse tags feature	2024-02-12 19:49:11 +02:00
Krrish Dholakia	8f989235ea	fix(proxy_server.py): restrict proxy to just listed models	2024-02-12 09:30:59 -08:00
Krrish Dholakia	5d59fa166c	test: api error handling	2024-02-12 09:11:46 -08:00
stephenleo	37c83e0023	fix latency calc (lower better)	2024-02-11 17:06:46 +08:00
Krish Dholakia	1391490d92	Merge pull request #1931 from BerriAI/litellm_microsoft_presidio_pii ... feat(proxy_server.py): support for pii masking with microsoft presidio	2024-02-11 00:27:14 -08:00
Ishaan Jaff	1cb8d2d3a3	Merge pull request #1933 from BerriAI/litellm_team_specific_models ... [FEAT] Proxy - set team specific models	2024-02-10 21:40:13 -08:00
ishaan-jaff	7648aecf87	(fix) setting valid_models per team	2024-02-10 21:20:58 -08:00
ishaan-jaff	5ac5f6c53c	(feat)team-specific models	2024-02-10 21:13:39 -08:00
Krish Dholakia	a36aa6aa01	Merge pull request #1926 from BerriAI/litellm_ui_further_improvements ... Enable viewing key alias instead of hashed tokens	2024-02-10 20:52:23 -08:00
Krrish Dholakia	71f772d2f5	fix(proxy_server.py): support list as well as direct input for custom callbacks	2024-02-10 20:38:09 -08:00
Krrish Dholakia	72ec488461	fix(proxy_server.py): fix import	2024-02-10 20:31:54 -08:00
Krrish Dholakia	2d845b12ed	feat(proxy_server.py): support for pii masking with microsoft presidio	2024-02-10 20:21:12 -08:00
ishaan-jaff	afd0d7cb41	(fix) undo today's mistake where bedrock was async	2024-02-10 18:32:29 -08:00
ishaan-jaff	18e73ec03d	(feat) litellm set ssl_certificates	2024-02-10 17:52:47 -08:00
Krrish Dholakia	7e2e545bed	fix(proxy_server.py): don't change old /key/info endpoint	2024-02-10 17:31:23 -08:00
Krrish Dholakia	f4dc643b1c	test(test_key_generate_prisma.py): fix test import	2024-02-10 16:16:12 -08:00
Krrish Dholakia	34c118e5e9	feat(ui): show key alias instead of hashed token	2024-02-10 15:45:42 -08:00
Krrish Dholakia	6b83001459	feat(proxy_server.py): support key lists for /key/info	2024-02-10 14:24:12 -08:00
ishaan-jaff	757334c85f	(fix) proxy - use bedrock in sync streaming	2024-02-10 09:47:33 -08:00
Krrish Dholakia	7409460230	fix(ui): export ui npm build	2024-02-10 08:43:41 -08:00