3623 commits

Author	SHA1	Message	Date
Ishaan Jaff	c23cf18a70	Merge branch 'main' into litellm_add_bedrock_guardrails	2024-08-22 17:28:49 -07:00
Ishaan Jaff	550da1153e	test bedrock guardrails	2024-08-22 17:24:42 -07:00
Krrish Dholakia	b0706a6f8f	fix(proxy_server.py): expose flag to disable retries when max parallel request limit is hit	2024-08-22 16:49:52 -07:00
Krrish Dholakia	b95d4bb61a	fix(files_endpoints.py): fix multiple args error	2024-08-22 16:42:44 -07:00
Krrish Dholakia	73a5921262	feat(auth_checks.py): allow team to call all models, when explicitly set via /*	2024-08-22 16:38:56 -07:00
Ishaan Jaff	0a74738112	add async_post_call_success_hook	2024-08-22 16:34:43 -07:00
Krish Dholakia	e9928a01ad	Merge pull request #5325 from BerriAI/litellm_redis_cluster ... feat(caching.py): redis cluster support	2024-08-22 16:13:45 -07:00
Krrish Dholakia	b7f42c96a4	feat(azure.py): support health checking azure deployments ... Fixes https://github.com/BerriAI/litellm/issues/5279	2024-08-22 16:11:14 -07:00
Ishaan Jaff	2f01a22ef7	add bedrock guardrails support	2024-08-22 16:09:55 -07:00
Krrish Dholakia	5959cf0b50	fix: fix linting errors	2024-08-22 15:51:59 -07:00
Krrish Dholakia	f9ab33cbc2	feat(proxy_server.py): support azure batch api endpoints	2024-08-22 15:21:43 -07:00
Ishaan Jaff	c719c375f7	track litellm_request_latency_metric	2024-08-22 13:58:10 -07:00
Ishaan Jaff	b16752f0bc	add new litellm params for client_id, tenant_id etc	2024-08-22 11:37:30 -07:00
Krish Dholakia	f87f3987bd	Merge branch 'main' into litellm_redis_cluster	2024-08-22 11:06:14 -07:00
Ishaan Jaff	525d152d85	use azure_ad_token_provider to init clients	2024-08-22 11:03:49 -07:00
Ishaan Jaff	d2dd40e1d2	fix allow setting LiteLLM license as .env	2024-08-22 10:05:00 -07:00
Ishaan Jaff	468bf7c615	fix allow setting license in config.yaml	2024-08-22 09:45:15 -07:00
Ishaan Jaff	a067f0f926	add docstring for /embeddings and /completions	2024-08-22 09:30:47 -07:00
Ishaan Jaff	2caee891e0	add doc string for /chat/completions swagger	2024-08-22 09:27:40 -07:00
Ishaan Jaff	0de3f615ca	fix /user/delete doc string	2024-08-22 09:09:51 -07:00
Ishaan Jaff	b0b5400cde	fix team_member_add	2024-08-21 19:10:37 -07:00
Ishaan Jaff	5ffee5875c	fix test_master_key_hashing	2024-08-21 17:56:09 -07:00
Ishaan Jaff	2baa6eb5e1	use litellm proxy with vertex ai sdk	2024-08-21 17:47:01 -07:00
Ishaan Jaff	56057f278a	Merge branch 'main' into litellm_pass_through_vtx_multi_modal	2024-08-21 17:23:22 -07:00
Ishaan Jaff	c20cb7b586	fix pass through endpoints	2024-08-21 17:21:22 -07:00
Ishaan Jaff	bfb5136489	refactor vertex endpoints to pass through all routes	2024-08-21 17:08:42 -07:00
Ishaan Jaff	376165aa52	add test vtx embedding	2024-08-21 17:05:47 -07:00
Ishaan Jaff	152ebe2e7f	proxy - print embedding request when recieved	2024-08-21 17:00:18 -07:00
Krrish Dholakia	d6bc37374e	feat(litellm_logging.py): add 'saved_cache_cost' to standard logging payload (s3)	2024-08-21 16:58:07 -07:00
Krrish Dholakia	0707d8d815	docs(users.md): add doc on setting max budget for internal users	2024-08-21 16:21:40 -07:00
Krish Dholakia	3971880af4	Merge branch 'main' into litellm_disable_storing_master_key_hash_in_db	2024-08-21 15:37:25 -07:00
Krrish Dholakia	33c9c16388	feat(caching.py): redis cluster support ... Closes https://github.com/BerriAI/litellm/issues/4358	2024-08-21 15:01:52 -07:00
Krish Dholakia	a583b95d85	Merge pull request #5308 from BerriAI/litellm_team_admin_permissions ... feat(user_api_key_auth.py): allow team admin to add new members to team	2024-08-21 14:21:22 -07:00
Krrish Dholakia	ac5c6c8751	fix(litellm_pre_call_utils.py): handle dynamic keys via api correctly	2024-08-21 13:37:21 -07:00
Ishaan Jaff	b522ade709	docs semantic caching qdrant	2024-08-21 13:03:41 -07:00
Krrish Dholakia	35a9f328c7	fix(internal_user_endpoints.py): pass in user api key dict value	2024-08-21 12:46:43 -07:00
Ishaan Jaff	8c83fb3f34	fixes for using qdrant with litellm proxy	2024-08-21 12:36:41 -07:00
Krrish Dholakia	9f83724697	feat(proxy_server.py): support disabling storing master key hash in db, for spend tracking	2024-08-21 12:35:37 -07:00
Krrish Dholakia	748943f910	test(test_proxy_server.py): fix test to specify user role	2024-08-21 08:37:04 -07:00
Krrish Dholakia	7eb474b87c	feat(litellm_pre_call_utils.py): support passing tags/spend logs metadata from keys/team metadata to request	2024-08-21 08:13:36 -07:00
Ishaan Jaff	83fe4909f2	enforece guardrails per API Key as enterprise	2024-08-20 17:34:28 -07:00
Ishaan Jaff	5ad7da95b6	Merge pull request #5309 from BerriAI/litellm_new_guardrails_doc ... [Docs] - v2 Guardrails are now Free / Open Source	2024-08-20 17:29:28 -07:00
Ishaan Jaff	e8a803969a	fix lakera ai tests	2024-08-20 17:28:18 -07:00
Ishaan Jaff	2f0bd38f3a	support lakera ai category thresholds	2024-08-20 17:19:24 -07:00
Krrish Dholakia	e32a68c94b	refactor(team_endpoints.py): refactor auth checks for team member endpoints to ui team admin to manage it	2024-08-20 16:57:18 -07:00
Ishaan Jaff	54cf835a51	docs move lakera to free	2024-08-20 16:38:37 -07:00
Ishaan Jaff	4a21434fc5	Merge pull request #5303 from BerriAI/litellm_make_lakera_free ... [Feat-Proxy] Make Guardrails Free / OSS - Lakera AI, Aporia AI 🛡️	2024-08-20 16:33:50 -07:00
Krrish Dholakia	c305eb3321	feat(_types.py): allow team admin to delete member from team	2024-08-20 16:25:13 -07:00
Krrish Dholakia	0af1d602ca	fix(litellm_pre_call_utils.py): only pass api_version if set	2024-08-20 16:00:46 -07:00
Ishaan Jaff	cdbd245c3d	working lakera ai during call hook	2024-08-20 14:39:04 -07:00