LiteLLM Minor Fixes & Improvements (11/29/2024) (#6965)

* fix(factory.py): ensure tool call converts image url Fixes https://github.com/BerriAI/litellm/issues/6953 * fix(transformation.py): support mp4 + pdf url's for vertex ai Fixes https://github.com/BerriAI/litellm/issues/6936 * fix(http_handler.py): mask gemini api key in error logs Fixes https://github.com/BerriAI/litellm/issues/6963 * docs(prometheus.md): update prometheus FAQs * feat(auth_checks.py): ensure specific model access > wildcard model access if wildcard model is in access group, but specific model is not - deny access * fix(auth_checks.py): handle auth checks for team based model access groups handles scenario where model access group used for wildcard models * fix(internal_user_endpoints.py): support adding guardrails on `/user/update` Fixes https://github.com/BerriAI/litellm/issues/6942 * fix(key_management_endpoints.py): fix prepare_metadata_fields helper * fix: fix tests * build(requirements.txt): bump openai dep version fixes proxies argument * test: fix tests * fix(http_handler.py): fix error message masking * fix(bedrock_guardrails.py): pass in prepped data * test: fix test * test: fix nvidia nim test * fix(http_handler.py): return original response headers * fix: revert maskedhttpstatuserror * test: update tests * test: cleanup test * fix(key_management_endpoints.py): fix metadata field update logic * fix(key_management_endpoints.py): maintain initial order of guardrails in key update * fix(key_management_endpoints.py): handle prepare metadata * fix: fix linting errors * fix: fix linting errors * fix: fix linting errors * fix: fix key management errors * fix(key_management_endpoints.py): update metadata * test: update test * refactor: add more debug statements * test: skip flaky test * test: fix test * fix: fix test * fix: fix update metadata logic * fix: fix test * ci(config.yml): change db url for e2e ui testing
2024-12-01 05:24:11 -08:00 · 2024-12-01 05:24:11 -08:00 · 859b47f08b
commit 859b47f08b
parent bd59f18809
37 changed files with 1040 additions and 714 deletions
--- a/tests/proxy_admin_ui_tests/test_key_management.py
+++ b/tests/proxy_admin_ui_tests/test_key_management.py
@ -693,3 +693,47 @@ def test_personal_key_generation_check():
            ),
            data=GenerateKeyRequest(),
        )
+
+
+def test_prepare_metadata_fields():
+    from litellm.proxy.management_endpoints.key_management_endpoints import (
+        prepare_metadata_fields,
+    )
+
+    new_metadata = {"test": "new"}
+    old_metadata = {"test": "test"}
+
+    args = {
+        "data": UpdateKeyRequest(
+            key_alias=None,
+            duration=None,
+            models=[],
+            spend=None,
+            max_budget=None,
+            user_id=None,
+            team_id=None,
+            max_parallel_requests=None,
+            metadata=new_metadata,
+            tpm_limit=None,
+            rpm_limit=None,
+            budget_duration=None,
+            allowed_cache_controls=[],
+            soft_budget=None,
+            config={},
+            permissions={},
+            model_max_budget={},
+            send_invite_email=None,
+            model_rpm_limit=None,
+            model_tpm_limit=None,
+            guardrails=None,
+            blocked=None,
+            aliases={},
+            key="sk-1qGQUJJTcljeaPfzgWRrXQ",
+            tags=None,
+        ),
+        "non_default_values": {"metadata": new_metadata},
+        "existing_metadata": {"tags": None, **old_metadata},
+    }
+
+    non_default_values = prepare_metadata_fields(**args)
+    assert non_default_values == {"metadata": new_metadata}