Krrish Dholakia
84f3ac7d25
fix: fix linting errors
2024-11-30 17:18:00 -08:00
Krrish Dholakia
ddf56b8935
fix: fix linting errors
2024-11-30 16:53:58 -08:00
Krrish Dholakia
433d7103cd
fix: fix linting errors
2024-11-30 16:48:50 -08:00
Krrish Dholakia
680701850f
fix(key_management_endpoints.py): handle prepare metadata
2024-11-30 15:59:39 -08:00
Krrish Dholakia
e93fc7c91a
fix(key_management_endpoints.py): maintain initial order of guardrails in key update
2024-11-30 14:09:33 -08:00
Krrish Dholakia
ec0f2abae2
fix(key_management_endpoints.py): fix metadata field update logic
2024-11-30 13:06:05 -08:00
Krrish Dholakia
b2abc61cc9
test: cleanup test
2024-11-30 12:54:42 -08:00
Krrish Dholakia
7bdc940588
test: update tests
2024-11-30 12:43:45 -08:00
Krrish Dholakia
d72407515c
fix: revert maskedhttpstatuserror
2024-11-30 12:24:45 -08:00
Krrish Dholakia
aee601d1d8
fix(http_handler.py): return original response headers
2024-11-30 01:54:49 -08:00
Krrish Dholakia
9c35a3b554
test: fix nvidia nim test
2024-11-30 01:10:37 -08:00
Krrish Dholakia
e90ff0f350
test: fix test
2024-11-30 00:45:26 -08:00
Krrish Dholakia
17b97cd930
fix(bedrock_guardrails.py): pass in prepped data
2024-11-30 00:36:47 -08:00
Krrish Dholakia
11c11f3724
fix(http_handler.py): fix error message masking
2024-11-30 00:18:03 -08:00
Krrish Dholakia
c6124984aa
test: fix tests
2024-11-29 21:23:00 -08:00
Krrish Dholakia
5d250ca19a
build(requirements.txt): bump openai dep version
...
fixes proxies argument
2024-11-29 21:11:12 -08:00
Krrish Dholakia
711a1428f8
fix: fix tests
2024-11-29 21:03:31 -08:00
Krrish Dholakia
204dd72c37
fix(key_management_endpoints.py): fix prepare_metadata_fields helper
2024-11-29 16:21:20 -08:00
Krrish Dholakia
a67dfa367e
fix(internal_user_endpoints.py): support adding guardrails on /user/update
...
Fixes https://github.com/BerriAI/litellm/issues/6942
2024-11-29 16:20:25 -08:00
Krrish Dholakia
aa1621757c
fix(auth_checks.py): handle auth checks for team based model access groups
...
handles scenario where model access group used for wildcard models
2024-11-29 16:02:05 -08:00
Krrish Dholakia
63a9666794
feat(auth_checks.py): ensure specific model access > wildcard model access
...
if wildcard model is in access group, but specific model is not - deny access
2024-11-29 15:37:16 -08:00
Krrish Dholakia
a014168c0c
docs(prometheus.md): update prometheus FAQs
2024-11-29 14:33:41 -08:00
Krrish Dholakia
a2dc3cec95
fix(http_handler.py): mask gemini api key in error logs
...
Fixes https://github.com/BerriAI/litellm/issues/6963
2024-11-29 14:25:00 -08:00
Krrish Dholakia
7624cc45e6
fix(transformation.py): support mp4 + pdf url's for vertex ai
...
Fixes https://github.com/BerriAI/litellm/issues/6936
2024-11-29 13:40:04 -08:00
Krrish Dholakia
828bf909fe
fix(factory.py): ensure tool call converts image url
...
Fixes https://github.com/BerriAI/litellm/issues/6953
2024-11-29 12:45:51 -08:00
Krish Dholakia
bd59f18809
fix(key_management_endpoints.py): support 'tags' param on /key/update ( #6945 )
2024-11-29 02:02:54 -08:00
Ishaan Jaff
05f810922c
(feat) Allow disabling ErrorLogs written to the DB ( #6940 )
...
* fix - allow disabling logging error logs
* docs on disabling error logs
* doc string for _PROXY_failure_handler
* test_disable_error_logs
* rename file
* fix rename file
* increase test coverage for test_enable_error_logs
2024-11-27 19:34:51 -08:00
Ishaan Jaff
0ac2d8b256
fix doc string
2024-11-27 18:55:06 -08:00
Ishaan Jaff
9393434d01
(fix) tag merging / aggregation logic ( #6932 )
...
* use 1 helper to merge tags + ensure unique ness
* test_add_litellm_data_to_request_duplicate_tags
* fix _merge_tags
* fix proxy utils test
2024-11-27 18:40:33 -08:00
Ishaan Jaff
d6181b2c9f
(feat) add enforcement for unique key aliases on /key/update and /key/generate ( #6944 )
...
* add enforcement for unique key aliases
* fix _enforce_unique_key_alias
* fix _enforce_unique_key_alias
* fix _enforce_unique_key_alias
* test_enforce_unique_key_alias
2024-11-27 18:40:21 -08:00
Ishaan Jaff
4ebb7c8a7f
(docs + fix) Add docs on Moderations endpoint, Text Completion ( #6947 )
...
* fix _pass_through_moderation_endpoint_factory
* fix route_llm_request
* doc moderations api
* docs on /moderations
* add e2e tests for moderations api
* docs moderations api
* test_pass_through_moderation_endpoint_factory
* docs text completion
2024-11-27 16:30:48 -08:00
Ishaan Jaff
eba700a491
Revert "Revert "(feat) Allow using include to include external YAML files in a config.yaml ( #6922 )""
...
This reverts commit 5d13302e6b
2024-11-27 16:08:59 -08:00
Ishaan Jaff
a8b8deb793
(fix) handle json decode errors for DD exception logging ( #6934 )
...
* fix JSONDecodeError
* handle async_log_proxy_authentication_errors
* fix test_async_log_proxy_authentication_errors_get_request
2024-11-27 14:48:54 -08:00
Ishaan Jaff
77f714dc51
(bug fix) /key/update was not storing budget_duration in the DB ( #6941 )
...
* fix - store budget_duration for keys
* test_generate_and_update_key
* test_update_user_unit_test
* fix user update
2024-11-27 14:48:01 -08:00
Sara Han
8af5b11f54
docs: update the docs ( #6923 )
2024-11-28 03:43:20 +05:30
Krish Dholakia
21156ff5d0
LiteLLM Minor Fixes & Improvements (11/27/2024) ( #6943 )
...
* fix(http_parsing_utils.py): remove `ast.literal_eval()` from http utils
Security fix - https://huntr.com/bounties/96a32812-213c-4819-ba4e-36143d35e95b?token=bf414bbd77f8b346556e
64ab2dd9301ea44339910877ea50401c76f977e36cdd78272f5fb4ca852a88a7e832828aae1192df98680544ee24aa98f3cf6980d8
bab641a66b7ccbc02c0e7d4ddba2db4dbe7318889dc0098d8db2d639f345f574159814627bb084563bad472e2f990f825bff0878a9
e281e72c88b4bc5884d637d186c0d67c9987c57c3f0caf395aff07b89ad2b7220d1dd7d1b427fd2260b5f01090efce5250f8b56ea2
c0ec19916c24b23825d85ce119911275944c840a1340d69e23ca6a462da610
* fix(converse/transformation.py): support bedrock apac cross region inference
Fixes https://github.com/BerriAI/litellm/issues/6905
* fix(user_api_key_auth.py): add auth check for websocket endpoint
Fixes https://github.com/BerriAI/litellm/issues/6926
* fix(user_api_key_auth.py): use `model` from query param
* fix: fix linting error
* test: run flaky tests first
2024-11-28 00:32:46 +05:30
Krish Dholakia
2d2931a215
LiteLLM Minor Fixes & Improvements (11/26/2024) ( #6913 )
...
* docs(config_settings.md): document all router_settings
* ci(config.yml): add router_settings doc test to ci/cd
* test: debug test on ci/cd
* test: debug ci/cd test
* test: fix test
* fix(team_endpoints.py): skip invalid team object. don't fail `/team/list` call
Causes downstream errors if ui just fails to load team list
* test(base_llm_unit_tests.py): add 'response_format={"type": "text"}' test to base_llm_unit_tests
adds complete coverage for all 'response_format' values to ci/cd
* feat(router.py): support wildcard routes in `get_router_model_info()`
Addresses https://github.com/BerriAI/litellm/issues/6914
* build(model_prices_and_context_window.json): add tpm/rpm limits for all gemini models
Allows for ratelimit tracking for gemini models even with wildcard routing enabled
Addresses https://github.com/BerriAI/litellm/issues/6914
* feat(router.py): add tpm/rpm tracking on success/failure to global_router
Addresses https://github.com/BerriAI/litellm/issues/6914
* feat(router.py): support wildcard routes on router.get_model_group_usage()
* fix(router.py): fix linting error
* fix(router.py): implement get_remaining_tokens_and_requests
Addresses https://github.com/BerriAI/litellm/issues/6914
* fix(router.py): fix linting errors
* test: fix test
* test: fix tests
* docs(config_settings.md): add missing dd env vars to docs
* fix(router.py): check if hidden params is dict
2024-11-28 00:01:38 +05:30
Ishaan Jaff
5d13302e6b
Revert "(feat) Allow using include to include external YAML files in a config.yaml ( #6922 )"
...
This reverts commit 68e59824a3
2024-11-27 10:17:09 -08:00
Krrish Dholakia
07223bdedf
bump: version 1.53.0 → 1.53.1
2024-11-27 12:53:32 +05:30
Krrish Dholakia
562e7defe6
build(ui/): update ui build
2024-11-27 12:53:19 +05:30
Ishaan Jaff
a6da3dea03
(feat) dd logger - set tags according to the values set by those env vars ( #6933 )
...
* dd logger, inherit from .envs
* test_datadog_payload_environment_variables
* fix _get_datadog_service
2024-11-26 22:08:04 -08:00
Ishaan Jaff
fe151db27c
bump: version 1.52.16 → 1.53.
2024-11-26 20:27:58 -08:00
Ishaan Jaff
68e59824a3
(feat) Allow using include to include external YAML files in a config.yaml ( #6922 )
...
* add helper to process inlcudes directive on yaml
* add doc on config management
* unit tests for `include` on config.yaml
2024-11-26 20:27:12 -08:00
Ishaan Jaff
4bc06392db
(feat) log proxy auth errors on datadog ( #6931 )
...
* add new dd type for auth errors
* add async_log_proxy_authentication_errors
* fix comment
* use async_log_proxy_authentication_errors
* test_datadog_post_call_failure_hook
* test_async_log_proxy_authentication_errors
2024-11-26 20:26:57 -08:00
Ishaan Jaff
aea68cbeb6
(feat) DataDog Logger - Add Failure logging + use Standard Logging payload ( #6929 )
...
* add async_log_failure_event for dd
* use standard logging payload for DD logging
* use standard logging payload for DD
* fix use SLP status
* allow opting into _create_v0_logging_payload
* add unit tests for DD logging payload
* fix dd logging tests
2024-11-26 19:27:06 -08:00
paul-gauthier
d84e355eab
sonnet supports pdf, haiku does not ( #6928 )
2024-11-26 19:06:17 -08:00
Ishaan Jaff
8fd3bf34d8
(feat) pass through llm endpoints - add PATCH support (vertex context caching requires for update ops) ( #6924 )
...
* add PATCH for pass through endpoints
* test_pass_through_routes_support_all_methods
2024-11-26 14:39:13 -08:00
Krish Dholakia
8673f2541e
fix(key_management_endpoints.py): fix user-membership check when creating team key ( #6890 )
...
* fix(key_management_endpoints.py): fix user-membership check when creating team key
* docs: add deprecation notice on original `/v1/messages` endpoint + add better swagger tags on pass-through endpoints
* fix(gemini/): fix image_url handling for gemini
Fixes https://github.com/BerriAI/litellm/issues/6897
* fix(teams.tsx): fix member add when role is 'user'
* fix(team_endpoints.py): /team/member_add
fix adding several new members to team
* test(test_vertex.py): remove redundant test
* test(test_proxy_server.py): fix team member add tests
2024-11-26 14:19:24 +05:30
Ishaan Jaff
dcea31e50a
run ci/cd again for new release
2024-11-26 00:26:27 -08:00
Krrish Dholakia
0b15662c6e
test: temporarily comment out doc test - fix ci/cd issue in separate pr
2024-11-26 13:52:40 +05:30
