Ishaan Jaff
164017119d
[Bug Fix] Timestamp Granularities are not properly passed to whisper in Azure ( #10299 )
...
Read Version from pyproject.toml / read-version (push) Successful in 23s
Helm unit test / unit-test (push) Successful in 29s
* test fix form data parsing
* test fix form data parsing
* fix types
2025-04-24 18:57:11 -07:00
Krish Dholakia
f2a7edaddc
fix(proxy_server.py): Fix "Circular reference detected" error when max_parallel_requests = 0 ( #9671 )
...
* fix(proxy_server.py): remove non-functional parent backoff/retry on /chat/completion
Causes circular reference error
* fix(http_parsing_utils.py): safely return parsed body - don't allow mutation of cached request body by client functions
Root cause fix for circular reference error
* Revert "fix: Anthropic prompt caching on GCP Vertex AI (#9605 )" (#9670 )
This reverts commit a8673246dc
2025-03-31 22:06:02 -07:00
Krish Dholakia
9b7ebb6a7d
build(pyproject.toml): add new dev dependencies - for type checking ( #9631 )
...
* build(pyproject.toml): add new dev dependencies - for type checking
* build: reformat files to fit black
* ci: reformat to fit black
* ci(test-litellm.yml): make tests run clear
* build(pyproject.toml): add ruff
* fix: fix ruff checks
* build(mypy/): fix mypy linting errors
* fix(hashicorp_secret_manager.py): fix passing cert for tls auth
* build(mypy/): resolve all mypy errors
* test: update test
* fix: fix black formatting
* build(pre-commit-config.yaml): use poetry run black
* fix(proxy_server.py): fix linting error
* fix: fix ruff safe representation error
2025-03-29 11:02:13 -07:00
Krish Dholakia
8f86959c32
Litellm dev 02 27 2025 p6 ( #8891 )
...
Read Version from pyproject.toml / read-version (push) Successful in 13s
* fix(http_parsing_utils.py): orjson can throw errors on some emoji's in text, default to json.loads
* fix(sagemaker/handler.py): support passing model id on async streaming
* fix(litellm_pre_call_utils.py): Fixes https://github.com/BerriAI/litellm/issues/7237
2025-02-28 14:34:17 -08:00
Ishaan Jaff
c0aec0cc5d
(Bug fix) - reading /parsing request body when on hypercorn ( #8734 )
...
* _safe_get_request_parsed_body
* use scope on hypercorn
* test http parsing utils
* ci/cd run again
2025-02-25 15:18:04 -08:00
Ishaan Jaff
c8ac61f117
fix http parsing utils ( #7753 )
2025-01-13 19:58:26 -08:00
Ishaan Jaff
36c2883f6e
(proxy perf) - only read request body 1 time per request ( #7728 )
...
* req body
* fix linting
2025-01-12 22:00:59 -08:00
Ishaan Jaff
d4779deb0b
Revert "fix _read_request_body to re-use parsed body already ( #7722 )" ( #7724 )
...
Read Version from pyproject.toml / read-version (push) Successful in 11s
This reverts commit 95183f2103
2025-01-12 16:45:26 -08:00
Ishaan Jaff
95183f2103
fix _read_request_body to re-use parsed body already ( #7722 )
2025-01-12 15:41:40 -08:00
Ishaan Jaff
7923cb1a64
fix _read_request_body ( #7706 )
2025-01-11 21:54:51 -08:00
Krish Dholakia
522da384b6
Litellm dev 12 20 2024 p3 ( #7339 )
...
* fix(proxy_track_cost_callback.py): log to db if only end user param given
* fix: allows for jwt-auth based end user id spend tracking to work
* fix(utils.py): fix 'get_end_user_id_for_cost_tracking' to use 'user_api_key_end_user_id'
more stable - works with jwt-auth based end user tracking as well
* test(test_jwt.py): add e2e unit test to confirm end user cost tracking works for spend logs
* test: update test to use end_user api key hash param
* fix(langfuse.py): support end user cost tracking via jwt auth + langfuse
logs end user to langfuse if decoded from jwt token
* fix: fix linting errors
* test: fix test
* test: fix test
* fix: fix end user id extraction
* fix: run test earlier
2024-12-20 21:13:32 -08:00
Ishaan Jaff
c7f14e936a
(code quality) run ruff rule to ban unused imports ( #7313 )
...
* remove unused imports
* fix AmazonConverseConfig
* fix test
* fix import
* ruff check fixes
* test fixes
* fix testing
* fix imports
2024-12-19 12:33:42 -08:00
Ishaan Jaff
9432812c90
(proxy) - Auth fix, ensure re-using safe request body for checking model field ( #7222 )
...
* litellm fix auth check
* fix _read_request_body
* test_auth_with_form_data_and_model
* fix auth check
* fix _read_request_body
* fix _safe_get_request_headers
2024-12-14 12:01:25 -08:00
Krish Dholakia
21156ff5d0
LiteLLM Minor Fixes & Improvements (11/27/2024) ( #6943 )
...
* fix(http_parsing_utils.py): remove `ast.literal_eval()` from http utils
Security fix - https://huntr.com/bounties/96a32812-213c-4819-ba4e-36143d35e95b?token=bf414bbd77f8b346556e
64ab2dd9301ea44339910877ea50401c76f977e36cdd78272f5fb4ca852a88a7e832828aae1192df98680544ee24aa98f3cf6980d8
bab641a66b7ccbc02c0e7d4ddba2db4dbe7318889dc0098d8db2d639f345f574159814627bb084563bad472e2f990f825bff0878a9
e281e72c88b4bc5884d637d186c0d67c9987c57c3f0caf395aff07b89ad2b7220d1dd7d1b427fd2260b5f01090efce5250f8b56ea2
c0ec19916c24b23825d85ce119911275944c840a1340d69e23ca6a462da610
* fix(converse/transformation.py): support bedrock apac cross region inference
Fixes https://github.com/BerriAI/litellm/issues/6905
* fix(user_api_key_auth.py): add auth check for websocket endpoint
Fixes https://github.com/BerriAI/litellm/issues/6926
* fix(user_api_key_auth.py): use `model` from query param
* fix: fix linting error
* test: run flaky tests first
2024-11-28 00:32:46 +05:30
Krish Dholakia
d57be47b0f
Litellm ruff linting enforcement ( #5992 )
...
* ci(config.yml): add a 'check_code_quality' step
Addresses https://github.com/BerriAI/litellm/issues/5991
* ci(config.yml): check why circle ci doesn't pick up this test
* ci(config.yml): fix to run 'check_code_quality' tests
* fix(__init__.py): fix unprotected import
* fix(__init__.py): don't remove unused imports
* build(ruff.toml): update ruff.toml to ignore unused imports
* fix: fix: ruff + pyright - fix linting + type-checking errors
* fix: fix linting errors
* fix(lago.py): fix module init error
* fix: fix linting errors
* ci(config.yml): cd into correct dir for checks
* fix(proxy_server.py): fix linting error
* fix(utils.py): fix bare except
causes ruff linting errors
* fix: ruff - fix remaining linting errors
* fix(clickhouse.py): use standard logging object
* fix(__init__.py): fix unprotected import
* fix: ruff - fix linting errors
* fix: fix linting errors
* ci(config.yml): cleanup code qa step (formatting handled in local_testing)
* fix(_health_endpoints.py): fix ruff linting errors
* ci(config.yml): just use ruff in check_code_quality pipeline for now
* build(custom_guardrail.py): include missing file
* style(embedding_handler.py): fix ruff check
2024-10-01 19:44:20 -04:00
Ishaan Jaff
b2fcf65653
log file_size_in_mb in metadata
2024-07-29 08:00:28 -07:00
Ishaan Jaff
0184735d3d
fix set default value for max_file_size_mb
2024-07-16 20:34:56 -07:00
Ishaan Jaff
bac6685bfc
fix linting
2024-07-15 20:02:41 -07:00
Ishaan Jaff
38cef1c58d
fix error from max file size
2024-07-15 19:57:33 -07:00
Ishaan Jaff
6c060b1fdc
check_file_size_under_limit
2024-07-15 19:38:08 -07:00
Ishaan Jaff
427f2ee1fa
feat - otel log /team exceptions
2024-06-11 16:27:07 -07:00
