Krish Dholakia
87733c8193
Fix anthropic prompt caching cost calc + trim logged message in db ( #9838 )
...
* fix(spend_tracking_utils.py): prevent logging entire mp4 files to db
Fixes https://github.com/BerriAI/litellm/issues/9732
* fix(anthropic/chat/transformation.py): Fix double counting cache creation input tokens
Fixes https://github.com/BerriAI/litellm/issues/9812
* refactor(anthropic/chat/transformation.py): refactor streaming to use same usage calculation block as non-streaming
reduce errors
* fix(bedrock/chat/converse_transformation.py): don't increment prompt tokens with cache_creation_input_tokens
* build: remove redisvl from requirements.txt (temporary)
* fix(spend_tracking_utils.py): handle circular references
* test: update code cov test
* test: update test
2025-04-09 21:26:43 -07:00
Krish Dholakia
8e3c7b2de0
fix(vertex_ai.py): move to only passing in accepted keys by vertex ai response schema ( #8992 )
...
* fix(vertex_ai.py): common_utils.py
move to only passing in accepted keys by vertex ai
prevent json schema compatible keys like $id, and $comment from causing vertex ai openapi calls to fail
* fix(test_vertex.py): add testing to ensure only accepted schema params passed in
* fix(common_utils.py): fix linting error
* test: update test
* test: accept function
2025-04-07 18:07:01 -07:00
Nicholas Grabar
1f2bbda11d
Add recursion depth to convert_anyof_null_to_nullable, constants.py. Fix recursive_detector.py raise error state
2025-03-28 13:11:19 -07:00
Ishaan Jaff
fff15543d9
(UI + Proxy) Cache Health Check Page - Cleanup/Improvements ( #8665 )
...
Read Version from pyproject.toml / read-version (push) Successful in 14s
* fixes for redis cache ping serialization
* fix cache ping check
* fix cache health check ui
* working error details on ui
* ui expand / collapse error
* move cache health check to diff file
* fix displaying error from cache health check
* ui allow copying errors
* ui cache health fixes
* show redis details
* clean up cache health page
* ui polish fixes
* fix error handling on cache health page
* fix redis_cache_params on cache ping response
* error handling
* cache health ping response
* fx error response from cache ping
* parsedLitellmParams
* fix cache health check
* fix cache health page
* cache safely handle json dumps issues
* test caching routes
* test_primitive_types
* fix caching routes
* litellm_mapped_tests
* fix pytest-mock
* fix _serialize
* fix linting on safe dumps
* test_default_max_depth
* pip install "pytest-mock==3.12.0"
* litellm_mapped_tests_coverage
* add readme on new litellm test dir
2025-02-19 19:08:50 -08:00
Krish Dholakia
f651d51f26
Litellm dev 02 07 2025 p2 ( #8377 )
...
* fix(caching_routes.py): mask redis password on `/cache/ping` route
* fix(caching_routes.py): fix linting erro
* fix(caching_routes.py): fix linting error on caching routes
* fix: fix test - ignore mask_dict - has a breakpoint
* fix(azure.py): add timeout param + elapsed time in azure timeout error
* fix(http_handler.py): add elapsed time to http timeout request
makes it easier to debug how long request took before failing
2025-02-07 17:30:38 -08:00
Ishaan Jaff
53a3ea3d06
(Refactor) Langfuse - remove prepare_metadata, langfuse python SDK now handles non-json serializable objects ( #7925 )
...
* test_langfuse_logging_completion_with_langfuse_metadata
* fix litellm - remove prepare metadata
* test_langfuse_logging_with_non_serializable_metadata
* detailed e2e langfuse metadata tests
* clean up langfuse logging
* fix langfuse
* remove unused imports
* fix code qa checks
* fix _prepare_metadata
2025-01-22 22:11:40 -08:00
Ishaan Jaff
dd385410df
(Code quality) - Ban recursive functions in codebase ( #7910 )
...
* code qa add RecursiveFunctionFinder
* test_recursive_detector
* RecursiveFunctionFinder
* fix check
* recursive_detector
2025-01-21 20:33:32 -08:00
