litellm-mirror/tests/litellm/llms/bedrock
Krish Dholakia 87733c8193
Fix anthropic prompt caching cost calc + trim logged message in db (#9838)
* fix(spend_tracking_utils.py): prevent logging entire mp4 files to db

Fixes https://github.com/BerriAI/litellm/issues/9732

* fix(anthropic/chat/transformation.py): Fix double counting cache creation input tokens

Fixes https://github.com/BerriAI/litellm/issues/9812

* refactor(anthropic/chat/transformation.py): refactor streaming to use same usage calculation block as non-streaming

reduce errors

* fix(bedrock/chat/converse_transformation.py): don't increment prompt tokens with cache_creation_input_tokens

* build: remove redisvl from requirements.txt (temporary)

* fix(spend_tracking_utils.py): handle circular references

* test: update code cov test

* test: update test
2025-04-09 21:26:43 -07:00
..
chat Fix anthropic prompt caching cost calc + trim logged message in db (#9838) 2025-04-09 21:26:43 -07:00
rerank Add cost tracking for rerank via bedrock (#8691) 2025-02-20 21:00:18 -08:00
test_base_aws_llm.py (Observability) - Add more detailed dd tracing on Proxy Auth, Bedrock Auth (#8693) 2025-02-20 18:00:41 -08:00
test_bedrock_common_utils.py fix(common_utils.py): handle cris only model 2025-03-18 23:35:43 -07:00