litellm-mirror/litellm/types
Krish Dholakia 252c10ad08 Support caching on reasoning content + other fixes (#8973)
* fix(factory.py): pass on anthropic thinking content from assistant call

* fix(factory.py): fix anthropic messages to handle thinking blocks

Fixes https://github.com/BerriAI/litellm/issues/8961

* fix(factory.py): fix bedrock handling for assistant content in messages

Fixes https://github.com/BerriAI/litellm/issues/8961

* feat(convert_dict_to_response.py): handle reasoning content + thinking blocks in chat completion block

ensures caching works for anthropic thinking block

* fix(convert_dict_to_response.py): pass all message params to delta block

ensures streaming delta also contains the reasoning content / thinking block

* test(test_prompt_factory.py): remove redundant test

anthropic now supports assistant as the first message

* fix(factory.py): fix linting errors

* fix: fix code qa

* test: remove falsy test

* fix(litellm_logging.py): fix str conversion
2025-03-04 21:12:16 -08:00
..
integrations Support arize phoenix on litellm proxy (#7756) (#8715) 2025-02-22 20:55:11 -08:00
llms Support caching on reasoning content + other fixes (#8973) 2025-03-04 21:12:16 -08:00
passthrough_endpoints vertex ai anthropic thinking param support (#8853) 2025-02-26 21:37:18 -08:00
adapter.py feat(anthropic_adapter.py): support for translating anthropic params to openai format 2024-07-10 00:32:28 -07:00
caching.py (Bug fix) - Cache Health not working when configured with prometheus service logger (#8687) 2025-02-20 13:41:56 -08:00
completion.py LiteLLM Minor Fixes and Improvements (09/12/2024) (#5658) 2024-09-12 23:04:06 -07:00
embedding.py Removed config dict type definition 2024-05-17 10:39:00 +08:00
files.py LiteLLM Contributor PRs (02/18/2025). (#8643) 2025-02-19 21:52:46 -08:00
fine_tuning.py (feat) POST /fine_tuning/jobs support passing vertex specific hyper params (#7490) 2025-01-01 07:44:48 -08:00
guardrails.py test: update test 2025-02-10 22:13:58 -08:00
rerank.py Add cohere v2/rerank support (#8421) (#8605) 2025-02-22 22:25:29 -08:00
router.py vertex ai anthropic thinking param support (#8853) 2025-02-26 21:37:18 -08:00
services.py (Bug Fix + Better Observability) - BudgetResetJob: (#8562) 2025-02-15 16:13:08 -08:00
utils.py Revert "(bug fix) - don't log messages, prompt, input in model_parameters in StandardLoggingPayload (#8923)" 2025-03-01 11:05:33 -08:00