litellm-mirror/litellm/llms/base_llm
Krish Dholakia 5f8859eda8 Fix anthropic thinking + response_format (#9594)
* fix(anthropic/chat/transformation.py): Don't set tool choice on response_format conversion when thinking is enabled

Not allowed by Anthropic

Fixes https://github.com/BerriAI/litellm/issues/8901

* refactor: move test to base anthropic chat tests

ensures consistent behaviour across vertex/anthropic/bedrock

* fix(anthropic/chat/transformation.py): if thinking token is specified and max tokens is not - ensure max token to anthropic is higher than thinking tokens

* feat(converse_transformation.py): correctly handle thinking + response format on Bedrock Converse

Fixes https://github.com/BerriAI/litellm/issues/8901

* fix(converse_transformation.py): correctly handle adding max tokens

* test: handle service unavailable error
2025-03-28 15:57:40 -07:00
..
anthropic_messages (Refactor) /v1/messages to follow simpler logic for Anthropic API spec (#9013) 2025-03-06 00:43:08 -08:00
audio_transcription Add OpenAI gpt-4o-transcribe support (#9517) 2025-03-26 23:10:25 -07:00
chat Fix anthropic thinking + response_format (#9594) 2025-03-28 15:57:40 -07:00
completion refactor: update method signature 2025-03-12 15:23:38 -07:00
embedding refactor: update method signature 2025-03-12 15:23:38 -07:00
image_variations refactor: update method signature 2025-03-12 15:23:38 -07:00
rerank Add cohere v2/rerank support (#8421) (#8605) 2025-02-22 22:25:29 -08:00
responses fix code quality checks 2025-03-20 13:57:35 -07:00
base_model_iterator.py Litellm dev 12 30 2024 p2 (#7495) 2025-01-01 18:57:29 -08:00
base_utils.py Support discovering gemini, anthropic, xai models by calling their /v1/model endpoint (#9530) 2025-03-27 22:50:48 -07:00