LiteLLM Minor Fixes & Improvements (2024/16/01) (#7826)

* fix(lm_studio/chat/transformation.py): Fix https://github.com/BerriAI/litellm/issues/7811

* fix(router.py): fix mock timeout check

* fix: drop model name from fallback args since it causes a conflict with the model=model that is provided later on. (#7806)

This error happens if you provide multiple fallback models to the completion function with model name defined in each one.

* fix(router.py): remove mock_timeout before sending to request

prevents reuse in fallbacks

* test: update test

* test: revert test change - wrong pr

---------

Co-authored-by: Dudu Lasry <david1542@users.noreply.github.com>
This commit is contained in:
Krish Dholakia 2025-01-17 20:59:21 -08:00 committed by GitHub
parent a2762fb273
commit 1bea338597
No known key found for this signature in database
GPG key ID: B5690EEEBB952194
7 changed files with 40 additions and 9 deletions

View file

@ -358,6 +358,7 @@ class OpenAIChatCompletion(BaseLLM):
organization=organization,
)
else:
_new_client = OpenAI(
api_key=api_key,
base_url=api_base,