Litellm dev 12 25 2024 p1 (#7411)

* test(test_watsonx.py): e2e unit test for watsonx custom header

covers https://github.com/BerriAI/litellm/issues/7408

* fix(common_utils.py): handle auth token already present in headers (watsonx + openai-like base handler)

Fixes https://github.com/BerriAI/litellm/issues/7408

* fix(watsonx/chat): fix chat route

Fixes https://github.com/BerriAI/litellm/issues/7408

* fix(huggingface/chat/handler.py): fix huggingface async completion calls

* Correct handling of max_retries=0 to disable AzureOpenAI retries (#7379)

* test: fix test

---------

Co-authored-by: Minh Duc <phamminhduc0711@gmail.com>
This commit is contained in:
Krish Dholakia 2024-12-25 17:36:30 -08:00 committed by GitHub
parent 157810fcbf
commit 9237357bcc
No known key found for this signature in database
GPG key ID: B5690EEEBB952194
9 changed files with 299 additions and 14 deletions

View file

@ -43,7 +43,9 @@ class OpenAILikeBase:
"Content-Type": "application/json",
}
if api_key is not None:
if (
api_key is not None and "Authorization" not in headers
): # [TODO] remove 'validate_environment' from OpenAI base. should use llm providers config for this only.
headers.update({"Authorization": "Bearer {}".format(api_key)})
if not custom_endpoint: