Krrish Dholakia
9351b45d0c
fix: fix linting errors
2025-03-11 18:49:55 -07:00
Krrish Dholakia
42af49cd87
fix: fix merge conflicts
2025-03-11 18:41:41 -07:00
Krish Dholakia
8dea6e91a6
Merge branch 'litellm_dev_03_10_2025_p3' into litellm_router_client_init_migration
2025-03-11 18:27:56 -07:00
Krrish Dholakia
e4fc6422e2
fix: fix max parallel requests client
2025-03-11 18:25:48 -07:00
Krrish Dholakia
2469072c50
fix: remove unused imports
2025-03-11 18:15:10 -07:00
Krrish Dholakia
69839b3720
refactor(azure/common_utils.py): refactor azure client param logic
...
create common util for azure client param logic
2025-03-11 12:14:50 -07:00
Krrish Dholakia
8845f0947d
fix(client_initialization_utils.py): refactor azure client init logic
2025-03-11 09:00:12 -07:00
Krish Dholakia
65ef65d360
feat: prioritize api_key over tenant_id for more Azure AD token provi… ( #8701 )
...
* feat: prioritize api_key over tenant_id for more Azure AD token provider (#8318 )
* fix: prioritize api_key over tenant_id for Azure AD token provider
* test: Add test for Azure AD token provider in router
* fix: fix linting error
---------
Co-authored-by: you-n-g <you-n-g@users.noreply.github.com>
2025-03-09 18:59:37 -07:00
Ishaan Jaff
38bfefa6ef
(Feat) - LiteLLM Use UsernamePasswordCredential for Azure OpenAI ( #7496 )
...
* add get_azure_ad_token_from_username_password
* docs azure use username / password for auth
* update doc
* get_azure_ad_token_from_username_password
* test test_get_azure_ad_token_from_username_password
2025-01-01 14:11:27 -08:00
Ishaan Jaff
c7f14e936a
(code quality) run ruff rule to ban unused imports ( #7313 )
...
* remove unused imports
* fix AmazonConverseConfig
* fix test
* fix import
* ruff check fixes
* test fixes
* fix testing
* fix imports
2024-12-19 12:33:42 -08:00
Ishaan Jaff
3c984ed60e
(feat) Add Azure Blob Storage Logging Integration ( #7265 )
...
* add path to http handler
* AzureBlobStorageLogger
* test_azure_blob_storage
* use constants for Azure storage
* use helper get_azure_ad_token_from_entrata_id
* azure blob storage support
* get_azure_ad_token_from_azure_storage
* fix import
* azure logging
* docs azure storage
* add docs on azure blobs
* add premium user check
* add azure_storage as identified logging callback
* async_upload_payload_to_azure_blob_storage
* docs azure storage
* callback_class_str_to_classType
2024-12-16 22:18:22 -08:00
Ishaan Jaff
36e99ebce7
fix use consistent naming ( #7092 )
Read Version from pyproject.toml / read-version (push) Successful in 11s
2024-12-07 22:01:00 -08:00
Ishaan Jaff
17e81d861c
(refactor) router - use static methods for client init utils ( #6420 )
...
* use InitalizeOpenAISDKClient
* use InitalizeOpenAISDKClient static method
* fix # noqa: PLR0915
2024-10-24 19:26:46 +04:00
Ishaan Jaff
d063086bbf
Revert "(refactor) litellm.Router client initialization utils ( #6394 )" ( #6403 )
...
This reverts commit b70147f63b
2024-10-23 20:31:57 +05:30
Ishaan Jaff
b70147f63b
(refactor) litellm.Router client initialization utils ( #6394 )
...
* refactor InitalizeOpenAISDKClient
* use helper func for _should_create_openai_sdk_client_for_model
* use static methods for set client on litellm router
* reduce LOC in _get_client_initialization_params
* fix _should_create_openai_sdk_client_for_model
* code quality fix
* test test_should_create_openai_sdk_client_for_model
* test test_get_client_initialization_params_openai
* fix mypy linting errors
* fix OpenAISDKClientInitializationParams
* test_get_client_initialization_params_all_env_vars
* test_get_client_initialization_params_azure_ai_studio_mistral
* test_get_client_initialization_params_default_values
* fix _get_client_initialization_params
2024-10-23 17:33:19 +05:30
Ishaan Jaff
610974b4fc
(code quality) add ruff check PLR0915 for too-many-statements ( #6309 )
...
* ruff add PLR0915
* add noqa for PLR0915
* fix noqa
* add # noqa: PLR0915
* # noqa: PLR0915
* # noqa: PLR0915
* # noqa: PLR0915
* add # noqa: PLR0915
* # noqa: PLR0915
* # noqa: PLR0915
* # noqa: PLR0915
* # noqa: PLR0915
2024-10-18 15:36:49 +05:30
Krish Dholakia
fac3b2ee42
Add pyright to ci/cd + Fix remaining type-checking errors ( #6082 )
...
* fix: fix type-checking errors
* fix: fix additional type-checking errors
* fix: additional type-checking error fixes
* fix: fix additional type-checking errors
* fix: additional type-check fixes
* fix: fix all type-checking errors + add pyright to ci/cd
* fix: fix incorrect import
* ci(config.yml): use mypy on ci/cd
* fix: fix type-checking errors in utils.py
* fix: fix all type-checking errors on main.py
* fix: fix mypy linting errors
* fix(anthropic/cost_calculator.py): fix linting errors
* fix: fix mypy linting errors
* fix: fix linting errors
2024-10-05 17:04:00 -04:00
Ishaan Jaff
25887c1846
fix import error
2024-09-05 10:09:44 -07:00
Ishaan Jaff
3c898e23ea
refactor secret managers
2024-09-03 10:58:02 -07:00
Krish Dholakia
02f288a8a3
Azure Service Principal with Secret authentication workflow. ( #5131 ) ( #5437 )
...
* Azure Service Principal with Secret authentication workflow. (#5131 )
* Implement Azure Service Principal with Secret authentication workflow.
* Use `ClientSecretCredential` instead of `DefaultAzureCredential`.
* Move imports into the function.
* Add type hint for `azure_ad_token_provider`.
* Add unit test for router initialization and sample completion using Azure Service Principal with Secret authentication workflow.
* Add unit test for router initialization with neither API key nor using Azure Service Principal with Secret authentication workflow.
* fix(client_initializtion_utils.py): fix typing + overrides
* test: fix linting errors
* fix(client_initialization_utils.py): fix client init azure ad token logic
* fix(router_client_initialization.py): add flag check for reading azure ad token from environment
* test(test_streaming.py): skip end of life bedrock model
* test(test_router_client_init.py): add correct flag to test
---------
Co-authored-by: kzych-inpost <142029278+kzych-inpost@users.noreply.github.com>
2024-09-02 14:29:00 -07:00
Ishaan Jaff
f13a65be2d
fix azure_ad_token_provider
2024-08-22 16:15:53 -07:00
Ishaan Jaff
08fa3f346a
add new litellm params for client_id, tenant_id etc
2024-08-22 11:37:30 -07:00
Ishaan Jaff
8f657b40f5
use azure_ad_token_provider to init clients
2024-08-22 11:03:49 -07:00
Marc Abramowitz
ac9aa1ab67
Use AZURE_API_VERSION as default azure openai version
...
Without this change, the default version of the Azure OpenAI API is hardcoded in
the code as an old version, `"2024-02-01"`. This change allows the user to set
the default version of the Azure OpenAI API by setting the environment variable
`AZURE_API_VERSION` or by using the command-line parameter `--api_version`.
2024-08-14 15:47:57 -07:00
Ishaan Jaff
9a545c1ff8
Revert "[Ui] add together AI, Mistral, PerplexityAI, OpenRouter models on Admin UI "
2024-07-20 19:04:22 -07:00
Ishaan Jaff
3708355f91
router fix init openai compatible providers
2024-07-19 19:42:04 -07:00
Krrish Dholakia
0710c167ab
fix(client_initialization_utils.py): fix import logic
2024-07-06 19:28:38 -07:00
Krrish Dholakia
14ab1e5d2d
fix(client_initialization_utils.py): fix merge conflicts
2024-07-06 19:20:28 -07:00
Ishaan Jaff
984cc4722e
fix should_initialize_sync_client
2024-07-06 13:10:22 -07:00
Ishaan Jaff
2609de43d0
use helper for init client + check if we should init sync clients
2024-07-06 12:52:41 -07:00
