phoenix/litellm
1
0
Fork 0
forked from phoenix/litellm-mirror
Code Pull requests Activity

(feat) add azure openai cost tracking for prompt caching (#6077)

Browse source 
* add azure o1 models to model cost map

* add azure o1 cost tracking

* fix azure cost calc

* add get llm provider test
This commit is contained in:
Ishaan Jaff 2024-10-05 15:04:18 +05:30 • committed by GitHub
parent 7267852511
commit ab0b536143
No known key found for this signature in database
GPG key ID: B5690EEEBB952194
4 changed files with 160 additions and 0 deletions
Download patch file Download diff file Expand all files Collapse all files

9
tests/local_testing/test_get_llm_provider.py
View file

@ -115,3 +115,12 @@ def test_get_llm_provider_cohere_chat_test2():
print("api_base=", api_base)
assert custom_llm_provider == "cohere_chat"
assert model == "command-r-plus"
def test_get_llm_provider_azure_o1():
model, custom_llm_provider, dynamic_api_key, api_base = litellm.get_llm_provider(
model="azure/o1-mini",
)
assert custom_llm_provider == "azure"
assert model == "o1-mini"