litellm-mirror/tests/llm_translation
Krish Dholakia 6eb2346fd6 QA: ensure all bedrock regional models have same supported_ as base + Anthropic nested pydantic object support (#7844)
* build: ensure all regional bedrock models have same supported values as base bedrock model

prevents drift

* test(base_llm_unit_tests.py): add testing for nested pydantic objects

* fix(test_utils.py): add test_get_potential_model_names

* fix(anthropic/chat/transformation.py): support nested pydantic objects

Fixes https://github.com/BerriAI/litellm/issues/7755
2025-01-17 19:49:12 -08:00
..
test_llm_response_utils LiteLLM Minor Fixes & Improvements (10/23/2024) (#6407) 2024-10-24 19:01:41 -07:00
base_audio_transcription_unit_tests.py Litellm dev 12 25 2025 p2 (#7420) 2024-12-25 18:35:34 -08:00
base_embedding_unit_tests.py Litellm dev 12 25 2025 p2 (#7420) 2024-12-25 18:35:34 -08:00
base_llm_unit_tests.py QA: ensure all bedrock regional models have same supported_ as base + Anthropic nested pydantic object support (#7844) 2025-01-17 19:49:12 -08:00
base_rerank_unit_tests.py LiteLLM Minor Fixes & Improvements (12/05/2024) (#7037) 2024-12-05 00:02:31 -08:00
conftest.py aiohttp_openai/ fixes - allow using aiohttp_openai/gpt-4o (#7598) 2025-01-06 21:39:11 -08:00
dog.wav (feat) Support audio param in responses streaming (#6312) 2024-10-18 19:16:14 +05:30
gettysburg.wav Litellm dev 12 25 2025 p2 (#7420) 2024-12-25 18:35:34 -08:00
Readme.md LiteLLM Minor Fixes & Improvements (11/29/2024) (#6965) 2024-12-01 05:24:11 -08:00
test_aiohttp_openai.py (proxy - RPS) - Get 2K RPS at 4 instances, minor fix aiohttp_openai/ (#7659) 2025-01-09 17:24:18 -08:00
test_anthropic_completion.py Litellm dev 01 07 2025 p2 (#7622) 2025-01-08 16:56:39 -08:00
test_anthropic_text_completion.py [Bug Fix]: ImportError: cannot import name 'T' from 're' (#7314) 2024-12-19 13:09:30 -08:00
test_aws_base_llm.py (fix) BaseAWSLLM - cache IAM role credentials when used (#7775) 2025-01-14 20:16:22 -08:00
test_azure_ai.py Litellm dev 12 30 2024 p2 (#7495) 2025-01-01 18:57:29 -08:00
test_azure_o1.py Litellm dev 12 30 2024 p1 (#7480) 2024-12-30 21:52:52 -08:00
test_azure_openai.py Support temporary budget increases on keys (#7754) 2025-01-14 17:03:11 -08:00
test_bedrock_completion.py Litellm dev 01 13 2025 p2 (#7758) 2025-01-14 17:04:01 -08:00
test_clarifai_completion.py (Refactor) Code Quality improvement - Use Common base handler for clarifai/ (#7125) 2024-12-09 21:04:48 -08:00
test_cloudflare.py (Refactor) Code Quality improvement - Use Common base handler for cloudflare/ provider (#7127) 2024-12-10 10:12:22 -08:00
test_cohere.py (Refactor) Code Quality improvement - use Common base handler for Cohere (#7117) 2024-12-09 17:45:29 -08:00
test_cohere_generate_api.py fix(acompletion): support fallbacks on acompletion (#7184) 2024-12-11 19:20:54 -08:00
test_convert_dict_to_image.py fix ImageObject conversion (#6584) 2024-11-04 15:46:43 -08:00
test_databricks.py Litellm dev 12 25 2024 p1 (#7411) 2024-12-25 17:36:30 -08:00
test_deepgram.py Litellm dev 12 28 2024 p3 (#7464) 2024-12-28 19:18:58 -08:00
test_deepseek_completion.py test_multilingual_requests deepseek 2024-12-03 20:40:02 -08:00
test_fireworks_ai_translation.py fireworks ai use llama-v3p1-8b-instruct 2025-01-16 21:28:44 -08:00
test_gemini.py LiteLLM Minor Fixes & Improvements (12/23/2024) - p3 (#7394) 2024-12-23 22:02:52 -08:00
test_gpt4o_audio.py fix(acompletion): support fallbacks on acompletion (#7184) 2024-12-11 19:20:54 -08:00
test_groq.py Litellm dev 11 21 2024 (#6837) 2024-11-22 01:53:52 +05:30
test_huggingface.py Litellm dev 12 25 2024 p1 (#7411) 2024-12-25 17:36:30 -08:00
test_infinity.py (feat) add infinity rerank models (#7321) 2024-12-19 18:30:28 -08:00
test_jina_ai.py Litellm 12 02 2024 (#6994) 2024-12-02 22:00:01 -08:00
test_max_completion_tokens.py Litellm dev 12 24 2024 p3 (#7403) 2024-12-24 18:07:53 -08:00
test_mistral_api.py test_multilingual_requests 2024-12-03 20:52:19 -08:00
test_nvidia_nim.py LiteLLM Minor Fixes & Improvements (11/29/2024) (#6965) 2024-12-01 05:24:11 -08:00
test_openai.py update tests 2025-01-06 22:36:00 -08:00
test_openai_o1.py test: override openai o1 prompt caching test - openai backend not caching right now 2024-12-24 16:49:48 -08:00
test_optional_params.py Litellm dev 01 2025 p4 (#7776) 2025-01-14 21:49:25 -08:00
test_prompt_caching.py (feat) openai prompt caching (non streaming) - add prompt_tokens_details in usage response (#6039) 2024-10-03 23:31:10 +05:30
test_prompt_factory.py Litellm dev 01 13 2025 p2 (#7758) 2025-01-14 17:04:01 -08:00
test_rerank.py test_rerank_response_assertions (#7476) 2024-12-30 10:12:56 -08:00
test_router_llm_translation_tests.py Litellm add router to base llm testing (#7202) 2024-12-13 19:16:28 -08:00
test_text_completion.py (fix) litellm.text_completion raises a non-blocking error on simple usage (#6546) 2024-11-04 15:47:48 -08:00
test_text_completion_unit_tests.py huggingface/mistralai/Mistral-7B-Instruct-v0.3 2025-01-13 18:42:36 -08:00
test_together_ai.py LiteLLM Minor Fixes & Improvements (12/05/2024) (#7037) 2024-12-05 00:02:31 -08:00
test_triton.py [Bug fix ]: Triton /infer handler incompatible with batch responses (#7337) 2024-12-20 20:59:40 -08:00
test_vertex.py fix(vertex_ai/gemini/transformation.py): handle 'http://' in gemini p… (#7660) 2025-01-10 07:31:59 -08:00
test_voyage_ai.py (fix) unable to pass input_type parameter to Voyage AI embedding mode (#7276) 2024-12-17 19:23:49 -08:00
test_watsonx.py test_watsonx_token_in_env_var 2025-01-16 22:28:37 -08:00
test_xai.py test commit on main 2025-01-16 20:52:55 -08:00

Unit tests for individual LLM providers.

Name of the test file is the name of the LLM provider - e.g. test_openai.py is for OpenAI.