litellm-mirror/tests/llm_translation
Ishaan Jaff 1b2ed0c344 [Bug fix ]: Triton /infer handler incompatible with batch responses (#7337)
* migrate triton to base llm http handler

* clean up triton handler.py

* use transform functions for triton

* add TritonConfig

* get openai params for triton

* use triton embedding config

* test_completion_triton_generate_api

* test_completion_triton_infer_api

* fix TritonConfig doc string

* use TritonResponseIterator

* fix triton embeddings

* docs triton chat usage
2024-12-20 20:59:40 -08:00
..
test_llm_response_utils LiteLLM Minor Fixes & Improvements (10/23/2024) (#6407) 2024-10-24 19:01:41 -07:00
base_embedding_unit_tests.py (fix) unable to pass input_type parameter to Voyage AI embedding mode (#7276) 2024-12-17 19:23:49 -08:00
base_llm_unit_tests.py o1 - add image param handling (#7312) 2024-12-19 11:22:25 -08:00
base_rerank_unit_tests.py LiteLLM Minor Fixes & Improvements (12/05/2024) (#7037) 2024-12-05 00:02:31 -08:00
conftest.py [Feat] Add max_completion_tokens param (#5691) 2024-09-14 14:57:01 -07:00
dog.wav (feat) Support audio param in responses streaming (#6312) 2024-10-18 19:16:14 +05:30
Readme.md LiteLLM Minor Fixes & Improvements (11/29/2024) (#6965) 2024-12-01 05:24:11 -08:00
test_anthropic_completion.py Litellm dev 12 12 2024 (#7203) 2024-12-13 08:54:03 -08:00
test_anthropic_text_completion.py [Bug Fix]: ImportError: cannot import name 'T' from 're' (#7314) 2024-12-19 13:09:30 -08:00
test_azure_ai.py LiteLLM Minor Fixes & Improvements (11/29/2024) (#6965) 2024-12-01 05:24:11 -08:00
test_azure_openai.py Litellm dev 12 12 2024 (#7203) 2024-12-13 08:54:03 -08:00
test_bedrock_completion.py Litellm dev 2024 12 19 p3 (#7322) 2024-12-20 13:30:16 -08:00
test_clarifai_completion.py (Refactor) Code Quality improvement - Use Common base handler for clarifai/ (#7125) 2024-12-09 21:04:48 -08:00
test_cloudflare.py (Refactor) Code Quality improvement - Use Common base handler for cloudflare/ provider (#7127) 2024-12-10 10:12:22 -08:00
test_cohere.py (Refactor) Code Quality improvement - use Common base handler for Cohere (#7117) 2024-12-09 17:45:29 -08:00
test_cohere_generate_api.py fix(acompletion): support fallbacks on acompletion (#7184) 2024-12-11 19:20:54 -08:00
test_convert_dict_to_image.py fix ImageObject conversion (#6584) 2024-11-04 15:46:43 -08:00
test_databricks.py feat(databricks/chat): support structured outputs on databricks 2024-12-02 23:08:19 -08:00
test_deepseek_completion.py test_multilingual_requests deepseek 2024-12-03 20:40:02 -08:00
test_fireworks_ai_translation.py refactor(fireworks_ai/): inherit from openai like base config (#7146) 2024-12-10 16:15:19 -08:00
test_gemini.py (Refactor) Code Quality improvement - remove /prompt_templates/ , base_aws_llm.py from /llms folder (#7164) 2024-12-11 00:02:46 -08:00
test_gpt4o_audio.py fix(acompletion): support fallbacks on acompletion (#7184) 2024-12-11 19:20:54 -08:00
test_groq.py Litellm dev 11 21 2024 (#6837) 2024-11-22 01:53:52 +05:30
test_infinity.py (feat) add infinity rerank models (#7321) 2024-12-19 18:30:28 -08:00
test_jina_ai.py Litellm 12 02 2024 (#6994) 2024-12-02 22:00:01 -08:00
test_max_completion_tokens.py build: Squashed commit of https://github.com/BerriAI/litellm/pull/7165 2024-12-11 01:00:33 -08:00
test_mistral_api.py test_multilingual_requests 2024-12-03 20:52:19 -08:00
test_nvidia_nim.py LiteLLM Minor Fixes & Improvements (11/29/2024) (#6965) 2024-12-01 05:24:11 -08:00
test_openai.py o1 - add image param handling (#7312) 2024-12-19 11:22:25 -08:00
test_openai_o1.py o1 - add image param handling (#7312) 2024-12-19 11:22:25 -08:00
test_optional_params.py Litellm dev 12 19 2024 p2 (#7315) 2024-12-19 20:28:16 -08:00
test_prompt_caching.py (feat) openai prompt caching (non streaming) - add prompt_tokens_details in usage response (#6039) 2024-10-03 23:31:10 +05:30
test_prompt_factory.py Code Quality Improvement - use vertex_ai/ as folder name for vertexAI (#7166) 2024-12-11 00:32:41 -08:00
test_rerank.py (code refactor) - Add BaseRerankConfig. Use BaseRerankConfig for cohere/rerank and azure_ai/rerank (#7319) 2024-12-19 17:03:34 -08:00
test_router_llm_translation_tests.py Litellm add router to base llm testing (#7202) 2024-12-13 19:16:28 -08:00
test_text_completion.py (fix) litellm.text_completion raises a non-blocking error on simple usage (#6546) 2024-11-04 15:47:48 -08:00
test_text_completion_unit_tests.py LiteLLM Minor Fixes & Improvements (11/29/2024) (#6965) 2024-12-01 05:24:11 -08:00
test_together_ai.py LiteLLM Minor Fixes & Improvements (12/05/2024) (#7037) 2024-12-05 00:02:31 -08:00
test_triton.py [Bug fix ]: Triton /infer handler incompatible with batch responses (#7337) 2024-12-20 20:59:40 -08:00
test_vertex.py LiteLLM Minor Fixes & Improvements (12/16/2024) - p1 (#7263) 2024-12-17 15:33:36 -08:00
test_voyage_ai.py (fix) unable to pass input_type parameter to Voyage AI embedding mode (#7276) 2024-12-17 19:23:49 -08:00
test_xai.py Litellm code qa common config (#7113) 2024-12-09 15:58:25 -08:00

Unit tests for individual LLM providers.

Name of the test file is the name of the LLM provider - e.g. test_openai.py is for OpenAI.