Temporary Commit at 1/6/2025, 8:13:09 PM

Summary:
### THIS DIFF

### PLAN

### CONTEXT

### DESIGN

Test Plan:
# Test Setup

**Type checker and check that the build compiles**

**Unit Tests**

**E2E Tests**

// Screenshots and videos
| Before | After |
|--|
| … | … |

# Monitoring Plan.
This commit is contained in:
Sixian Yi 2025-01-06 20:13:10 -08:00
parent b719743be9
commit bf610adf9b
25 changed files with 305 additions and 3 deletions

View file

@ -0,0 +1,22 @@
inference_providers:
- ollama
- fireworks
- together
- tgi
- vllm
test_models:
text: meta-llama/Llama-3.1-8B-Instruct
vision: meta-llama/Llama-3.2-11B-Vision-Instruct
inference/test_vision_inference.py
test_vision_chat_completion_streaming
test_vision_chat_completion_non_streaming
inference/test_text_inference.py
test_structured_output
test_chat_completion_streaming
test_chat_completion_non_streaming
test_chat_completion_with_tool_calling
test_chat_completion_with_tool_calling_streaming