Matthew Farrellee c2a9c65fff chore: update the vLLM inference impl to use OpenAIMixin for openai-compat functions ... inference recordings from Qwen3-0.6B and vLLM 0.8.3 - ``` docker run --gpus all -v ~/.cache/huggingface:/root/.cache/huggingface -p 8000:8000 --ipc=host \ vllm/vllm-openai:latest \ --model Qwen/Qwen3-0.6B --enable-auto-tool-choice --tool-call-parser hermes ``` test with - ``` ./scripts/integration-tests.sh --stack-config server:ci-tests --setup vllm --subdirs inference ```		2025-09-10 10:10:10 -04:00
..
responses	chore: update the vLLM inference impl to use OpenAIMixin for openai-compat functions	2025-09-10 10:10:10 -04:00
test.txt	feat(ci): add support for running vision inference tests (#2972)	2025-07-31 11:50:42 -07:00