Matthew Farrellee c2a9c65fff chore: update the vLLM inference impl to use OpenAIMixin for openai-compat functions ... inference recordings from Qwen3-0.6B and vLLM 0.8.3 - ``` docker run --gpus all -v ~/.cache/huggingface:/root/.cache/huggingface -p 8000:8000 --ipc=host \ vllm/vllm-openai:latest \ --model Qwen/Qwen3-0.6B --enable-auto-tool-choice --tool-call-parser hermes ``` test with - ``` ./scripts/integration-tests.sh --stack-config server:ci-tests --setup vllm --subdirs inference ```		2025-09-10 10:10:10 -04:00
..
inline	feat: Add vector_db_id to chunk metadata (#3304)	2025-09-10 11:19:21 +02:00
registry	chore: update the vertexai inference impl to use openai-python for openai-compat functions (#3377)	2025-09-10 15:39:29 +02:00
remote	chore: update the vLLM inference impl to use OpenAIMixin for openai-compat functions	2025-09-10 10:10:10 -04:00
utils	chore: update the vLLM inference impl to use OpenAIMixin for openai-compat functions	2025-09-10 10:10:10 -04:00
__init__.py	API Updates (#73)	2024-09-17 19:51:35 -07:00
datatypes.py	feat: create unregister shield API endpoint in Llama Stack (#2853)	2025-08-05 07:33:46 -07:00