Matthew Farrellee c2a9c65fff chore: update the vLLM inference impl to use OpenAIMixin for openai-compat functions ... inference recordings from Qwen3-0.6B and vLLM 0.8.3 - ``` docker run --gpus all -v ~/.cache/huggingface:/root/.cache/huggingface -p 8000:8000 --ipc=host \ vllm/vllm-openai:latest \ --model Qwen/Qwen3-0.6B --enable-auto-tool-choice --tool-call-parser hermes ``` test with - ``` ./scripts/integration-tests.sh --stack-config server:ci-tests --setup vllm --subdirs inference ```		2025-09-10 10:10:10 -04:00
..
__init__.py	chore: enable pyupgrade fixes (#1806)	2025-05-01 14:23:50 -07:00
embedding_mixin.py	fix: Make SentenceTransformer embedding operations non-blocking (#3335)	2025-09-04 13:58:41 -04:00
inference_store.py	chore(rename): move llama_stack.distribution to llama_stack.core (#2975)	2025-07-30 23:30:53 -07:00
litellm_openai_mixin.py	chore: indicate to mypy that InferenceProvider.batch_completion/batch_chat_completion is concrete (#3239)	2025-08-22 14:17:30 -07:00
model_registry.py	refactor(logging): rename llama_stack logger categories (#3065)	2025-08-21 17:31:04 -07:00
openai_compat.py	refactor(logging): rename llama_stack logger categories (#3065)	2025-08-21 17:31:04 -07:00
openai_mixin.py	chore: update the vLLM inference impl to use OpenAIMixin for openai-compat functions	2025-09-10 10:10:10 -04:00
prompt_adapter.py	refactor(logging): rename llama_stack logger categories (#3065)	2025-08-21 17:31:04 -07:00