llama-stack-mirror/docs/source/distributions/self_hosted_distro
Yuan Tang f5a5c5d459
docs: Add instruction on enabling tool calling for remote vLLM (#1719)
# What does this PR do?

This PR adds a link to tool calling instructions in vLLM. Users have
asked about this many times, e.g.
https://github.com/meta-llama/llama-stack/issues/1648#issuecomment-2740642077

---------

Signed-off-by: Yuan Tang <terrytangyuan@gmail.com>
2025-03-20 15:18:17 -07:00
..
bedrock.md fix: register provider model name and HF alias in run.yaml (#1304) 2025-02-27 16:39:23 -08:00
cerebras.md fix: register provider model name and HF alias in run.yaml (#1304) 2025-02-27 16:39:23 -08:00
dell-tgi.md Update default port from 5000 -> 8321 2025-01-16 15:26:48 -08:00
dell.md chore: move embedding deps to RAG tool where they are needed (#1210) 2025-02-21 11:33:41 -08:00
fireworks.md fix: remove Llama-3.2-1B-Instruct for fireworks (#1558) 2025-03-11 11:19:29 -07:00
groq.md fix: register provider model name and HF alias in run.yaml (#1304) 2025-02-27 16:39:23 -08:00
meta-reference-gpu.md docs: update the downloaded list doc (#1266) 2025-02-28 10:10:12 -08:00
meta-reference-quantized-gpu.md docs: update the downloaded list doc (#1266) 2025-02-28 10:10:12 -08:00
nvidia.md add nvidia distribution (#565) 2025-01-15 14:04:43 -08:00
ollama.md fix: revert to using faiss for ollama distro (#1530) 2025-03-10 16:15:17 -07:00
passthrough.md fix: passthrough provider template + fix (#1612) 2025-03-13 09:44:26 -07:00
remote-vllm.md docs: Add instruction on enabling tool calling for remote vLLM (#1719) 2025-03-20 15:18:17 -07:00
sambanova.md fix: register provider model name and HF alias in run.yaml (#1304) 2025-02-27 16:39:23 -08:00
tgi.md docs: fix typo (#1390) 2025-03-04 09:02:55 -08:00
together.md refactor(test): move tools, evals, datasetio, scoring and post training tests (#1401) 2025-03-04 14:53:47 -08:00