llama-stack-mirror/docs/source/distributions/self_hosted_distro
AlexHe99 983f6feeb8
docs: Update remote-vllm.md with AMD GPU vLLM server supported. (#1858)
Add the content to use AMD GPU as the vLLM server. Split the original
part to two sub chapters,
1. AMD vLLM server
2. NVIDIA vLLM server (orignal)

# What does this PR do?
[Provide a short summary of what this PR does and why. Link to relevant
issues if applicable.]

[//]: # (If resolving an issue, uncomment and update the line below)
[//]: # (Closes #[issue-number])

## Test Plan
[Describe the tests you ran to verify your changes with result
summaries. *Provide clear instructions so the plan can be easily
re-executed.*]

[//]: # (## Documentation)

---------

Signed-off-by: Alex He <alehe@amd.com>
2025-04-08 21:35:32 -07:00
..
bedrock.md fix: Default to port 8321 everywhere (#1734) 2025-03-20 15:50:41 -07:00
cerebras.md fix: Default to port 8321 everywhere (#1734) 2025-03-20 15:50:41 -07:00
dell-tgi.md fix: docker run with --pull always to fetch the latest image (#1733) 2025-03-20 15:35:48 -07:00
dell.md fix: docker run with --pull always to fetch the latest image (#1733) 2025-03-20 15:35:48 -07:00
fireworks.md test: verification on provider's OAI endpoints (#1893) 2025-04-07 23:06:28 -07:00
groq.md test: verification on provider's OAI endpoints (#1893) 2025-04-07 23:06:28 -07:00
meta-reference-gpu.md fix: Default to port 8321 everywhere (#1734) 2025-03-20 15:50:41 -07:00
meta-reference-quantized-gpu.md fix: Default to port 8321 everywhere (#1734) 2025-03-20 15:50:41 -07:00
nvidia.md fix: Default to port 8321 everywhere (#1734) 2025-03-20 15:50:41 -07:00
ollama.md fix: Default to port 8321 everywhere (#1734) 2025-03-20 15:50:41 -07:00
passthrough.md fix: Default to port 8321 everywhere (#1734) 2025-03-20 15:50:41 -07:00
remote-vllm.md docs: Update remote-vllm.md with AMD GPU vLLM server supported. (#1858) 2025-04-08 21:35:32 -07:00
sambanova.md test: verification on provider's OAI endpoints (#1893) 2025-04-07 23:06:28 -07:00
tgi.md fix: Default to port 8321 everywhere (#1734) 2025-03-20 15:50:41 -07:00
together.md test: verification on provider's OAI endpoints (#1893) 2025-04-07 23:06:28 -07:00