phoenix-oss/llama-stack-mirror
0
0
Fork 1
mirror of https://github.com/meta-llama/llama-stack.git synced 2026-01-01 15:39:59 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions

fix vllm template

Browse source
This commit is contained in:
Xi Yan 2025-01-17 14:40:51 -08:00
parent 1f60c0286d
commit 8cf7f72116
6 changed files with 316 additions and 249 deletions
Download patch file Download diff file Expand all files Collapse all files

3
docs/source/distributions/self_hosted_distro/remote-vllm.md
View file

@ -14,9 +14,12 @@ The `llamastack/distribution-remote-vllm` distribution consists of the following
| API | Provider(s) |
|-----|-------------|
| agents | `inline::meta-reference` |
| datasetio | `remote::huggingface`, `inline::localfs` |
| eval | `inline::meta-reference` |
| inference | `remote::vllm` |
| memory | `inline::faiss`, `remote::chromadb`, `remote::pgvector` |
| safety | `inline::llama-guard` |
| scoring | `inline::basic`, `inline::llm-as-judge`, `inline::braintrust` |
| telemetry | `inline::meta-reference` |
| tool_runtime | `remote::brave-search`, `remote::tavily-search`, `inline::code-interpreter`, `inline::memory-runtime` |