phoenix-oss/llama-stack-mirror
0
0
Fork 1
mirror of https://github.com/meta-llama/llama-stack.git synced 2025-12-27 06:48:05 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions
llama-stack-mirror/docs/source/providers/inference/remote_runpod.md
Sébastien Han e11c7595d3
docs: auto generated documentation for providers 
Simple approach to get some provider pages in the docs.

Add or update description fields in the provider configuration class
using Pydantic’s Field, ensuring these descriptions are clear and
complete, as they will be used to auto-generate provider documentation
via ./scripts/distro_codegen.py instead of editing the docs
manually.

Signed-off-by: Sébastien Han <seb@redhat.com>
2025-06-30 14:55:50 +02:00

474 B
Raw Blame History

remote::runpod

Description

RunPod inference provider for running models on RunPod's cloud GPU platform.

Configuration

Field Type Required Default Description
url str | None No The URL for the Runpod model serving endpoint
api_token str | None No The API token

Sample Configuration

url: ${env.RUNPOD_URL:+}
api_token: ${env.RUNPOD_API_TOKEN:+}