phoenix-oss/llama-stack-mirror
0
0
Fork 1
mirror of https://github.com/meta-llama/llama-stack.git synced 2025-12-06 10:37:22 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions

fix: runpod provider no longer crashes sans API key (#4316)

Browse source 
# What does this PR do?
previously the runpod provider would fail if the
RUNPOD_API_TOKEN was not set

modify the impl to default to an empty string to
align with similar providers' behavior

Closes #4296

## Test Plan
Run `uv run llama stack run --providers inference=remote::runpod` with
`RUNPOD_API_TOKEN` unset - server now boots where it previously crashed
```
INFO     2025-12-04 13:52:59,920 uvicorn.error:84 uncategorized: Started server process [233656]                        
INFO     2025-12-04 13:52:59,921 uvicorn.error:48 uncategorized: Waiting for application startup.                       
INFO     2025-12-04 13:52:59,926 llama_stack.core.server.server:168 core::server: Starting up Llama Stack server        
         (version: 0.4.0.dev0)                                                                                          
INFO     2025-12-04 13:52:59,927 llama_stack.core.stack:495 core: starting registry refresh task                        
INFO     2025-12-04 13:52:59,928 uvicorn.error:62 uncategorized: Application startup complete.                          
INFO     2025-12-04 13:52:59,929 uvicorn.error:216 uncategorized: Uvicorn running on http://['::', '0.0.0.0']:8321      
         (Press CTRL+C to quit)
```

Signed-off-by: Nathan Weinberg <nweinber@redhat.com>
This commit is contained in:
Nathan Weinberg 2025-12-04 14:38:43 -05:00 • committed by GitHub
parent 8bbcfc4f56
commit f14936035d
No known key found for this signature in database
GPG key ID: B5690EEEBB952194
2 changed files with 2 additions and 2 deletions
Download patch file Download diff file Expand all files Collapse all files

2
docs/docs/providers/inference/remote_runpod.mdx
View file

@ -23,5 +23,5 @@ RunPod inference provider for running models on RunPod's cloud GPU platform.
```yaml
base_url: ${env.RUNPOD_URL:=}
api_token: ${env.RUNPOD_API_TOKEN}
api_token: ${env.RUNPOD_API_TOKEN:=}
```