phoenix-oss/llama-stack-mirror
0
0
Fork 1
mirror of https://github.com/meta-llama/llama-stack.git synced 2025-12-23 23:01:51 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions

feat: pre-commit result

Browse source
This commit is contained in:
Young Han 2025-07-14 14:32:58 -07:00
parent f65a260cdd
commit b884bc490b
10 changed files with 286 additions and 288 deletions
Download patch file Download diff file Expand all files Collapse all files

2
docs/source/distributions/self_hosted_distro/llamacpp.md
View file

@ -33,7 +33,7 @@ Set these environment variables before running Llama Stack:
```bash
export LLAMACPP_URL=http://localhost:8080 # URL of your llama.cpp server (without /v1 suffix)
export INFERENCE_MODEL=your-model-name # Name/identifier without gguf extension
export LLAMACPP_API_KEY="YOUR_API_KEY" # API key (leave empty for local servers)
export LLAMACPP_API_KEY="YOUR_API_KEY" # API key (leave empty for local servers)
```
## Running Llama Stack

2
docs/source/providers/inference/remote_llamacpp.md
View file

@ -11,7 +11,7 @@
```yaml
openai_compat_api_base: ${env.LLAMACPP_URL:http://localhost:8080}/v1
api_key: ${env.LLAMACPP_API_KEY:}
api_key: ${env.LLAMACPP_API_KEY:=}
```