phoenix-oss/llama-stack-mirror
0
0
Fork 1
mirror of https://github.com/meta-llama/llama-stack.git synced 2025-10-09 05:08:37 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions

chore: use uvicorn to start llama stack server everywhere (#3625)
Some checks failed
SqlStore Integration Tests / test-postgres (3.12) (push) Failing after 0s
Details
Integration Auth Tests / test-matrix (oauth2_token) (push) Failing after 0s
Details
Test Llama Stack Build / generate-matrix (push) Successful in 3s
Details
Integration Tests (Replay) / Integration Tests (, , , client=, ) (push) Failing after 4s
Details
Vector IO Integration Tests / test-matrix (push) Failing after 3s
Details
Test External Providers Installed via Module / test-external-providers-from-module (venv) (push) Has been skipped
Details
Test Llama Stack Build / build-single-provider (push) Failing after 3s
Details
SqlStore Integration Tests / test-postgres (3.13) (push) Failing after 6s
Details
Test Llama Stack Build / build-custom-container-distribution (push) Failing after 3s
Details
Test Llama Stack Build / build-ubi9-container-distribution (push) Failing after 3s
Details
Python Package Build Test / build (3.12) (push) Failing after 3s
Details
Python Package Build Test / build (3.13) (push) Failing after 2s
Details
Test External API and Providers / test-external (venv) (push) Failing after 4s
Details
Unit Tests / unit-tests (3.13) (push) Failing after 3s
Details
API Conformance Tests / check-schema-compatibility (push) Successful in 11s
Details
Test Llama Stack Build / build (push) Failing after 3s
Details
Unit Tests / unit-tests (3.12) (push) Failing after 4s
Details
UI Tests / ui-tests (22) (push) Successful in 44s
Details
Pre-commit / pre-commit (push) Successful in 1m24s
Details

Browse source 
# What does this PR do?
https://github.com/llamastack/llama-stack/pull/3462 allows using uvicorn
to start llama stack server which supports spawning multiple workers.

This PR enables us to launch >1 workers from `llama stack run` (will add
the parameter in a follow-up PR, keeping this PR on simplifying) by
removing the old way of launching stack server and consolidates
launching via uvicorn.run only.


## Test Plan
ran `llama stack run starter`
CI
This commit is contained in:
ehhuang 2025-10-06 05:27:40 -07:00 • committed by GitHub
parent 92219fd8fb
commit 426cac078b
No known key found for this signature in database
GPG key ID: B5690EEEBB952194
8 changed files with 92 additions and 149 deletions
Download patch file Download diff file Expand all files Collapse all files

4
.github/workflows/providers-build.yml vendored
View file

@ -112,7 +112,7 @@ jobs:
fi
entrypoint=$(docker inspect --format '{{ .Config.Entrypoint }}' $IMAGE_ID)
echo "Entrypoint: $entrypoint"
if [ "$entrypoint" != "[python -m llama_stack.core.server.server /app/run.yaml]" ]; then
if [ "$entrypoint" != "[llama stack run /app/run.yaml]" ]; then
echo "Entrypoint is not correct"
exit 1
fi
@ -150,7 +150,7 @@ jobs:
fi
entrypoint=$(docker inspect --format '{{ .Config.Entrypoint }}' $IMAGE_ID)
echo "Entrypoint: $entrypoint"
if [ "$entrypoint" != "[python -m llama_stack.core.server.server /app/run.yaml]" ]; then
if [ "$entrypoint" != "[llama stack run /app/run.yaml]" ]; then
echo "Entrypoint is not correct"
exit 1
fi