phoenix-oss/llama-stack-mirror
0
0
Fork 1
mirror of https://github.com/meta-llama/llama-stack.git synced 2025-10-10 05:24:39 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions
2675 commits 156 branches 116 tags 123 MiB
Commit graph

2 commits

Author SHA1 Message Date
Eric Huang
a285f9c95f chore: refactor server.main 
# What does this PR do?
Refactor main to split out the app construction so that we can use `uvicorn --workers` to enable multi-process stack.


## Test Plan
CI

> uv run --with llama-stack python -m llama_stack.core.server.server benchmarking/k8s-benchmark/stack_run_config.yaml

works.

> LLAMA_STACK_CONFIG=benchmarking/k8s-benchmark/stack_run_config.yaml uv run uvicorn llama_stack.core.server.server:create_app --port 8321 --workers 4

works.
 2025-09-17 12:29:49 -07:00
ehhuang
c04f1c1e8c
chore: move benchmarking related code (#3406) 
# What does this PR do?
- moving things and some formatting changes


## Test Plan
 2025-09-10 13:19:44 -07:00