llama-stack-mirror/llama_stack/core/server
Eric Huang a285f9c95f chore: refactor server.main
# What does this PR do?
Refactor main to split out the app construction so that we can use `uvicorn --workers` to enable multi-process stack.


## Test Plan
CI

> uv run --with llama-stack python -m llama_stack.core.server.server benchmarking/k8s-benchmark/stack_run_config.yaml

works.

> LLAMA_STACK_CONFIG=benchmarking/k8s-benchmark/stack_run_config.yaml uv run uvicorn llama_stack.core.server.server:create_app --port 8321 --workers 4

works.
2025-09-17 12:29:49 -07:00
..
__init__.py chore(rename): move llama_stack.distribution to llama_stack.core (#2975) 2025-07-30 23:30:53 -07:00
auth.py refactor(logging): rename llama_stack logger categories (#3065) 2025-08-21 17:31:04 -07:00
auth_providers.py feat: Add Kubernetes auth provider to use SelfSubjectReview and kubernetes api server (#2559) 2025-09-08 11:25:10 +02:00
quota.py refactor(logging): rename llama_stack logger categories (#3065) 2025-08-21 17:31:04 -07:00
routes.py chore(rename): move llama_stack.distribution to llama_stack.core (#2975) 2025-07-30 23:30:53 -07:00
server.py chore: refactor server.main 2025-09-17 12:29:49 -07:00