ehhuang f6bf36343d chore: logging perf improvments (#3393) ... # What does this PR do? - Use BackgroundLogger when logging metric events. - Reuse event loop in BackgroundLogger ## Test Plan ``` cd /docs/source/distributions/k8s-benchmark # start mock server python openai-mock-server.py --port 8000 # start stack server LLAMA_STACK_LOGGING="all=WARNING" uv run --with llama-stack python -m llama_stack.core.server.server docs/source/distributions/k8s-benchmark/stack_run_config.yaml # run benchmark script uv run python3 benchmark.py --duration 120 --concurrent 50 --base-url=http://localhost:8321/v1/openai/v1 --model=vllm-inference/meta-llama/Llama-3.2-3B-Instruct ``` ### RPS from 57 -> 62		2025-09-10 11:52:23 -07:00
..
apis	feat: Adding OpenAI Prompts API (#3319)	2025-09-08 11:05:13 -04:00
cli	feat: include a default inference store during llama stack build (#3373)	2025-09-09 15:54:58 -07:00
core	chore: logging perf improvments (#3393)	2025-09-10 11:52:23 -07:00
distributions	fix: Fix locations of distrubution runtime directories (#3336)	2025-09-05 14:09:36 +02:00
models	refactor(logging): rename llama_stack logger categories (#3065)	2025-08-21 17:31:04 -07:00
providers	chore: logging perf improvments (#3393)	2025-09-10 11:52:23 -07:00
strong_typing	chore: enable pyupgrade fixes (#1806)	2025-05-01 14:23:50 -07:00
testing	fix: environment variable typo in inference recorder error message (#3374)	2025-09-08 17:51:38 +02:00
ui	build: Bump version to 0.2.21	2025-09-08 22:30:03 +00:00
__init__.py	chore(rename): move llama_stack.distribution to llama_stack.core (#2975)	2025-07-30 23:30:53 -07:00
env.py	refactor(test): move tools, evals, datasetio, scoring and post training tests (#1401)	2025-03-04 14:53:47 -08:00
log.py	chore(pre-commit): add pre-commit hook to enforce llama_stack logger usage (#3061)	2025-08-20 07:15:35 -04:00
schema_utils.py	feat(auth): API access control (#2822)	2025-07-24 15:30:48 -07:00