llama-stack-mirror/src/llama_stack
Emilio Garcia ba50790a28
feat(tests): metrics tests (#3966)
# What does this PR do?
1. Make telemetry tests as easy as possible for users by expanding the
`SpanStub` data class and creating the `MetricStub` dataclass as a way
to consistently marshal telemetry data in test fixtures and unmarshal
and handle it in tests.
2. Structure server and client tests to always follow the same standards
for consistent testing experience by using the `SpanStub` and
`MetricStub` data class objects.
3. Enable Metrics Testing for completions endpoint
4. Correct token metrics to use histograms instead of counts to capture
tokens per request rather than a cumulative count of tokens over the
lifecycle of the server.

## Test Plan
These are tests
2025-11-05 10:26:15 -08:00
..
apis chore: remove unused classes (#4077) 2025-11-05 16:45:23 +01:00
cli fix: show built-in distributions in llama stack list (#4040) 2025-11-05 10:16:28 -08:00
core feat(tests): metrics tests (#3966) 2025-11-05 10:26:15 -08:00
distributions docs: add documentation on how to use custom run yaml in docker (#3949) 2025-10-28 16:05:44 -07:00
models fix(mypy): resolve provider utility and testing type issues (#3935) 2025-10-28 10:37:27 -07:00
providers chore(api)!: remove tool_runtime.rag_tool from the API surface (#4067) 2025-11-04 14:50:54 -08:00
strong_typing fix(mypy): part-03 completely resolve meta reference responses impl typing issues (#3951) 2025-10-29 08:07:15 -07:00
testing fix: update tests for OpenAI-style models endpoint (#4053) 2025-11-03 17:30:08 -08:00
__init__.py chore(package): migrate to src/ layout (#3920) 2025-10-27 12:02:21 -07:00
env.py chore(package): migrate to src/ layout (#3920) 2025-10-27 12:02:21 -07:00
log.py chore(package): migrate to src/ layout (#3920) 2025-10-27 12:02:21 -07:00
schema_utils.py chore(package): migrate to src/ layout (#3920) 2025-10-27 12:02:21 -07:00