llama-stack-mirror/docs/static
Ashwin Bharambe c92a1c99f0 feat(responses): add usage types to inference and responses APIs
Add OpenAI-compatible usage tracking types:
- OpenAIChatCompletionUsage with prompt/completion token counts
- OpenAIResponseUsage with input/output token counts
- Token detail types for cached_tokens and reasoning_tokens
- Add usage field to chat completion and response objects

This enables reporting token consumption for both streaming and
non-streaming responses, matching OpenAI's usage reporting format.

🤖 Generated with [Claude Code](https://claude.com/claude-code)

Co-Authored-By: Claude <noreply@anthropic.com>
2025-10-09 21:12:29 -07:00
..
img docs: update OG image (#3669) 2025-10-03 10:22:54 -07:00
providers/vector_io docs: static content migration (#3535) 2025-09-24 14:08:50 -07:00
deprecated-llama-stack-spec.html feat(responses): add usage types to inference and responses APIs 2025-10-09 21:12:29 -07:00
deprecated-llama-stack-spec.yaml feat(responses): add usage types to inference and responses APIs 2025-10-09 21:12:29 -07:00
experimental-llama-stack-spec.html feat(tools)!: substantial clean up of "Tool" related datatypes (#3627) 2025-10-02 15:12:03 -07:00
experimental-llama-stack-spec.yaml feat(tools)!: substantial clean up of "Tool" related datatypes (#3627) 2025-10-02 15:12:03 -07:00
llama-stack-spec.html feat(responses): add usage types to inference and responses APIs 2025-10-09 21:12:29 -07:00
llama-stack-spec.yaml feat(responses): add usage types to inference and responses APIs 2025-10-09 21:12:29 -07:00
remote_or_local.gif docs: static content migration (#3535) 2025-09-24 14:08:50 -07:00
safety_system.webp docs: static content migration (#3535) 2025-09-24 14:08:50 -07:00
site.webmanifest docs: add favicon and mobile styling (#3650) 2025-10-02 10:42:54 +02:00
stainless-llama-stack-spec.html feat(responses): add usage types to inference and responses APIs 2025-10-09 21:12:29 -07:00
stainless-llama-stack-spec.yaml feat(responses): add usage types to inference and responses APIs 2025-10-09 21:12:29 -07:00