llama-stack-mirror/llama_stack/providers/inline/agents
Ashwin Bharambe 1394403360
feat(responses): implement usage tracking in streaming responses (#3771)
Implementats usage accumulation to StreamingResponseOrchestrator. 

The most important part was to pass `stream_options = { "include_usage":
true }` to the chat_completion call. This means I will have to record
all responses tests again because request hash will change :)

Test changes:
- Add usage assertions to streaming and non-streaming tests
- Update test recordings with actual usage data from OpenAI
2025-10-10 12:27:03 -07:00
..
meta_reference feat(responses): implement usage tracking in streaming responses (#3771) 2025-10-10 12:27:03 -07:00
__init__.py add missing inits 2024-11-08 17:54:24 -08:00