llama-stack-mirror/llama_stack/providers
Ashwin Bharambe cfb86f1178 feat(responses): implement usage tracking in streaming responses
Implementation changes:
- Add usage accumulation to StreamingResponseOrchestrator
- Enable stream_options to receive usage in streaming chunks
- Track usage across multi-turn responses with tool execution
- Convert between chat completion and response usage formats
- Extract usage accumulation into helper method for clarity

Test changes:
- Add usage assertions to streaming and non-streaming tests
- Update test recordings with actual usage data from OpenAI
2025-10-10 10:13:33 -07:00
..
inline feat(responses): implement usage tracking in streaming responses 2025-10-10 10:13:33 -07:00
registry fix: Update watsonx.ai provider to use LiteLLM mixin and list all models (#3674) 2025-10-08 07:29:43 -04:00
remote fix(mypy): fix wrong attribute access (#3770) 2025-10-10 09:30:43 -07:00
utils feat: use SecretStr for inference provider auth credentials (#3724) 2025-10-10 07:32:50 -07:00
__init__.py API Updates (#73) 2024-09-17 19:51:35 -07:00
datatypes.py feat: combine ProviderSpec datatypes (#3378) 2025-09-18 16:10:00 +02:00