phoenix-oss/llama-stack-mirror
0
0
Fork 1
mirror of https://github.com/meta-llama/llama-stack.git synced 2025-12-11 19:56:03 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions
3073 commits 57 branches 150 tags 125 MiB
Commit graph

2 commits

Author SHA1 Message Date
Ashwin Bharambe
809dae01c2 fix: update tests for OpenAI-style models endpoint 
The llama-stack-client now uses /v1/openai/v1/models which returns OpenAI-compatible model objects with 'id' and 'custom_metadata' fields instead of the Resource-style 'identifier' field. Updated api_recorder to handle the new endpoint and modified tests to access model metadata appropriately. Deleted stale model recordings for re-recording.
 2025-11-03 16:42:26 -08:00
Ashwin Bharambe
1394403360
feat(responses): implement usage tracking in streaming responses (#3771) 
Implementats usage accumulation to StreamingResponseOrchestrator. 

The most important part was to pass `stream_options = { "include_usage":
true }` to the chat_completion call. This means I will have to record
all responses tests again because request hash will change :)

Test changes:
- Add usage assertions to streaming and non-streaming tests
- Update test recordings with actual usage data from OpenAI
 2025-10-10 12:27:03 -07:00