phoenix-oss/llama-stack-mirror
0
0
Fork 1
mirror of https://github.com/meta-llama/llama-stack.git synced 2025-12-14 09:42:38 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions

feat: Add max_output_tokens to Response API

Browse source 
Responses and Completions have a max_output_tokens field. It is currently
missing from the create and response object in Responses API.

This PR fixes it.

fixes: #3562
Signed-off-by: Abhishek Bongale <abhishekbongale@outlook.com>
This commit is contained in:
Abhishek Bongale 2025-10-06 09:46:09 +01:00
parent 92219fd8fb
commit bb58da22a1
14 changed files with 127 additions and 20 deletions
Download patch file Download diff file Expand all files Collapse all files

1
llama_stack/apis/agents/agents.py
View file

@ -825,6 +825,7 @@ class Agents(Protocol):
"List of shields to apply during response generation. Shields provide safety and content moderation."
),
] = None,
max_output_tokens: int | None = None,
) -> OpenAIResponseObject | AsyncIterator[OpenAIResponseObjectStream]:
"""Create a new OpenAI response.