phoenix-oss/llama-stack-mirror
0
0
Fork 1
mirror of https://github.com/meta-llama/llama-stack.git synced 2025-12-04 02:03:44 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions

Implement include parameter specifically for adding logprobs in the output message

Browse source
This commit is contained in:
Shabana Baig 2025-11-30 11:53:57 -05:00
parent 4ff0c25c52
commit 7d6c0aaf11
10 changed files with 255 additions and 8 deletions
Download patch file Download diff file Expand all files Collapse all files

2
src/llama_stack_api/inference.py
View file

@ -582,7 +582,7 @@ class OpenAITokenLogProb(BaseModel):
token: str
bytes: list[int] | None = None
logprob: float
top_logprobs: list[OpenAITopLogProb]
top_logprobs: list[OpenAITopLogProb] | None = None
@json_schema_type