phoenix-oss/llama-stack-mirror
0
0
Fork 1
mirror of https://github.com/meta-llama/llama-stack.git synced 2025-12-31 11:20:00 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions

feat: Support "stop" parameter in remote:vLLM

Browse source 
Signed-off-by: Yuan Tang <terrytangyuan@gmail.com>
This commit is contained in:
Yuan Tang 2025-03-19 22:41:34 -04:00
parent f369871083
commit a1da09e166
No known key found for this signature in database
4 changed files with 34 additions and 0 deletions
Download patch file Download diff file Expand all files Collapse all files

1
llama_stack/models/llama/datatypes.py
View file

@ -201,6 +201,7 @@ class SamplingParams(BaseModel):
max_tokens: Optional[int] = 0
repetition_penalty: Optional[float] = 1.0
stop: Optional[List[str]] = None
class CheckpointQuantizationFormat(Enum):