phoenix-oss/llama-stack-mirror
0
0
Fork 1
mirror of https://github.com/meta-llama/llama-stack.git synced 2025-12-31 09:13:53 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions

feat: Support "stop" parameter in remote:vLLM

Browse source 
Signed-off-by: Yuan Tang <terrytangyuan@gmail.com>
This commit is contained in:
Yuan Tang 2025-03-19 22:41:34 -04:00
parent f369871083
commit a1da09e166
No known key found for this signature in database
4 changed files with 34 additions and 0 deletions
Download patch file Download diff file Expand all files Collapse all files

6
tests/integration/test_cases/inference/completion.json
View file

@ -10,6 +10,12 @@
"expected": "1963"
}
},
"stop_sequence": {
"data": {
"content": "Return the exact same sentence: Michael Jordan was born in 1963",
"expected": "Michael Jordan was born in"
}
},
"streaming": {
"data": {
"content": "Roses are red,"