structured output for /completion API ollama

This commit is contained in:
Sixian Yi 2025-01-17 22:41:29 -08:00
parent 3a9468ce9b
commit 1787008251
3 changed files with 2 additions and 2 deletions

View file

@ -172,6 +172,7 @@ class OllamaInferenceAdapter(Inference, ModelsProtocolPrivate):
model=model.provider_resource_id,
content=content,
sampling_params=sampling_params,
response_format=response_format,
stream=stream,
logprobs=logprobs,
)