Ben Browning ac5dc8fae2 Add prompt_logprobs and guided_choice to OpenAI completions ... This adds the vLLM-specific extra_body parameters of prompt_logprobs and guided_choice to our openai_completion inference endpoint. The plan here would be to expand this to support all common optional parameters of any of the OpenAI providers, allowing each provider to use or ignore these parameters based on whether their server supports them. Signed-off-by: Ben Browning <bbrownin@redhat.com>		2025-04-09 15:47:02 -04:00
..
__init__.py	Auto-generate distro yamls + docs (#468)	2024-11-18 14:57:06 -08:00
config.py	Remove os.getenv() from ollama config	2025-02-20 14:30:32 -08:00
models.py	refactor: move all llama code to models/llama out of meta reference (#1887)	2025-04-07 15:03:58 -07:00
ollama.py	Add prompt_logprobs and guided_choice to OpenAI completions	2025-04-09 15:47:02 -04:00