phoenix-oss/llama-stack-mirror
0
0
Fork 1
mirror of https://github.com/meta-llama/llama-stack.git synced 2025-12-31 01:13:53 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions
llama-stack-mirror/llama_stack/providers/remote/inference
History
Ben Browning 8f5cd49159 vllm prompt_logprobs can also be 0 
This adjusts the vllm openai_completion endpoint to also pass a
value of 0 for prompt_logprobs, instead of only passing values greater
than zero to the backend.

The existing test_openai_completion_prompt_logprobs was parameterized
to test this case as well.

Signed-off-by: Ben Browning <bbrownin@redhat.com>
2025-04-09 17:32:03 -04:00
..
anthropic feat(providers): Groq now uses LiteLLM openai-compat (#1303) 2025-02-27 13:16:50 -08:00
bedrock Add unsupported OpenAI mixin to all remaining inference providers 2025-04-09 15:47:02 -04:00
cerebras Add unsupported OpenAI mixin to all remaining inference providers 2025-04-09 15:47:02 -04:00
cerebras_openai_compat test: verification on provider's OAI endpoints (#1893) 2025-04-07 23:06:28 -07:00
databricks Add unsupported OpenAI mixin to all remaining inference providers 2025-04-09 15:47:02 -04:00
fireworks test: verification on provider's OAI endpoints (#1893) 2025-04-07 23:06:28 -07:00
fireworks_openai_compat test: verification on provider's OAI endpoints (#1893) 2025-04-07 23:06:28 -07:00
gemini feat(providers): Groq now uses LiteLLM openai-compat (#1303) 2025-02-27 13:16:50 -08:00
groq test: verification on provider's OAI endpoints (#1893) 2025-04-07 23:06:28 -07:00
groq_openai_compat test: verification on provider's OAI endpoints (#1893) 2025-04-07 23:06:28 -07:00
nvidia Add unsupported OpenAI mixin to all remaining inference providers 2025-04-09 15:47:02 -04:00
ollama Add prompt_logprobs and guided_choice to OpenAI completions 2025-04-09 15:47:02 -04:00
openai feat(providers): Groq now uses LiteLLM openai-compat (#1303) 2025-02-27 13:16:50 -08:00
passthrough Add prompt_logprobs and guided_choice to OpenAI completions 2025-04-09 15:47:02 -04:00
runpod Add unsupported OpenAI mixin to all remaining inference providers 2025-04-09 15:47:02 -04:00
sambanova Add unsupported OpenAI mixin to all remaining inference providers 2025-04-09 15:47:02 -04:00
sambanova_openai_compat test: verification on provider's OAI endpoints (#1893) 2025-04-07 23:06:28 -07:00
tgi Add unsupported OpenAI mixin to all remaining inference providers 2025-04-09 15:47:02 -04:00
together Add prompt_logprobs and guided_choice to OpenAI completions 2025-04-09 15:47:02 -04:00
together_openai_compat test: verification on provider's OAI endpoints (#1893) 2025-04-07 23:06:28 -07:00
vllm vllm prompt_logprobs can also be 0 2025-04-09 17:32:03 -04:00
__init__.py impls -> inline, adapters -> remote (#381) 2024-11-06 14:54:05 -08:00