Ben Browning c014571258 fix: OpenAI API - together.ai extra usage chunks ... This fixes an issue where, with some models (ie the Llama 4 models), together.ai is sending a final usage chunk for streaming responses even if the user didn't ask to include usage. With this change, the OpenAI API verification tests now pass 100% when using Llama Stack as your API server and together.ai as the backend provider. As part of this, I also cleaned up the streaming/non-streaming return types of the `openai_chat_completion` method to keep type checking happy. Signed-off-by: Ben Browning <bbrownin@redhat.com>		2025-04-13 13:39:56 -04:00
..
anthropic	feat(providers): Groq now uses LiteLLM openai-compat (#1303)	2025-02-27 13:16:50 -08:00
bedrock	feat: OpenAI-Compatible models, completions, chat/completions (#1894)	2025-04-11 13:14:17 -07:00
cerebras	feat: OpenAI-Compatible models, completions, chat/completions (#1894)	2025-04-11 13:14:17 -07:00
cerebras_openai_compat	test: verification on provider's OAI endpoints (#1893)	2025-04-07 23:06:28 -07:00
databricks	feat: OpenAI-Compatible models, completions, chat/completions (#1894)	2025-04-11 13:14:17 -07:00
fireworks	fix: OpenAI API - together.ai extra usage chunks	2025-04-13 13:39:56 -04:00
fireworks_openai_compat	test: verification on provider's OAI endpoints (#1893)	2025-04-07 23:06:28 -07:00
gemini	feat(providers): Groq now uses LiteLLM openai-compat (#1303)	2025-02-27 13:16:50 -08:00
groq	test: verification on provider's OAI endpoints (#1893)	2025-04-07 23:06:28 -07:00
groq_openai_compat	test: verification on provider's OAI endpoints (#1893)	2025-04-07 23:06:28 -07:00
nvidia	fix: OpenAI API - together.ai extra usage chunks	2025-04-13 13:39:56 -04:00
ollama	fix: OpenAI API - together.ai extra usage chunks	2025-04-13 13:39:56 -04:00
openai	feat(providers): Groq now uses LiteLLM openai-compat (#1303)	2025-02-27 13:16:50 -08:00
passthrough	fix: OpenAI API - together.ai extra usage chunks	2025-04-13 13:39:56 -04:00
runpod	feat: OpenAI-Compatible models, completions, chat/completions (#1894)	2025-04-11 13:14:17 -07:00
sambanova	feat: OpenAI-Compatible models, completions, chat/completions (#1894)	2025-04-11 13:14:17 -07:00
sambanova_openai_compat	test: verification on provider's OAI endpoints (#1893)	2025-04-07 23:06:28 -07:00
tgi	feat: OpenAI-Compatible models, completions, chat/completions (#1894)	2025-04-11 13:14:17 -07:00
together	fix: OpenAI API - together.ai extra usage chunks	2025-04-13 13:39:56 -04:00
together_openai_compat	test: verification on provider's OAI endpoints (#1893)	2025-04-07 23:06:28 -07:00
vllm	fix: OpenAI API - together.ai extra usage chunks	2025-04-13 13:39:56 -04:00
__init__.py	impls -> inline, adapters -> remote (#381)	2024-11-06 14:54:05 -08:00