llama-stack/docs/source/distributions/self_hosted_distro
Jorge Piedrahita Ortiz b2b00a216b
feat(providers): sambanova updated to use LiteLLM openai-compat (#1596)
# What does this PR do?

switch sambanova inference adaptor to LiteLLM usage to simplify
integration and solve issues with current adaptor when streaming and
tool calling, models and templates updated

## Test Plan
pytest -s -v tests/integration/inference/test_text_inference.py
--stack-config=sambanova
--text-model=sambanova/Meta-Llama-3.3-70B-Instruct

pytest -s -v tests/integration/inference/test_vision_inference.py
--stack-config=sambanova
--vision-model=sambanova/Llama-3.2-11B-Vision-Instruct
2025-05-06 16:50:22 -07:00
..
bedrock.md fix: remove code interpeter implementation (#2087) 2025-05-01 14:35:08 -07:00
cerebras.md fix: remove code interpeter implementation (#2087) 2025-05-01 14:35:08 -07:00
dell-tgi.md fix: docker run with --pull always to fetch the latest image (#1733) 2025-03-20 15:35:48 -07:00
dell.md fix: docker run with --pull always to fetch the latest image (#1733) 2025-03-20 15:35:48 -07:00
fireworks.md fix: remove code interpeter implementation (#2087) 2025-05-01 14:35:08 -07:00
groq.md fix: remove code interpeter implementation (#2087) 2025-05-01 14:35:08 -07:00
meta-reference-gpu.md fix: remove code interpeter implementation (#2087) 2025-05-01 14:35:08 -07:00
nvidia.md feat: Add NVIDIA NeMo datastore (#1852) 2025-04-28 09:41:59 -07:00
ollama.md fix: remove code interpeter implementation (#2087) 2025-05-01 14:35:08 -07:00
passthrough.md fix: remove code interpeter implementation (#2087) 2025-05-01 14:35:08 -07:00
remote-vllm.md fix: remove code interpeter implementation (#2087) 2025-05-01 14:35:08 -07:00
sambanova.md feat(providers): sambanova updated to use LiteLLM openai-compat (#1596) 2025-05-06 16:50:22 -07:00
tgi.md fix: remove code interpeter implementation (#2087) 2025-05-01 14:35:08 -07:00
together.md fix: remove code interpeter implementation (#2087) 2025-05-01 14:35:08 -07:00