mirror of
https://github.com/meta-llama/llama-stack.git
synced 2025-06-29 11:24:19 +00:00
# What does this PR do? switch sambanova inference adaptor to LiteLLM usage to simplify integration and solve issues with current adaptor when streaming and tool calling, models and templates updated ## Test Plan pytest -s -v tests/integration/inference/test_text_inference.py --stack-config=sambanova --text-model=sambanova/Meta-Llama-3.3-70B-Instruct pytest -s -v tests/integration/inference/test_vision_inference.py --stack-config=sambanova --vision-model=sambanova/Llama-3.2-11B-Vision-Instruct |
||
---|---|---|
.. | ||
bedrock.md | ||
cerebras.md | ||
dell-tgi.md | ||
dell.md | ||
fireworks.md | ||
groq.md | ||
meta-reference-gpu.md | ||
nvidia.md | ||
ollama.md | ||
passthrough.md | ||
remote-vllm.md | ||
sambanova.md | ||
tgi.md | ||
together.md |