forked from phoenix-oss/llama-stack-mirror
# What does this PR do? switch sambanova inference adaptor to LiteLLM usage to simplify integration and solve issues with current adaptor when streaming and tool calling, models and templates updated ## Test Plan pytest -s -v tests/integration/inference/test_text_inference.py --stack-config=sambanova --text-model=sambanova/Meta-Llama-3.3-70B-Instruct pytest -s -v tests/integration/inference/test_vision_inference.py --stack-config=sambanova --vision-model=sambanova/Llama-3.2-11B-Vision-Instruct |
||
---|---|---|
.. | ||
bedrock.md | ||
cerebras.md | ||
dell-tgi.md | ||
dell.md | ||
fireworks.md | ||
groq.md | ||
meta-reference-gpu.md | ||
nvidia.md | ||
ollama.md | ||
passthrough.md | ||
remote-vllm.md | ||
sambanova.md | ||
tgi.md | ||
together.md |