phoenix-oss/llama-stack-mirror
0
0
Fork 1
mirror of https://github.com/meta-llama/llama-stack.git synced 2025-12-24 09:58:07 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions

docs

Browse source
This commit is contained in:
Young Han 2025-07-14 17:52:27 -07:00
parent 723a870171
commit 2153957ab6
2 changed files with 6 additions and 4 deletions
Download patch file Download diff file Expand all files Collapse all files

5
docs/source/distributions/self_hosted_distro/llamacpp.md
View file

@ -1,8 +1,9 @@
<!-- This file was auto-generated by distro_codegen.py, please edit source -->
# Llama Stack with llama.cpp
This template demonstrates how to utilize Llama Stack with [llama.cpp](https://github.com/ggerganov/llama.cpp) as the inference provider. \n
Previously, the use of quantized models with Llama Stack was restricted, but now it is fully supported through llama.cpp. \n
This template demonstrates how to utilize Llama Stack with [llama.cpp](https://github.com/ggerganov/llama.cpp) as the inference provider.
Previously, the use of quantized models with Llama Stack was restricted, but now it is fully supported through llama.cpp.
You can employ any .gguf models available on [Hugging Face](https://huggingface.co/models) with this template.

5
llama_stack/templates/llamacpp/doc_template.md
View file

@ -1,7 +1,8 @@
# Llama Stack with llama.cpp
This template demonstrates how to utilize Llama Stack with [llama.cpp](https://github.com/ggerganov/llama.cpp) as the inference provider. \n
Previously, the use of quantized models with Llama Stack was restricted, but now it is fully supported through llama.cpp. \n
This template demonstrates how to utilize Llama Stack with [llama.cpp](https://github.com/ggerganov/llama.cpp) as the inference provider.
Previously, the use of quantized models with Llama Stack was restricted, but now it is fully supported through llama.cpp.
You can employ any .gguf models available on [Hugging Face](https://huggingface.co/models) with this template.