phoenix-oss/llama-stack-mirror
0
0
Fork 1
mirror of https://github.com/meta-llama/llama-stack.git synced 2025-10-03 19:57:35 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions

update rag.mdx

Browse source
This commit is contained in:
Kai Wu 2025-09-29 10:25:37 -07:00
parent 21c16901c9
commit cdd486d58c
1 changed files with 13 additions and 1 deletions
Download patch file Download diff file Expand all files Collapse all files

14
docs/docs/building_applications/rag.mdx
View file

@ -24,7 +24,19 @@ This new approach provides better compatibility with OpenAI's ecosystem and is t
## Prerequisites
For this guide, we will use [Ollama](https://ollama.com/) as the inference provider.
Ollama is an LLM runtime that allows you to run Llama models locally.
Ollama is an LLM runtime that allows you to run Llama models locally. It's a great choice for development and testing, but you can also use any other inference provider that supports the OpenAI API.
Before you begin, make sure you have the following:
1. **Ollama**: Follow the [installation guide](https://ollama.com/docs/ollama/getting-started/install
) to set up Ollama on your machine.
2. **Llama Stack**: Follow the [installation guide](/docs/installation) to set up Llama Stack on your
machine.
3. **Documents**: Prepare a set of documents that you want to search. These can be plain text, PDFs, or other file types.
4. Set the `LLAMA_STACK_PORT` environment variable to the port where Llama Stack is running. For example, if you are using the default port of 8321, set `export LLAMA_STACK_PORT=8321`. Also set 'OLLAMA_URL' environment variable to be 'http://localhost:11434'
## Step 0: Initialize Client
After lauched Llama Stack server by `llama stack build --distro starter --image-type venv --run`, initialize the client with the base URL of your Llama Stack instance.
```python
import os