forked from phoenix-oss/llama-stack-mirror
* move docs -> source * Add files via upload * mv image * Add files via upload * colocate iOS setup doc * delete image * Add files via upload * fix * delete image * Add files via upload * Update developer_cookbook.md * toctree * wip subfolder * docs update * subfolder * updates * name * updates * index * updates * refactor structure * depth * docs * content * docs * getting started * distributions * fireworks * fireworks * update * theme * theme * theme * pdj theme * pytorch theme * css * theme * agents example * format * index * headers * copy button * test tabs * test tabs * fix * tabs * tab * tabs * sphinx_design * quick start commands * size * width * css * css * download models * asthetic fix * tab format * update * css * width * css * docs * tab based * tab * tabs * docs * style * image * css * color * typo * update docs * missing links * list templates * links * links update * troubleshooting * fix * distributions * docs * fix table * kill llamastack-local-gpu/cpu * Update index.md * Update index.md * mv ios_setup.md * Update ios_setup.md * Add remote_or_local.gif * Update ios_setup.md * release notes * typos * Add ios_setup to index * nav bar * hide torctree * ios image * links update * rename * rename * docs * rename * links * distributions * distributions * distributions * distributions * remove release * remote --------- Co-authored-by: dltn <6599399+dltn@users.noreply.github.com> Co-authored-by: Ashwin Bharambe <ashwin.bharambe@gmail.com>
53 lines
1.4 KiB
Markdown
53 lines
1.4 KiB
Markdown
# Memory API Providers
|
|
|
|
This guide gives you references to switch between different memory API providers.
|
|
|
|
##### pgvector
|
|
1. Start running the pgvector server:
|
|
|
|
```
|
|
$ docker run --network host --name mypostgres -it -p 5432:5432 -e POSTGRES_PASSWORD=mysecretpassword -e POSTGRES_USER=postgres -e POSTGRES_DB=postgres pgvector/pgvector:pg16
|
|
```
|
|
|
|
2. Edit the `run.yaml` file to point to the pgvector server.
|
|
```
|
|
memory:
|
|
- provider_id: pgvector
|
|
provider_type: remote::pgvector
|
|
config:
|
|
host: 127.0.0.1
|
|
port: 5432
|
|
db: postgres
|
|
user: postgres
|
|
password: mysecretpassword
|
|
```
|
|
|
|
> [!NOTE]
|
|
> If you get a `RuntimeError: Vector extension is not installed.`. You will need to run `CREATE EXTENSION IF NOT EXISTS vector;` to include the vector extension. E.g.
|
|
|
|
```
|
|
docker exec -it mypostgres ./bin/psql -U postgres
|
|
postgres=# CREATE EXTENSION IF NOT EXISTS vector;
|
|
postgres=# SELECT extname from pg_extension;
|
|
extname
|
|
```
|
|
|
|
3. Run `docker compose up` with the updated `run.yaml` file.
|
|
|
|
##### chromadb
|
|
1. Start running chromadb server
|
|
```
|
|
docker run -it --network host --name chromadb -p 6000:6000 -v ./chroma_vdb:/chroma/chroma -e IS_PERSISTENT=TRUE chromadb/chroma:latest
|
|
```
|
|
|
|
2. Edit the `run.yaml` file to point to the chromadb server.
|
|
```
|
|
memory:
|
|
- provider_id: remote::chromadb
|
|
provider_type: remote::chromadb
|
|
config:
|
|
host: localhost
|
|
port: 6000
|
|
```
|
|
|
|
3. Run `docker compose up` with the updated `run.yaml` file.
|