phoenix-oss/llama-stack-mirror
0
0
Fork 1
mirror of https://github.com/meta-llama/llama-stack.git synced 2025-07-15 09:36:10 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions

update distributions compose/readme (#338)

Browse source 
* readme updates

* quantied compose

* dell tgi

* config update
This commit is contained in:
Xi Yan 2024-10-28 16:34:43 -07:00 • committed by GitHub
parent 985ff4d6ce
commit a70a4706fc
No known key found for this signature in database
GPG key ID: B5690EEEBB952194
14 changed files with 219 additions and 31 deletions
Download patch file Download diff file Expand all files Collapse all files

11
distributions/meta-reference-gpu/run.yaml
View file

@ -33,14 +33,9 @@ providers:
prompt_guard_shield:
model: Prompt-Guard-86M
memory:
- provider_id: pgvector
provider_type: remote::pgvector
config:
host: 127.0.0.1
port: 5432
db: postgres
user: postgres
password: mysecretpassword
- provider_id: meta0
provider_type: meta-reference
config: {}
agents:
- provider_id: meta0
provider_type: meta-reference