diff --git a/distributions/fireworks/README.md b/distributions/fireworks/README.md index 3d8a3def6..b5bdd9c17 100644 --- a/distributions/fireworks/README.md +++ b/distributions/fireworks/README.md @@ -30,7 +30,7 @@ inference: api_key: ``` -### (Alternative) TGI server + llama stack run (Single Node GPU) +### (Alternative) llama stack run (Single Node CPU) ``` docker run --network host -it -p 5000:5000 -v ./run.yaml:/root/my-run.yaml --gpus=all llamastack/distribution-fireworks --yaml_config /root/my-run.yaml diff --git a/distributions/together/README.md b/distributions/together/README.md index 9bc8e184c..2c2b53767 100644 --- a/distributions/together/README.md +++ b/distributions/together/README.md @@ -33,7 +33,7 @@ inference: api_key: ``` -### (Alternative) TGI server + llama stack run (Single Node GPU) +### (Alternative) llama stack run (Single Node CPU) ``` docker run --network host -it -p 5000:5000 -v ./run.yaml:/root/my-run.yaml --gpus=all llamastack/distribution-together --yaml_config /root/my-run.yaml @@ -52,7 +52,7 @@ inference: Together distribution comes with weaviate as Memory provider. We also need to configure the remote weaviate API key and URL in `run.yaml` to get memory API. ``` memory: - - provider_id: meta0 + - provider_id: weaviate0 provider_type: remote::weaviate config: weaviate_api_key: