phoenix-oss/llama-stack-mirror
0
0
Fork 1
mirror of https://github.com/meta-llama/llama-stack.git synced 2026-01-07 09:39:56 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions
llama-stack-mirror/docs/source/distributions/remote_hosted_distro/index.md
reidliu 785a281dbd chore: remove the incorrect output 
Signed-off-by: reidliu <reid201711@gmail.com>
2025-03-07 21:06:40 +08:00

1.3 KiB
Raw Blame History

Remote-Hosted Distributions

Remote-Hosted distributions are available endpoints serving Llama Stack API that you can directly connect to.

Distribution Endpoint Inference Agents Memory Safety Telemetry
Together https://llama-stack.together.ai remote::together meta-reference remote::weaviate meta-reference meta-reference
Fireworks https://llamastack-preview.fireworks.ai remote::fireworks meta-reference remote::weaviate meta-reference meta-reference

Connecting to Remote-Hosted Distributions

You can use llama-stack-client to interact with these endpoints. For example, to list the available models served by the Fireworks endpoint:

$ pip install llama-stack-client
$ llama-stack-client configure --endpoint https://llamastack-preview.fireworks.ai
$ llama-stack-client models list

Checkout the llama-stack-client-python repo for more details on how to use the llama-stack-client CLI. Checkout llama-stack-app for examples applications built on top of Llama Stack.