phoenix-oss/llama-stack
1
0
Fork 0
forked from phoenix-oss/llama-stack-mirror
Code Pull requests Releases Packages 2 Activity Actions

More simplification of the "Starting a Llama Stack" doc

Browse source
This commit is contained in:
Ashwin Bharambe 2024-11-22 22:38:53 -08:00
parent 76fc5d9f31
commit 1e6006c599
4 changed files with 17 additions and 54 deletions
Download patch file Download diff file Expand all files Collapse all files

4
docs/source/distributions/importing_as_library.md
View file

@ -1,6 +1,6 @@
# Importing Llama Stack as a Python Library
# Using Llama Stack as a Library
Llama Stack is typically utilized in a client-server configuration. To get started quickly, you can import Llama Stack as a library and call the APIs directly without needing to set up a server. For [example](https://github.com/meta-llama/llama-stack-client-python/blob/main/src/llama_stack_client/lib/direct/test.py):
If you are planning to use an external service for Inference (even Ollama or TGI counts as external), it is often easier to use Llama Stack as a library. This avoids the overhead of setting up a server. For [example](https://github.com/meta-llama/llama-stack-client-python/blob/main/src/llama_stack_client/lib/direct/test.py):
```python
from llama_stack_client.lib.direct.direct import LlamaStackDirectClient