mirror of https://github.com/meta-llama/llama-stack.git synced 2025-07-29 15:23:51 +00:00

Composable building blocks to build Llama Apps https://llama-stack.readthedocs.io

Find a file

Ashwin Bharambe 66412b932b Nuke fp8_requirements, fold fbgemm into common requirements		2024-08-07 13:58:55 -07:00
docs	Update CLI_reference	2024-08-06 22:18:02 -07:00
llama_toolchain	Nuke fp8_requirements, fold fbgemm into common requirements	2024-08-07 13:58:55 -07:00
tests	update inference config to take model and not model_dir	2024-08-06 15:02:47 -07:00
.flake8	Initial commit	2024-07-23 08:32:33 -07:00
.gitignore	Bring agentic system api to toolchain	2024-08-04 17:33:29 -07:00
.pre-commit-config.yaml	Initial commit	2024-07-23 08:32:33 -07:00
CODE_OF_CONDUCT.md	Initial commit	2024-07-23 08:32:33 -07:00
CONTRIBUTING.md	Initial commit	2024-07-23 08:32:33 -07:00
LICENSE	Initial commit	2024-07-23 08:32:33 -07:00
MANIFEST.in	add requirements to MANIFEST.in	2024-07-23 12:59:28 -07:00
ollama_install.sh	update inference config to take model and not model_dir	2024-08-06 15:02:47 -07:00
pyproject.toml	Initial commit	2024-07-23 08:32:33 -07:00
README.md	Nuke fp8_requirements, fold fbgemm into common requirements	2024-08-07 13:58:55 -07:00
requirements.txt	Nuke fp8_requirements, fold fbgemm into common requirements	2024-08-07 13:58:55 -07:00
setup.py	Bump version to 0.0.2	2024-07-29 23:56:41 -07:00

README.md

llama-toolchain

This repo contains the API specifications for various components of the Llama Stack as well implementations for some of those APIs like model inference.

The Llama Stack consists of toolchain-apis and agentic-apis. This repo contains the toolchain-apis.

Installation

You can install this repository as a package with pip install llama-toolchain

If you want to install from source:

mkdir -p ~/local
cd ~/local
git clone git@github.com:meta-llama/llama-toolchain.git

conda create -n toolchain python=3.10
conda activate toolchain

cd llama-toolchain
pip install -e .

The Llama CLI

The llama CLI makes it easy to configure and run the Llama toolchain. Read the CLI reference for details.