phoenix-oss/llama-stack-mirror
0
0
Fork 1
mirror of https://github.com/meta-llama/llama-stack.git synced 2025-07-29 07:14:20 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions
Composable building blocks to build Llama Apps https://llama-stack.readthedocs.io
61 commits 78 branches 89 tags 89 MiB
Find a file
Ashwin Bharambe ad62e2e1f3 make inference server load checkpoints for fp8 inference 
- introduce quantization related args for inference config
- also kill GeneratorArgs
2024-07-20 22:54:48 -07:00
toolchain make inference server load checkpoints for fp8 inference 2024-07-20 22:54:48 -07:00
.gitignore more work on agent definitions 2024-07-09 13:53:09 -07:00
README.md cleanup 2024-07-11 10:04:56 -07:00
requirements.txt update requirements for running standalone 2024-07-19 18:11:25 -07:00

README.md

This repo contains the API specifications for various parts of the Llama Stack. The Stack consists of toolchain-apis and agentic-apis.

The tool chain apis that are covered --

  • inference / batch inference
  • post training
  • reward model scoring
  • synthetic data generation

Generate OpenAPI specs

Set up virtual environment

python3.9 -m venv ~/.venv/toolchain/ 
source ~/.venv/toolchain/bin/activate

with-proxy pip3 install -r requirements.txt

Run the generate.sh script

cd source && sh generate.sh