mirror of
https://github.com/meta-llama/llama-stack.git
synced 2025-10-04 04:04:14 +00:00
updating license for toolchain
This commit is contained in:
parent
0e2fc9966a
commit
86fff23a9e
74 changed files with 512 additions and 94 deletions
16
README.md
16
README.md
|
@ -1,7 +1,7 @@
|
|||
This repo contains the API specifications for various parts of the Llama Stack.
|
||||
The Stack consists of toolchain-apis and agentic-apis.
|
||||
The Stack consists of toolchain-apis and agentic-apis.
|
||||
|
||||
The tool chain apis that are covered --
|
||||
The tool chain apis that are covered --
|
||||
- inference / batch inference
|
||||
- post training
|
||||
- reward model scoring
|
||||
|
@ -10,7 +10,7 @@ The tool chain apis that are covered --
|
|||
|
||||
## Running FP8
|
||||
|
||||
You need `fbgemm-gpu` package which requires torch >= 2.4.0 (currently only in nightly, but releasing shortly...).
|
||||
You need `fbgemm-gpu` package which requires torch >= 2.4.0 (currently only in nightly, but releasing shortly...).
|
||||
|
||||
```bash
|
||||
ENV=fp8_env
|
||||
|
@ -21,19 +21,19 @@ pip3 install -r fp8_requirements.txt
|
|||
```
|
||||
|
||||
|
||||
### Generate OpenAPI specs
|
||||
### Generate OpenAPI specs
|
||||
|
||||
Set up virtual environment
|
||||
Set up virtual environment
|
||||
|
||||
```
|
||||
python3 -m venv ~/.venv/toolchain/
|
||||
python3 -m venv ~/.venv/toolchain/
|
||||
source ~/.venv/toolchain/bin/activate
|
||||
|
||||
with-proxy pip3 install -r requirements.txt
|
||||
with-proxy pip3 install -r requirements.txt
|
||||
|
||||
```
|
||||
|
||||
Run the generate.sh script
|
||||
Run the generate.sh script
|
||||
|
||||
```
|
||||
cd source && sh generate.sh
|
||||
|
|
Loading…
Add table
Add a link
Reference in a new issue