phoenix-oss/llama-stack-mirror
0
0
Fork 1
mirror of https://github.com/meta-llama/llama-stack.git synced 2025-08-15 22:18:00 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions 1

add notes about batches development status to docs

Browse source 
this also captures other notes from agents, eval and inference apis
This commit is contained in:
Matthew Farrellee 2025-08-13 07:15:07 -04:00
parent 8e678912ec
commit 04a73c89ef
7 changed files with 56 additions and 1 deletions
Download patch file Download diff file Expand all files Collapse all files

1
docs/source/concepts/apis.md
View file

@ -18,3 +18,4 @@ We are working on adding a few more APIs to complete the application lifecycle.
- **Batch Inference**: run inference on a dataset of inputs
- **Batch Agents**: run agents on a dataset of inputs
- **Synthetic Data Generation**: generate synthetic data for model development
- **Batches**: OpenAI-compatible batch management for inference