phoenix-oss/llama-stack-mirror
0
0
Fork 1
mirror of https://github.com/meta-llama/llama-stack.git synced 2025-12-18 06:49:47 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions

add notes about batches development status to docs

Browse source 
this also captures other notes from agents, eval and inference apis
This commit is contained in:
Matthew Farrellee 2025-08-13 07:15:07 -04:00 • committed by Ashwin Bharambe
parent 11249b029b
commit e6d5bf5588
7 changed files with 56 additions and 1 deletions
Download patch file Download diff file Expand all files Collapse all files

1
docs/source/concepts/apis.md
View file

@ -18,3 +18,4 @@ We are working on adding a few more APIs to complete the application lifecycle.
- **Batch Inference**: run inference on a dataset of inputs
- **Batch Agents**: run agents on a dataset of inputs
- **Synthetic Data Generation**: generate synthetic data for model development
- **Batches**: OpenAI-compatible batch management for inference