phoenix-oss/llama-stack-mirror
0
0
Fork 1
mirror of https://github.com/meta-llama/llama-stack.git synced 2025-10-04 04:04:14 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions

change Reranker to WeightedInMemoryAggregator

Browse source
This commit is contained in:
kimbwook 2025-09-11 21:40:21 +09:00
parent 60318b659d
commit 897be1376e
No known key found for this signature in database
GPG key ID: 13B032C99CBD373A
6 changed files with 22 additions and 142 deletions
Download patch file Download diff file Expand all files Collapse all files

12
docs/source/providers/batches/index.md
View file

@ -3,15 +3,15 @@
## Overview
The Batches API enables efficient processing of multiple requests in a single operation,
particularly useful for processing large datasets, batch evaluation workflows, and
cost-effective inference at scale.
particularly useful for processing large datasets, batch evaluation workflows, and
cost-effective inference at scale.
The API is designed to allow use of openai client libraries for seamless integration.
The API is designed to allow use of openai client libraries for seamless integration.
This API provides the following extensions:
- idempotent batch creation
This API provides the following extensions:
- idempotent batch creation
Note: This API is currently under active development and may undergo changes.
Note: This API is currently under active development and may undergo changes.
This section contains documentation for all available providers for the **batches** API.