---
description: Available providers for the batches API
sidebar_label: Overview
sidebar_position: 1
title: Batches
---

# Batches

## Overview

The Batches API enables efficient processing of multiple requests in a single operation,
    particularly useful for processing large datasets, batch evaluation workflows, and
    cost-effective inference at scale.

    The API is designed to allow use of openai client libraries for seamless integration.

    This API provides the following extensions:
     - idempotent batch creation

    Note: This API is currently under active development and may undergo changes.

This section contains documentation for all available providers for the **batches** API.

## Providers

- **[Reference](./inline_reference)** - Inline provider
