---
description: Available providers for the inference API
sidebar_label: Overview
sidebar_position: 1
title: Inference
---

# Inference

## Overview

Llama Stack Inference API for generating completions, chat completions, and embeddings.

    This API provides the raw interface to the underlying models. Two kinds of models are supported:
    - LLM models: these models generate "raw" and "chat" (conversational) completions.
    - Embedding models: these models generate embeddings to be used for semantic search.

This section contains documentation for all available providers for the **inference** API.

## Providers

- **[Meta Reference](./inline_meta-reference)** - Inline provider
- **[Sentence Transformers](./inline_sentence-transformers)** - Inline provider
- **[Anthropic](./remote_anthropic)** - Remote provider
- **[Azure](./remote_azure)** - Remote provider
- **[Bedrock](./remote_bedrock)** - Remote provider
- **[Cerebras](./remote_cerebras)** - Remote provider
- **[Databricks](./remote_databricks)** - Remote provider
- **[Fireworks](./remote_fireworks)** - Remote provider
- **[Gemini](./remote_gemini)** - Remote provider
- **[Groq](./remote_groq)** - Remote provider
- **[Hugging Face Endpoint](./remote_hf_endpoint)** - Remote provider
- **[Hugging Face Serverless](./remote_hf_serverless)** - Remote provider
- **[Llama OpenAI Compatible](./remote_llama-openai-compat)** - Remote provider
- **[Nvidia](./remote_nvidia)** - Remote provider
- **[Ollama](./remote_ollama)** - Remote provider
- **[Openai](./remote_openai)** - Remote provider
- **[Passthrough](./remote_passthrough)** - Remote provider
- **[Runpod](./remote_runpod)** - Remote provider
- **[Sambanova](./remote_sambanova)** - Remote provider
- **[SambaNova OpenAI Compatible](./remote_sambanova-openai-compat)** - Remote provider
- **[Tgi](./remote_tgi)** - Remote provider
- **[Together](./remote_together)** - Remote provider
- **[Vertexai](./remote_vertexai)** - Remote provider
- **[Vllm](./remote_vllm)** - Remote provider
- **[Watsonx](./remote_watsonx)** - Remote provider
