phoenix-oss/llama-stack-mirror
0
0
Fork 1
mirror of https://github.com/meta-llama/llama-stack.git synced 2025-10-04 12:07:34 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions

Add rerank API for NVIDIA Inference Provider

Browse source
This commit is contained in:
Jiayi 2025-09-03 17:34:05 -07:00
parent ce77c27ff8
commit bab9d7aaea
9 changed files with 9213 additions and 1 deletions
Download patch file Download diff file Expand all files Collapse all files

2
docs/docs/providers/inference/index.mdx
View file

@ -4,6 +4,7 @@ description: "Llama Stack Inference API for generating completions, chat complet
This API provides the raw interface to the underlying models. Two kinds of models are supported:
- LLM models: these models generate \"raw\" and \"chat\" (conversational) completions.
- Embedding models: these models generate embeddings to be used for semantic search."
- Rerank models: these models rerank the documents by relevance."
sidebar_label: Inference
title: Inference
---
@ -17,5 +18,6 @@ Llama Stack Inference API for generating completions, chat completions, and embe
This API provides the raw interface to the underlying models. Two kinds of models are supported:
- LLM models: these models generate "raw" and "chat" (conversational) completions.
- Embedding models: these models generate embeddings to be used for semantic search.
- Rerank models: these models rerank the documents by relevance.
This section contains documentation for all available providers for the **inference** API.

4992
docs/static/llama-stack-spec.html vendored
View file

File diff suppressed because it is too large Load diff

3724
docs/static/llama-stack-spec.yaml vendored
View file

File diff suppressed because it is too large Load diff