mirror of
https://github.com/meta-llama/llama-stack.git
synced 2025-10-08 13:00:52 +00:00
docs: provider and distro codegen migration (#3531)
# What does this PR do? <!-- Provide a short summary of what this PR does and why. Link to relevant issues if applicable. --> <!-- If resolving an issue, uncomment and update the line below --> <!-- Closes #[issue-number] --> - Updates provider and distro codegen to handle the new format - Migrates provider and distro files to the new format ## Test Plan - Manual testing <!-- Describe the tests you ran to verify your changes with result summaries. *Provide clear instructions so the plan can be easily re-executed.* -->
This commit is contained in:
parent
45da31801c
commit
d23865757f
103 changed files with 1796 additions and 423 deletions
16
docs/docs/providers/scoring/index.mdx
Normal file
16
docs/docs/providers/scoring/index.mdx
Normal file
|
@ -0,0 +1,16 @@
|
|||
---
|
||||
sidebar_label: Scoring
|
||||
title: Scoring
|
||||
---
|
||||
|
||||
# Scoring
|
||||
|
||||
## Overview
|
||||
|
||||
This section contains documentation for all available providers for the **scoring** API.
|
||||
|
||||
## Providers
|
||||
|
||||
- [Basic](./inline_basic)
|
||||
- [Braintrust](./inline_braintrust)
|
||||
- [Llm-As-Judge](./inline_llm-as-judge)
|
17
docs/docs/providers/scoring/inline_basic.mdx
Normal file
17
docs/docs/providers/scoring/inline_basic.mdx
Normal file
|
@ -0,0 +1,17 @@
|
|||
---
|
||||
description: "Basic scoring provider for simple evaluation metrics and scoring functions."
|
||||
sidebar_label: Basic
|
||||
title: inline::basic
|
||||
---
|
||||
|
||||
# inline::basic
|
||||
|
||||
## Description
|
||||
|
||||
Basic scoring provider for simple evaluation metrics and scoring functions.
|
||||
|
||||
## Sample Configuration
|
||||
|
||||
```yaml
|
||||
{}
|
||||
```
|
23
docs/docs/providers/scoring/inline_braintrust.mdx
Normal file
23
docs/docs/providers/scoring/inline_braintrust.mdx
Normal file
|
@ -0,0 +1,23 @@
|
|||
---
|
||||
description: "Braintrust scoring provider for evaluation and scoring using the Braintrust platform."
|
||||
sidebar_label: Braintrust
|
||||
title: inline::braintrust
|
||||
---
|
||||
|
||||
# inline::braintrust
|
||||
|
||||
## Description
|
||||
|
||||
Braintrust scoring provider for evaluation and scoring using the Braintrust platform.
|
||||
|
||||
## Configuration
|
||||
|
||||
| Field | Type | Required | Default | Description |
|
||||
|-------|------|----------|---------|-------------|
|
||||
| `openai_api_key` | `str \| None` | No | | The OpenAI API Key |
|
||||
|
||||
## Sample Configuration
|
||||
|
||||
```yaml
|
||||
openai_api_key: ${env.OPENAI_API_KEY:=}
|
||||
```
|
17
docs/docs/providers/scoring/inline_llm-as-judge.mdx
Normal file
17
docs/docs/providers/scoring/inline_llm-as-judge.mdx
Normal file
|
@ -0,0 +1,17 @@
|
|||
---
|
||||
description: "LLM-as-judge scoring provider that uses language models to evaluate and score responses."
|
||||
sidebar_label: Llm-As-Judge
|
||||
title: inline::llm-as-judge
|
||||
---
|
||||
|
||||
# inline::llm-as-judge
|
||||
|
||||
## Description
|
||||
|
||||
LLM-as-judge scoring provider that uses language models to evaluate and score responses.
|
||||
|
||||
## Sample Configuration
|
||||
|
||||
```yaml
|
||||
{}
|
||||
```
|
Loading…
Add table
Add a link
Reference in a new issue