From 65cc97187757bd15ad21269abb3626c106ba80a7 Mon Sep 17 00:00:00 2001 From: Christina Xu <77992688+christinaexyou@users.noreply.github.com> Date: Tue, 6 May 2025 08:11:55 -0400 Subject: [PATCH] docs: Add TrustyAI LM-Eval to list of known external providers (#2020) # What does this PR do? Adds documentation for the remote [TrustyAI LM-Eval Eval Provider](https://github.com/trustyai-explainability/llama-stack-provider-lmeval). LM-Eval is a service for large language model evaluation based on the open source project [lm-evaluation-harness](https://github.com/EleutherAI/lm-evaluation-harness) and is integrated into the [TrustyAI Kubernetes Operator](https://trustyai-explainability.github.io/trustyai-site/main/trustyai-operator.html). --- docs/source/providers/external.md | 1 + 1 file changed, 1 insertion(+) diff --git a/docs/source/providers/external.md b/docs/source/providers/external.md index f9c156dea..ee36ebc3c 100644 --- a/docs/source/providers/external.md +++ b/docs/source/providers/external.md @@ -55,6 +55,7 @@ Here's a list of known external providers that you can use with Llama Stack: | KubeFlow Training | Train models with KubeFlow | Post Training | Remote | [llama-stack-provider-kft](https://github.com/opendatahub-io/llama-stack-provider-kft) | | KubeFlow Pipelines | Train models with KubeFlow Pipelines | Post Training | Remote | [llama-stack-provider-kfp-trainer](https://github.com/opendatahub-io/llama-stack-provider-kfp-trainer) | | RamaLama | Inference models with RamaLama | Inference | Remote | [ramalama-stack](https://github.com/containers/ramalama-stack) | +| TrustyAI LM-Eval | Evaluate models with TrustyAI LM-Eval | Eval | Remote | [llama-stack-provider-lmeval](https://github.com/trustyai-explainability/llama-stack-provider-lmeval) | ### Remote Provider Specification