Update Eval ReadME

This commit is contained in:
Jash Gulabrai 2025-04-15 14:01:01 -04:00
parent 970ff974f2
commit b8d2e33955

View file

@ -77,7 +77,7 @@ POST /eval/benchmarks/{benchmark_id}/jobs
"benchmark_config": { "benchmark_config": {
"eval_candidate": { "eval_candidate": {
"type": "model", "type": "model",
"model": "meta/llama-3.1-8b-instruct", "model": "meta-llama/Llama3.1-8B-Instruct",
"sampling_params": { "sampling_params": {
"max_tokens": 100, "max_tokens": 100,
"temperature": 0.7 "temperature": 0.7
@ -91,7 +91,7 @@ POST /eval/benchmarks/{benchmark_id}/jobs
Response example: Response example:
```json ```json
{ {
"job_id": "1234", "job_id": "eval-1234",
"status": "in_progress" "status": "in_progress"
} }
``` ```
@ -101,6 +101,14 @@ Response example:
GET /eval/benchmarks/{benchmark_id}/jobs/{job_id} GET /eval/benchmarks/{benchmark_id}/jobs/{job_id}
``` ```
Response example:
```json
{
"job_id": "eval-1234",
"status": "in_progress"
}
```
### Example for cancelling a job ### Example for cancelling a job
``` ```
POST /eval/benchmarks/{benchmark_id}/jobs/{job_id}/cancel POST /eval/benchmarks/{benchmark_id}/jobs/{job_id}/cancel