feat(verification): various improvements (#1921)

Browse source

# What does this PR do?
- provider and their models now live in config.yaml
- better distinguish different cases within a test
- add model key to surface provider's model_id
- include example command to rerun single test case

## Test Plan
<img width="1173" alt="image"
src="https://github.com/user-attachments/assets/b414baf0-c768-451f-8c3b-c2905cf36fac"
/>

...

This commit is contained in:

ehhuang 2025-04-10 10:26:19 -07:00 • committed by GitHub

parent 09a83b1ec1

commit 14146e4b3f

No known key found for this signature in database

GPG key ID: B5690EEEBB952194

22 changed files with 4449 additions and 8810 deletions

Show all changes Ignore whitespace when comparing lines Ignore changes in amount of whitespace Ignore changes in whitespace at EOL

Download patch file Download diff file Expand all files Collapse all files

1420

tests/verifications/test_results/together_1744264258.json Normal file

View file

File diff suppressed because it is too large Load diff