mirror of
https://github.com/meta-llama/llama-stack.git
synced 2025-06-27 18:50:41 +00:00
All of the tests from `llama_stack/providers/tests/` are now moved to `tests/integration`. I converted the `tools`, `scoring` and `datasetio` tests to use API. However, `eval` and `post_training` proved to be a bit challenging to leaving those. I think `post_training` should be relatively straightforward also. As part of this, I noticed that `wolfram_alpha` tool wasn't added to some of our commonly used distros so I added it. I am going to remove a lot of code duplication from distros next so while this looks like a one-off right now, it will go away and be there uniformly for all distros.
684 B
684 B
1 | input_query | generated_answer | expected_answer | chat_completion_input |
---|---|---|---|---|
2 | What is the capital of France? | London | Paris | [{'role': 'user', 'content': 'What is the capital of France?'}] |
3 | Who is the CEO of Meta? | Mark Zuckerberg | Mark Zuckerberg | [{'role': 'user', 'content': 'Who is the CEO of Meta?'}] |
4 | What is the largest planet in our solar system? | Jupiter | Jupiter | [{'role': 'user', 'content': 'What is the largest planet in our solar system?'}] |
5 | What is the smallest country in the world? | China | Vatican City | [{'role': 'user', 'content': 'What is the smallest country in the world?'}] |
6 | What is the currency of Japan? | Yen | Yen | [{'role': 'user', 'content': 'What is the currency of Japan?'}] |