Xi Yan 6deef1ece0 rebase eval test w/ tool_runtime fixtures (#773) ... # What does this PR do? - fix eval tests to include tool_runtime fixtures - rebase eval for extracting memory retrieval context ## Test Plan ``` pytest -v -s -m meta_reference_eval_together_inference_huggingface_datasetio llama_stack/providers/tests/eval/test_eval.py pytest -v -s -m braintrust_scoring_together_inference llama_stack/providers/tests/scoring/test_scoring.py ``` - With notebook: https://gist.github.com/yanxi0830/1260a6cb7ec42498a195b88422462a34 ## Sources Please link relevant resources if necessary. ## Before submitting - [ ] This PR fixes a typo or improves the docs (you can dismiss the other checks if that's the case). - [ ] Ran pre-commit to handle lint / formatting issues. - [ ] Read the [contributor guideline](https://github.com/meta-llama/llama-stack/blob/main/CONTRIBUTING.md), Pull Request section? - [ ] Updated relevant documentation. - [ ] Wrote necessary unit or integration tests.		2025-01-15 12:55:19 -08:00
..
__init__.py	[Evals API][4/n] evals with generation meta-reference impl (#303)	2024-10-25 13:12:39 -07:00
conftest.py	rebase eval test w/ tool_runtime fixtures (#773)	2025-01-15 12:55:19 -08:00
constants.py	Folder restructure for evals/datasets/scoring (#419)	2024-11-11 17:35:40 -05:00
fixtures.py	rebase eval test w/ tool_runtime fixtures (#773)	2025-01-15 12:55:19 -08:00
test_eval.py	[remove import *] clean up import *'s (#689)	2024-12-27 15:45:44 -08:00