Xi Yan 6deef1ece0 rebase eval test w/ tool_runtime fixtures (#773) ... # What does this PR do? - fix eval tests to include tool_runtime fixtures - rebase eval for extracting memory retrieval context ## Test Plan ``` pytest -v -s -m meta_reference_eval_together_inference_huggingface_datasetio llama_stack/providers/tests/eval/test_eval.py pytest -v -s -m braintrust_scoring_together_inference llama_stack/providers/tests/scoring/test_scoring.py ``` - With notebook: https://gist.github.com/yanxi0830/1260a6cb7ec42498a195b88422462a34 ## Sources Please link relevant resources if necessary. ## Before submitting - [ ] This PR fixes a typo or improves the docs (you can dismiss the other checks if that's the case). - [ ] Ran pre-commit to handle lint / formatting issues. - [ ] Read the [contributor guideline](https://github.com/meta-llama/llama-stack/blob/main/CONTRIBUTING.md), Pull Request section? - [ ] Updated relevant documentation. - [ ] Wrote necessary unit or integration tests.		2025-01-15 12:55:19 -08:00
..
__init__.py	[Agentic Eval] add ability to run agents generation (#469)	2024-11-18 11:43:03 -08:00
config.py	Add ability to query and export spans to dataset (#574)	2024-12-05 21:07:30 -08:00
eval.py	rebase eval test w/ tool_runtime fixtures (#773)	2025-01-15 12:55:19 -08:00