mirror of
https://github.com/meta-llama/llama-stack.git
synced 2025-07-13 16:46:09 +00:00
8b45d147df
# What does this PR do? **Why** - huggingface datasets could have extra unused columns, some of these columns (e.g. images) is unable to be casted as JSON over http requests for datasetio. - it is also inefficient to create a new dataset that's a subset of columns **Solution** - drop columns not specified by dataset schema ## Test Plan Tested with script: https://gist.github.com/yanxi0830/23be5725e0d82d79e24cc5dd1d21b571 ## Sources Please link relevant resources if necessary. ## Before submitting - [ ] This PR fixes a typo or improves the docs (you can dismiss the other checks if that's the case). - [ ] Ran pre-commit to handle lint / formatting issues. - [ ] Read the [contributor guideline](https://github.com/meta-llama/llama-stack/blob/main/CONTRIBUTING.md), Pull Request section? - [ ] Updated relevant documentation. - [ ] Wrote necessary unit or integration tests. |
||
|---|---|---|
| .. | ||
| agents | ||
| datasetio | ||
| inference | ||
| memory | ||
| safety | ||
| __init__.py | ||