llama-stack-mirror/llama_stack/providers
Xi Yan 4253cfcd7f
local persistent for hf dataset provider (#451)
# What does this PR do?

- local persistence for HF dataset provider
- follow https://github.com/meta-llama/llama-stack/pull/375

## Test Plan

**e2e**
1. fresh llama stack run w/ yaml
2. kill server
3. restart llama stack run w/ yaml

```yaml
datasets:
  - dataset_id: mmlu
    provider_id: huggingface-0
    url:
      uri: https://huggingface.co/datasets/llamastack/evals
    metadata:
      path: llamastack/evals
      name: evals__mmlu__details
      split: train
    dataset_schema:
      input_query:
        type: string
      expected_answer:
        type: string
```
<img width="686" alt="image"
src="https://github.com/user-attachments/assets/d7737931-6a7d-400a-a17d-fef6cbd97eea">


## Before submitting

- [ ] This PR fixes a typo or improves the docs (you can dismiss the
other checks if that's the case).
- [ ] Ran pre-commit to handle lint / formatting issues.
- [ ] Read the [contributor
guideline](https://github.com/meta-llama/llama-stack/blob/main/CONTRIBUTING.md),
      Pull Request section?
- [ ] Updated relevant documentation.
- [ ] Wrote necessary unit or integration tests.
2024-11-14 00:08:37 -05:00
..
adapters/datasetio/huggingface local persistent for hf dataset provider (#451) 2024-11-14 00:08:37 -05:00
inline PR-437-Fixed bug to allow system instructions after first turn (#440) 2024-11-13 10:34:04 -08:00
registry add inline:: prefix for localfs provider (#441) 2024-11-13 10:44:39 -05:00
remote model registration in ollama and vllm check against the available models in the provider (#446) 2024-11-13 13:04:06 -08:00
tests model registration in ollama and vllm check against the available models in the provider (#446) 2024-11-13 13:04:06 -08:00
utils model registration in ollama and vllm check against the available models in the provider (#446) 2024-11-13 13:04:06 -08:00
__init__.py API Updates (#73) 2024-09-17 19:51:35 -07:00
datatypes.py Kill "remote" providers and fix testing with a remote stack properly (#435) 2024-11-12 21:51:29 -08:00