forked from phoenix-oss/llama-stack-mirror
5287b437ae
## PR Stack - https://github.com/meta-llama/llama-stack/pull/1573 - https://github.com/meta-llama/llama-stack/pull/1625 - https://github.com/meta-llama/llama-stack/pull/1656 - https://github.com/meta-llama/llama-stack/pull/1657 - https://github.com/meta-llama/llama-stack/pull/1658 - https://github.com/meta-llama/llama-stack/pull/1659 - https://github.com/meta-llama/llama-stack/pull/1660 **Client SDK** - https://github.com/meta-llama/llama-stack-client-python/pull/203 **CI** -1391130488<img width="1042" alt="image" src="https://github.com/user-attachments/assets/69636067-376d-436b-9204-896e2dd490ca" /> -- the test_rag_agent_with_attachments is flaky and not related to this PR ## Doc <img width="789" alt="image" src="https://github.com/user-attachments/assets/b88390f3-73d6-4483-b09a-a192064e32d9" /> ## Client Usage ```python client.datasets.register( source={ "type": "uri", "uri": "lsfs://mydata.jsonl", }, schema="jsonl_messages", # optional dataset_id="my_first_train_data" ) # quick prototype debugging client.datasets.register( data_reference={ "type": "rows", "rows": [ "messages": [...], ], }, schema="jsonl_messages", ) ``` ## Test Plan - CI:1387805545``` LLAMA_STACK_CONFIG=fireworks pytest -v tests/integration/datasets/test_datasets.py ``` ``` LLAMA_STACK_CONFIG=fireworks pytest -v tests/integration/scoring/test_scoring.py ``` ``` pytest -v -s --nbval-lax ./docs/notebooks/Llama_Stack_Benchmark_Evals.ipynb ```
724 B
724 B
| 1 | input_query | generated_answer | expected_answer | chat_completion_input |
|---|---|---|---|---|
| 2 | What is the capital of France? | London | Paris | [{"role": "user", "content": "What is the capital of France?"}] |
| 3 | Who is the CEO of Meta? | Mark Zuckerberg | Mark Zuckerberg | [{"role": "user", "content": "Who is the CEO of Meta?"}] |
| 4 | What is the largest planet in our solar system? | Jupiter | Jupiter | [{"role": "user", "content": "What is the largest planet in our solar system?"}] |
| 5 | What is the smallest country in the world? | China | Vatican City | [{"role": "user", "content": "What is the smallest country in the world?"}] |
| 6 | What is the currency of Japan? | Yen | Yen | [{"role": "user", "content": "What is the currency of Japan?"}] |