llama-stack-mirror/llama_stack/providers/inline
Botao Chen 06cb0c837e
[torchtune integration] post training + eval (#670)
## What does this PR do?

- Add related Apis in experimental-post-training template to enable eval
on the finetuned checkpoint in the template
- A small bug fix on meta reference eval
- A small error handle improvement on post training 


## Test Plan
From client side issued an E2E post training request
https://github.com/meta-llama/llama-stack-client-python/pull/70 and get
eval results successfully

<img width="1315" alt="Screenshot 2024-12-20 at 12 06 59 PM"
src="https://github.com/user-attachments/assets/a09bd524-59ae-490c-908f-2e36ccf27c0a"
/>
2024-12-20 13:43:13 -08:00
..
agents fix context_retriever model->model_id 2024-12-19 12:52:00 -08:00
datasetio Telemetry API redesign (#525) 2024-12-04 11:22:45 -08:00
eval [torchtune integration] post training + eval (#670) 2024-12-20 13:43:13 -08:00
inference Fix Meta reference GPU implementation (#663) 2024-12-19 14:09:45 -08:00
ios/inference impls -> inline, adapters -> remote (#381) 2024-11-06 14:54:05 -08:00
memory Update the "InterleavedTextMedia" type (#635) 2024-12-17 11:18:31 -08:00
post_training/torchtune [torchtune integration] post training + eval (#670) 2024-12-20 13:43:13 -08:00
safety Add more debugging logs to when llama guard fails 2024-12-17 18:52:02 -08:00
scoring [/scoring] add ability to define aggregation functions for scoring functions & refactors (#597) 2024-12-11 10:03:42 -08:00
telemetry Update Telemetry API so OpenAPI generation can work (#640) 2024-12-16 13:00:14 -08:00
tool_runtime/brave_search Tools API with brave and MCP providers (#639) 2024-12-19 21:25:17 -08:00
__init__.py impls -> inline, adapters -> remote (#381) 2024-11-06 14:54:05 -08:00