phoenix-oss/llama-stack
1
0
Fork 0
forked from phoenix-oss/llama-stack-mirror
Code Pull requests Releases Packages 2 Activity Actions
llama-stack/llama_stack/templates
History
Botao Chen 06cb0c837e
[torchtune integration] post training + eval (#670) 
## What does this PR do?

- Add related Apis in experimental-post-training template to enable eval
on the finetuned checkpoint in the template
- A small bug fix on meta reference eval
- A small error handle improvement on post training 


## Test Plan
From client side issued an E2E post training request
https://github.com/meta-llama/llama-stack-client-python/pull/70 and get
eval results successfully

<img width="1315" alt="Screenshot 2024-12-20 at 12 06 59 PM"
src="https://github.com/user-attachments/assets/a09bd524-59ae-490c-908f-2e36ccf27c0a"
/>
2024-12-20 13:43:13 -08:00
..
bedrock Dont include 3B / 1B models for bedrock since they arent ondemand 2024-12-18 06:30:02 -08:00
cerebras Update Cerebras from Llama 3.1 to 3.3 (#645) 2024-12-17 16:28:24 -08:00
experimental-post-training [torchtune integration] post training + eval (#670) 2024-12-20 13:43:13 -08:00
fireworks Add Llama 70B 3.3 to fireworks (#654) 2024-12-19 17:32:49 -08:00
hf-endpoint add embedding model by default to distribution templates (#617) 2024-12-13 12:48:00 -08:00
hf-serverless add embedding model by default to distribution templates (#617) 2024-12-13 12:48:00 -08:00
meta-reference-gpu add embedding model by default to distribution templates (#617) 2024-12-13 12:48:00 -08:00
meta-reference-quantized-gpu add embedding model by default to distribution templates (#617) 2024-12-13 12:48:00 -08:00
ollama add embedding model by default to distribution templates (#617) 2024-12-13 12:48:00 -08:00
remote-vllm add embedding model by default to distribution templates (#617) 2024-12-13 12:48:00 -08:00
tgi add embedding model by default to distribution templates (#617) 2024-12-13 12:48:00 -08:00
together add embedding model by default to distribution templates (#617) 2024-12-13 12:48:00 -08:00
vllm-gpu add embedding model by default to distribution templates (#617) 2024-12-13 12:48:00 -08:00
__init__.py Auto-generate distro yamls + docs (#468) 2024-11-18 14:57:06 -08:00
template.py add embedding model by default to distribution templates (#617) 2024-12-13 12:48:00 -08:00