phoenix-oss/llama-stack-mirror
0
0
Fork 1
mirror of https://github.com/meta-llama/llama-stack.git synced 2025-07-02 04:28:46 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions

feat: associated models API with post_training

Browse source 
there are likely scenarios where admins of a stack only want to allow clients to fine-tune certain models, register certain models to be fine-tuned. etc
introduce the post_training router and post_training_models as the associated type. A different model type needs to be used for inference vs post_training due to the structure of the router currently.

Signed-off-by: Charlie Doern <cdoern@redhat.com>
This commit is contained in:
Charlie Doern 2025-05-30 12:05:33 -04:00
parent 63a9f08c9e
commit 71caa271ad
11 changed files with 393 additions and 23 deletions
Download patch file Download diff file Expand all files Collapse all files

4
llama_stack/distribution/distribution.py
View file

@ -39,6 +39,10 @@ def builtin_automatically_routed_apis() -> list[AutoRoutedApiInfo]:
routing_table_api=Api.models,
router_api=Api.inference,
),
AutoRoutedApiInfo(
routing_table_api=Api.post_training_models,
router_api=Api.post_training,
),
AutoRoutedApiInfo(
routing_table_api=Api.shields,
router_api=Api.safety,