llama-stack-mirror/llama_stack/providers/inline/post_training/torchtune
Ihar Hrachyshka 2433ef218d feat: implement async job scheduler for torchtune
Now a separate thread is started to execute training jobs. Training
requests now return job ID before the job completes. (Which fixes API
timeouts for any jobs that take longer than a minute.)

Note: the scheduler code is meant to be spun out in the future into a
common provider service that can be reused for different APIs and
providers. It is also expected to back the /jobs API proposed here:

https://github.com/meta-llama/llama-stack/discussions/1238

Hence its somewhat generalized form which is expected to simplify its
adoption elsewhere in the future.

Note: this patch doesn't attempt to implement missing APIs (e.g. cancel
or job removal). This work will belong to follow-up PRs.

Signed-off-by: Ihar Hrachyshka <ihar.hrachyshka@gmail.com>
2025-03-28 12:11:59 -04:00
..
common chore: fix mypy violations in post_training modules (#1548) 2025-03-18 14:58:16 -07:00
datasets chore: fix mypy violations in post_training modules (#1548) 2025-03-18 14:58:16 -07:00
recipes chore: fix mypy violations in post_training modules (#1548) 2025-03-18 14:58:16 -07:00
__init__.py chore: fix typing hints for get_provider_impl deps arguments (#1544) 2025-03-11 10:07:28 -07:00
config.py test: add unit test to ensure all config types are instantiable (#1601) 2025-03-12 22:29:58 -07:00
post_training.py feat: implement async job scheduler for torchtune 2025-03-28 12:11:59 -04:00