llama-stack-mirror/llama_stack/providers
Ihar Hrachyshka 1ceebdc813 fix: cancel scheduler tasks on shutdown
Otherwise the currently running tasks will never exit (before they
actually complete), which means the process can't be properly shut down
(only with SIGKILL).

Ideally, we let tasks know that they are about to shutdown and give them
some time to do so; but in the lack of the mechanism, it's better to
cancel than linger forever.

Signed-off-by: Ihar Hrachyshka <ihar.hrachyshka@gmail.com>
2025-05-09 13:53:00 -04:00
..
inline feat: add metrics query API (#1394) 2025-05-07 10:11:26 -07:00
registry feat(providers): sambanova updated to use LiteLLM openai-compat (#1596) 2025-05-06 16:50:22 -07:00
remote fix: revert "feat(provider): adding llama4 support in together inference provider (#2123)" (#2124) 2025-05-08 15:18:16 -07:00
tests chore: enable pyupgrade fixes (#1806) 2025-05-01 14:23:50 -07:00
utils fix: cancel scheduler tasks on shutdown 2025-05-09 13:53:00 -04:00
__init__.py API Updates (#73) 2024-09-17 19:51:35 -07:00
datatypes.py chore: enable pyupgrade fixes (#1806) 2025-05-01 14:23:50 -07:00