llama-stack-mirror

mirror of https://github.com/meta-llama/llama-stack.git synced 2025-07-16 01:53:10 +00:00

History

Dinesh Yeduguru efe791bab7 Support model resource updates and deletes (#452 ) # What does this PR do? * Changes the registry to store only one RoutableObject per identifier. Before it was a list, which is not really required. * Adds impl for updates and deletes * Updates routing table to handle updates correctly ## Test Plan ``` ❯ llama-stack-client models list +------------------------+---------------+------------------------------------+------------+ \| identifier \| provider_id \| provider_resource_id \| metadata \| +========================+===============+====================================+============+ \| Llama3.1-405B-Instruct \| fireworks-0 \| fireworks/llama-v3p1-405b-instruct \| {} \| +------------------------+---------------+------------------------------------+------------+ \| Llama3.1-8B-Instruct \| fireworks-0 \| fireworks/llama-v3p1-8b-instruct \| {} \| +------------------------+---------------+------------------------------------+------------+ \| Llama3.2-3B-Instruct \| fireworks-0 \| fireworks/llama-v3p2-1b-instruct \| {} \| +------------------------+---------------+------------------------------------+------------+ ❯ llama-stack-client models register dineshyv-model --provider-model-id=fireworks/llama-v3p1-70b-instruct Successfully registered model dineshyv-model ❯ llama-stack-client models list +------------------------+---------------+------------------------------------+------------+ \| identifier \| provider_id \| provider_resource_id \| metadata \| +========================+===============+====================================+============+ \| Llama3.1-405B-Instruct \| fireworks-0 \| fireworks/llama-v3p1-405b-instruct \| {} \| +------------------------+---------------+------------------------------------+------------+ \| Llama3.1-8B-Instruct \| fireworks-0 \| fireworks/llama-v3p1-8b-instruct \| {} \| +------------------------+---------------+------------------------------------+------------+ \| Llama3.2-3B-Instruct \| fireworks-0 \| fireworks/llama-v3p2-1b-instruct \| {} \| +------------------------+---------------+------------------------------------+------------+ \| dineshyv-model \| fireworks-0 \| fireworks/llama-v3p1-70b-instruct \| {} \| +------------------------+---------------+------------------------------------+------------+ ❯ llama-stack-client models update dineshyv-model --provider-model-id=fireworks/llama-v3p1-405b-instruct Successfully updated model dineshyv-model ❯ llama-stack-client models list +------------------------+---------------+------------------------------------+------------+ \| identifier \| provider_id \| provider_resource_id \| metadata \| +========================+===============+====================================+============+ \| Llama3.1-405B-Instruct \| fireworks-0 \| fireworks/llama-v3p1-405b-instruct \| {} \| +------------------------+---------------+------------------------------------+------------+ \| Llama3.1-8B-Instruct \| fireworks-0 \| fireworks/llama-v3p1-8b-instruct \| {} \| +------------------------+---------------+------------------------------------+------------+ \| Llama3.2-3B-Instruct \| fireworks-0 \| fireworks/llama-v3p2-1b-instruct \| {} \| +------------------------+---------------+------------------------------------+------------+ \| dineshyv-model \| fireworks-0 \| fireworks/llama-v3p1-405b-instruct \| {} \| +------------------------+---------------+------------------------------------+------------+ llama-stack-client models delete dineshyv-model ❯ llama-stack-client models list +------------------------+---------------+------------------------------------+------------+ \| identifier \| provider_id \| provider_resource_id \| metadata \| +========================+===============+====================================+============+ \| Llama3.1-405B-Instruct \| fireworks-0 \| fireworks/llama-v3p1-405b-instruct \| {} \| +------------------------+---------------+------------------------------------+------------+ \| Llama3.1-8B-Instruct \| fireworks-0 \| fireworks/llama-v3p1-8b-instruct \| {} \| +------------------------+---------------+------------------------------------+------------+ \| Llama3.2-3B-Instruct \| fireworks-0 \| fireworks/llama-v3p2-1b-instruct \| {} \| +------------------------+---------------+------------------------------------+------------+ ``` --------- Co-authored-by: Dinesh Yeduguru <dineshyv@fb.com>		2024-11-13 21:55:41 -08:00
..
adapters/datasetio/huggingface	local persistent for hf dataset provider (#451 )	2024-11-14 00:08:37 -05:00
inline	PR-437-Fixed bug to allow system instructions after first turn (#440 )	2024-11-13 10:34:04 -08:00
registry	add inline:: prefix for localfs provider (#441 )	2024-11-13 10:44:39 -05:00
remote	model registration in ollama and vllm check against the available models in the provider (#446 )	2024-11-13 13:04:06 -08:00
tests	Support model resource updates and deletes (#452 )	2024-11-13 21:55:41 -08:00
utils	model registration in ollama and vllm check against the available models in the provider (#446 )	2024-11-13 13:04:06 -08:00
__init__.py	API Updates (#73 )	2024-09-17 19:51:35 -07:00
datatypes.py	Kill "remote" providers and fix testing with a remote stack properly (#435 )	2024-11-12 21:51:29 -08:00