llama-stack/llama_stack/apis
Dinesh Yeduguru fdff24e77a
Inference to use provider resource id to register and validate (#428)
This PR changes the way model id gets translated to the final model name
that gets passed through the provider.
Major changes include:
1) Providers are responsible for registering an object and as part of
the registration returning the object with the correct provider specific
name of the model provider_resource_id
2) To help with the common look ups different names a new ModelLookup
class is created.



Tested all inference providers including together, fireworks, vllm,
ollama, meta reference and bedrock
2024-11-12 20:02:00 -08:00
..
agents migrate memory banks to Resource and new registration (#411) 2024-11-11 17:10:44 -08:00
batch_inference Remove "routing_table" and "routing_key" concepts for the user (#201) 2024-10-10 10:24:13 -07:00
common [Evals API][4/n] evals with generation meta-reference impl (#303) 2024-10-25 13:12:39 -07:00
datasetio migrate dataset to resource (#420) 2024-11-11 17:14:41 -08:00
datasets Remove the "ShieldType" concept (#430) 2024-11-12 12:37:24 -08:00
eval [Evals API][11/n] huggingface dataset provider + mmlu scoring fn (#392) 2024-11-11 14:49:50 -05:00
eval_tasks Remove the "ShieldType" concept (#430) 2024-11-12 12:37:24 -08:00
inference Inference to use provider resource id to register and validate (#428) 2024-11-12 20:02:00 -08:00
inspect Remove "routing_table" and "routing_key" concepts for the user (#201) 2024-10-10 10:24:13 -07:00
memory migrate memory banks to Resource and new registration (#411) 2024-11-11 17:10:44 -08:00
memory_banks Remove the "ShieldType" concept (#430) 2024-11-12 12:37:24 -08:00
models Remove the "ShieldType" concept (#430) 2024-11-12 12:37:24 -08:00
post_training [Evals API][4/n] evals with generation meta-reference impl (#303) 2024-10-25 13:12:39 -07:00
safety Remove the "ShieldType" concept (#430) 2024-11-12 12:37:24 -08:00
scoring migrate scoring fns to resource (#422) 2024-11-11 17:28:48 -08:00
scoring_functions Remove the "ShieldType" concept (#430) 2024-11-12 12:37:24 -08:00
shields Remove the "ShieldType" concept (#430) 2024-11-12 12:37:24 -08:00
synthetic_data_generation [Evals API][4/n] evals with generation meta-reference impl (#303) 2024-10-25 13:12:39 -07:00
telemetry Remove "routing_table" and "routing_key" concepts for the user (#201) 2024-10-10 10:24:13 -07:00
__init__.py API Updates (#73) 2024-09-17 19:51:35 -07:00
resource.py Enable sane naming of registered objects with defaults (#429) 2024-11-12 11:18:05 -08:00