5 commits

Author	SHA1	Message	Date
Dinesh Yeduguru	fdff24e77a	Inference to use provider resource id to register and validate (#428) ... This PR changes the way model id gets translated to the final model name that gets passed through the provider. Major changes include: 1) Providers are responsible for registering an object and as part of the registration returning the object with the correct provider specific name of the model provider_resource_id 2) To help with the common look ups different names a new ModelLookup class is created. Tested all inference providers including together, fireworks, vllm, ollama, meta reference and bedrock	2024-11-12 20:02:00 -08:00
Ashwin Bharambe	afe4a53ae8	Check vLLM registration	2024-11-12 13:14:36 -08:00
Dinesh Yeduguru	ec644d3418	migrate model to Resource and new registration signature (#410) ... * resource oriented object design for models * add back llama_model field * working tests * register singature fix * address feedback --------- Co-authored-by: Dinesh Yeduguru <dineshyv@fb.com>	2024-11-08 16:12:57 -08:00
Ashwin Bharambe	3b54ce3499	remote::vllm now works with vision models	2024-11-06 16:07:17 -08:00
Ashwin Bharambe	994732e2e0	impls -> inline, adapters -> remote (#381)	2024-11-06 14:54:05 -08:00

Renamed from llama_stack/providers/adapters/inference/vllm/vllm.py (Browse further)