llama-stack-mirror/llama_stack/providers/utils/inference
Dinesh Yeduguru 02f1c47416
support adding alias for models without hf repo/sku entry (#481)
# What does this PR do?

adds a new method build_model_alias_with_just_llama_model which is
needed for cases like ollama's quantized models which do not really have
a repo in hf and an entry in SKU list.


## Test Plan

pytest -v -s -m "ollama"
llama_stack/providers/tests/inference/test_text_inference.py

---------

Co-authored-by: Dinesh Yeduguru <dineshyv@fb.com>
2024-11-18 23:50:18 -08:00
..
__init__.py Allow models to be registered as long as llama model is provided (#472) 2024-11-18 15:05:29 -08:00
model_registry.py support adding alias for models without hf repo/sku entry (#481) 2024-11-18 23:50:18 -08:00
openai_compat.py Enable vision models for (Together, Fireworks, Meta-Reference, Ollama) (#376) 2024-11-05 16:22:33 -08:00
prompt_adapter.py Inference to use provider resource id to register and validate (#428) 2024-11-12 20:02:00 -08:00