llama-stack-mirror/llama_stack/providers
Nathan Weinberg 0e5574cf9d feat: allow ollama to use 'latest' if available but not specified
ollama's CLI supports running models via commands such as 'ollama run llama3.2'
this syntax does not work with the INFERENCE_MODEL llamastack var as currently
specifying a tag such as 'latest' is required

this commit will check to see if the 'latest' model is available and use that
model if a user passes a model name without a tag but the 'latest' is available
in ollama

Signed-off-by: Nathan Weinberg <nweinber@redhat.com>
2025-04-10 20:12:09 -04:00
..
inline fix: meta reference + llama4 tokenizer fix 2025-04-09 00:46:32 -07:00
registry fix: use torchao 0.8.0 for inference (#1925) 2025-04-10 13:39:20 -07:00
remote feat: allow ollama to use 'latest' if available but not specified 2025-04-10 20:12:09 -04:00
tests refactor: move all llama code to models/llama out of meta reference (#1887) 2025-04-07 15:03:58 -07:00
utils test: verification on provider's OAI endpoints (#1893) 2025-04-07 23:06:28 -07:00
__init__.py API Updates (#73) 2024-09-17 19:51:35 -07:00
datatypes.py chore: more mypy checks (ollama, vllm, ...) (#1777) 2025-04-01 17:12:39 +02:00