llama-stack-mirror/llama_stack/providers/remote/inference
Matthew Farrellee 466ef6f490 feat: add static embedding metadata to dynamic model listings for providers using OpenAIMixin
- remove auto-download of ollama embedding models
- add embedding model metadata to dynamic listing w/ unit test
- add support and tests for allowed_models
- removed inference provider models.py files where dynamic listing is enabled
- store embedding metadata in embedding_model_metadata field on inference providers
- make model_entries optional on ModelRegistryHelper and LiteLLMOpenAIMixin
- make OpenAIMixin a ModelRegistryHelper
- skip base64 embedding test for remote::ollama, always returns floats
- only use OpenAI client for ollama model listing
- remove unused build_model_entry function
- remove unused get_huggingface_repo function
2025-09-25 04:56:54 -04:00
..
anthropic feat: add static embedding metadata to dynamic model listings for providers using OpenAIMixin 2025-09-25 04:56:54 -04:00
azure feat: add static embedding metadata to dynamic model listings for providers using OpenAIMixin 2025-09-25 04:56:54 -04:00
bedrock feat: add static embedding metadata to dynamic model listings for providers using OpenAIMixin 2025-09-25 04:56:54 -04:00
cerebras feat: add static embedding metadata to dynamic model listings for providers using OpenAIMixin 2025-09-25 04:56:54 -04:00
databricks feat: add static embedding metadata to dynamic model listings for providers using OpenAIMixin 2025-09-25 04:56:54 -04:00
fireworks feat: add static embedding metadata to dynamic model listings for providers using OpenAIMixin 2025-09-25 04:56:54 -04:00
gemini feat: add static embedding metadata to dynamic model listings for providers using OpenAIMixin 2025-09-25 04:56:54 -04:00
groq feat: add static embedding metadata to dynamic model listings for providers using OpenAIMixin 2025-09-25 04:56:54 -04:00
llama_openai_compat feat: add static embedding metadata to dynamic model listings for providers using OpenAIMixin 2025-09-25 04:56:54 -04:00
nvidia feat: add static embedding metadata to dynamic model listings for providers using OpenAIMixin 2025-09-25 04:56:54 -04:00
ollama feat: add static embedding metadata to dynamic model listings for providers using OpenAIMixin 2025-09-25 04:56:54 -04:00
openai feat: add static embedding metadata to dynamic model listings for providers using OpenAIMixin 2025-09-25 04:56:54 -04:00
passthrough feat: add static embedding metadata to dynamic model listings for providers using OpenAIMixin 2025-09-25 04:56:54 -04:00
runpod ci: test safety with starter (#2628) 2025-07-09 16:53:50 +02:00
sambanova feat: add static embedding metadata to dynamic model listings for providers using OpenAIMixin 2025-09-25 04:56:54 -04:00
tgi feat: add dynamic model registration support to TGI inference (#3417) 2025-09-15 15:52:40 -04:00
together feat: add static embedding metadata to dynamic model listings for providers using OpenAIMixin 2025-09-25 04:56:54 -04:00
vertexai feat: add static embedding metadata to dynamic model listings for providers using OpenAIMixin 2025-09-25 04:56:54 -04:00
vllm feat: add static embedding metadata to dynamic model listings for providers using OpenAIMixin 2025-09-25 04:56:54 -04:00
watsonx feat: add static embedding metadata to dynamic model listings for providers using OpenAIMixin 2025-09-25 04:56:54 -04:00
__init__.py impls -> inline, adapters -> remote (#381) 2024-11-06 14:54:05 -08:00