phoenix-oss/llama-stack-mirror
0
0
Fork 1
mirror of https://github.com/meta-llama/llama-stack.git synced 2025-10-04 12:07:34 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions

chore: OpenAIMixin implements ModelsProtocolPrivate (#3662)

Browse source 
# What does this PR do?

add ModelsProtocolPrivate methods to OpenAIMixin

this will allow providers using OpenAIMixin to use a common interface


## Test Plan

ci w/ new tests
This commit is contained in:
Matthew Farrellee 2025-10-03 00:32:02 -04:00 • committed by Raghotham Murthy
parent cf422da825
commit 873a400544
8 changed files with 243 additions and 11 deletions
Download patch file Download diff file Expand all files Collapse all files

2
llama_stack/providers/remote/inference/tgi/tgi.py
View file

@ -29,7 +29,6 @@ from llama_stack.apis.models import Model
from llama_stack.apis.models.models import ModelType
from llama_stack.log import get_logger
from llama_stack.models.llama.sku_list import all_registered_models
from llama_stack.providers.datatypes import ModelsProtocolPrivate
from llama_stack.providers.utils.inference.model_registry import (
ModelRegistryHelper,
build_hf_repo_model_entry,
@ -65,7 +64,6 @@ def build_hf_repo_model_entries():
class _HfAdapter(
OpenAIMixin,
Inference,
ModelsProtocolPrivate,
):
url: str
api_key: SecretStr