phoenix-oss/llama-stack
1
0
Fork 0
forked from phoenix-oss/llama-stack-mirror
Code Pull requests Releases Packages 2 Activity Actions

fix: resolve type hint issues and import dependencies (#1176)

Browse source 
# What does this PR do?

- Fixed type hinting and missing imports across multiple modules.
- Improved compatibility by using `TYPE_CHECKING` for conditional
imports.
- Updated `pyproject.toml` to enforce stricter linting.

Signed-off-by: Sébastien Han <seb@redhat.com>

Signed-off-by: Sébastien Han <seb@redhat.com>
This commit is contained in:
Sébastien Han 2025-02-25 20:06:47 +01:00 • committed by GitHub
parent 1a044ef894
commit c223b1862b
No known key found for this signature in database
GPG key ID: B5690EEEBB952194
7 changed files with 14 additions and 5 deletions
Download patch file Download diff file Expand all files Collapse all files

7
llama_stack/providers/utils/inference/embedding_mixin.py
View file

@ -5,7 +5,10 @@
# the root directory of this source tree.
import logging
from typing import List, Optional
from typing import TYPE_CHECKING, List, Optional
if TYPE_CHECKING:
from sentence_transformers import SentenceTransformer
from llama_stack.apis.inference import (
EmbeddingsResponse,
@ -40,7 +43,7 @@ class SentenceTransformerEmbeddingMixin:
)
return EmbeddingsResponse(embeddings=embeddings)
def _load_sentence_transformer_model(self, model: str) -> "SentenceTransformer":
def _load_sentence_transformer_model(self, model: str) -> SentenceTransformer:
global EMBEDDING_MODELS
loaded_model = EMBEDDING_MODELS.get(model)