phoenix-oss/llama-stack
1
0
Fork 0
forked from phoenix-oss/llama-stack-mirror
Code Pull requests Releases Packages 2 Activity Actions

Added support for llama 3.3 model (#601)

Browse source 
# What does this PR do?

Llama-Stack does not support the 3.3 model. So added the support so
llama-stack can do inferencing with 3.3 model.
This commit is contained in:
varunfb 2024-12-10 20:03:31 -08:00 • committed by GitHub
parent 76eb558bde
commit f5c36c47ed
No known key found for this signature in database
GPG key ID: B5690EEEBB952194
1 changed files with 2 additions and 1 deletions
Download patch file Download diff file Expand all files Collapse all files

3
llama_stack/providers/utils/inference/__init__.py
View file

@ -27,7 +27,8 @@ def supported_inference_models() -> List[Model]:
m
for m in all_registered_models()
if (
m.model_family in {ModelFamily.llama3_1, ModelFamily.llama3_2}
m.model_family
in {ModelFamily.llama3_1, ModelFamily.llama3_2, ModelFamily.llama3_3}
or is_supported_safety_model(m)
)
]