phoenix-oss/llama-stack
1
0
Fork 0
forked from phoenix-oss/llama-stack-mirror
Code Pull requests Releases Packages 2 Activity Actions

refactor: move llama3 impl to meta_reference provider (#1364)

Browse source 
Just moving bits to a better place

## Test Plan

```bash
torchrun $CONDA_PREFIX/bin/pytest -s -v test_text_inference.py
```
This commit is contained in:
Ashwin Bharambe 2025-03-03 13:22:57 -08:00 • committed by GitHub
parent af396e3809
commit 725423c95c
No known key found for this signature in database
GPG key ID: B5690EEEBB952194
10 changed files with 7 additions and 9 deletions
Download patch file Download diff file Expand all files Collapse all files

26
llama_stack/models/llama/llama3/multimodal/utils.py
View file

@ -1,26 +0,0 @@
# Copyright (c) Meta Platforms, Inc. and affiliates.
# All rights reserved.
#
# This source code is licensed under the terms described in the LICENSE file in
# the root directory of this source tree.
# Copyright (c) Meta Platforms, Inc. and affiliates.
# All rights reserved.
#
# This source code is licensed under the terms described in the LICENSE file in
# top-level folder for each specific model found within the models/ directory at
# the top-level of this source tree.
import collections
import torch
def get_negative_inf_value(dtype):
return torch.finfo(dtype).min
def to_2tuple(x):
if isinstance(x, collections.abc.Iterable):
return x
return (x, x)