phoenix-oss/llama-stack
1
0
Fork 0
forked from phoenix-oss/llama-stack-mirror
Code Pull requests Releases Packages 2 Activity Actions

fix: use torchao 0.8.0 for inference (#1925)

Browse source 
# What does this PR do?

While building the "experimental-post-training" distribution, we
encountered a version conflict between torchao with inference requiring
version 0.5.0 and training currently depending on version 0.8.0.

Resolves this error:

```
  × No solution found when resolving dependencies:
  ╰─▶ Because you require torchao==0.5.0 and torchao==0.8.0, we can conclude that your requirements are unsatisfiable.
ERROR    2025-04-10 10:41:22,597 llama_stack.distribution.build:128 uncategorized: Failed to build target test with
         return code 1
```

Signed-off-by: Sébastien Han <seb@redhat.com>
This commit is contained in:
Sébastien Han 2025-04-10 22:39:20 +02:00 • committed by GitHub
parent 79fc81f78f
commit edd9aaac3b
No known key found for this signature in database
GPG key ID: B5690EEEBB952194
2 changed files with 2 additions and 2 deletions
Download patch file Download diff file Expand all files Collapse all files

2
llama_stack/providers/registry/inference.py
View file

@ -24,7 +24,7 @@ META_REFERENCE_DEPS = [
"zmq", "zmq",
"lm-format-enforcer", "lm-format-enforcer",
"sentence-transformers", "sentence-transformers",
"torchao==0.5.0", "torchao==0.8.0",
"fbgemm-gpu-genai==1.1.2", "fbgemm-gpu-genai==1.1.2",
] ]

2
llama_stack/templates/dependencies.json
View file

@ -381,7 +381,7 @@
"sentence-transformers", "sentence-transformers",
"sentencepiece", "sentencepiece",
"torch", "torch",
"torchao==0.5.0", "torchao==0.8.0",
"torchvision", "torchvision",
"tqdm", "tqdm",
"transformers", "transformers",