phoenix-oss/llama-stack-mirror
0
0
Fork 1
mirror of https://github.com/meta-llama/llama-stack.git synced 2025-08-15 22:18:00 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions

chore(misc): make tests and starter faster (#3042)
Some checks failed
Integration Tests (Replay) / discover-tests (push) Successful in 3s
Details
Test External Providers Installed via Module / test-external-providers-from-module (venv) (push) Has been skipped
Details
Integration Auth Tests / test-matrix (oauth2_token) (push) Failing after 9s
Details
Python Package Build Test / build (3.12) (push) Failing after 4s
Details
Vector IO Integration Tests / test-matrix (3.12, inline::milvus) (push) Failing after 12s
Details
Test Llama Stack Build / generate-matrix (push) Successful in 11s
Details
Test Llama Stack Build / build-ubi9-container-distribution (push) Failing after 12s
Details
Vector IO Integration Tests / test-matrix (3.12, inline::faiss) (push) Failing after 14s
Details
SqlStore Integration Tests / test-postgres (3.12) (push) Failing after 22s
Details
Test External API and Providers / test-external (venv) (push) Failing after 14s
Details
Integration Tests (Replay) / Integration Tests (, , , client=, vision=) (push) Failing after 12s
Details
Vector IO Integration Tests / test-matrix (3.12, remote::pgvector) (push) Failing after 15s
Details
SqlStore Integration Tests / test-postgres (3.13) (push) Failing after 22s
Details
Test Llama Stack Build / build-custom-container-distribution (push) Failing after 14s
Details
Unit Tests / unit-tests (3.13) (push) Failing after 14s
Details
Test Llama Stack Build / build-single-provider (push) Failing after 13s
Details
Vector IO Integration Tests / test-matrix (3.12, remote::chromadb) (push) Failing after 18s
Details
Unit Tests / unit-tests (3.12) (push) Failing after 16s
Details
Vector IO Integration Tests / test-matrix (3.12, remote::qdrant) (push) Failing after 18s
Details
Vector IO Integration Tests / test-matrix (3.13, remote::weaviate) (push) Failing after 10s
Details
Vector IO Integration Tests / test-matrix (3.13, inline::faiss) (push) Failing after 11s
Details
Vector IO Integration Tests / test-matrix (3.12, remote::weaviate) (push) Failing after 16s
Details
Vector IO Integration Tests / test-matrix (3.13, remote::qdrant) (push) Failing after 18s
Details
Test Llama Stack Build / build (push) Failing after 12s
Details
Vector IO Integration Tests / test-matrix (3.13, remote::chromadb) (push) Failing after 18s
Details
Vector IO Integration Tests / test-matrix (3.13, remote::pgvector) (push) Failing after 20s
Details
Vector IO Integration Tests / test-matrix (3.13, inline::sqlite-vec) (push) Failing after 16s
Details
Python Package Build Test / build (3.13) (push) Failing after 53s
Details
Vector IO Integration Tests / test-matrix (3.13, inline::milvus) (push) Failing after 59s
Details
Vector IO Integration Tests / test-matrix (3.12, inline::sqlite-vec) (push) Failing after 1m1s
Details
Update ReadTheDocs / update-readthedocs (push) Failing after 1m6s
Details
Pre-commit / pre-commit (push) Successful in 1m53s
Details

Browse source 
A bunch of miscellaneous cleanup focusing on tests, but ended up
speeding up starter distro substantially.

- Pulled llama stack client init for tests into `pytest_sessionstart` so
it does not clobber output
- Profiling of that told me where we were doing lots of heavy imports
for starter, so lazied them
- starter now starts 20seconds+ faster on my Mac
- A few other smallish refactors for `compat_client`
This commit is contained in:
Ashwin Bharambe 2025-08-05 14:55:05 -07:00 • committed by GitHub
parent e12524af85
commit 7f834339ba
No known key found for this signature in database
GPG key ID: B5690EEEBB952194
45 changed files with 2897 additions and 1688 deletions
Download patch file Download diff file Expand all files Collapse all files

98
tests/integration/recordings/responses/4a3a4447b16b.json
View file

@ -14,7 +14,7 @@
"models": [
{
"model": "nomic-embed-text:latest",
"modified_at": "2025-08-04T15:54:50.584357-07:00",
"modified_at": "2025-08-05T14:04:07.946926-07:00",
"digest": "0a109f422b47e3a30ba2b10eca18548e944e8a23073ee3f3e947efcf3c45e59f",
"size": 274302450,
"details": {
@ -28,9 +28,41 @@
"quantization_level": "F16"
}
},
{
"model": "llama3.2-vision:11b",
"modified_at": "2025-07-30T18:45:02.517873-07:00",
"digest": "6f2f9757ae97e8a3f8ea33d6adb2b11d93d9a35bef277cd2c0b1b5af8e8d0b1e",
"size": 7816589186,
"details": {
"parent_model": "",
"format": "gguf",
"family": "mllama",
"families": [
"mllama"
],
"parameter_size": "10.7B",
"quantization_level": "Q4_K_M"
}
},
{
"model": "llama3.2-vision:latest",
"modified_at": "2025-07-29T20:18:47.920468-07:00",
"digest": "6f2f9757ae97e8a3f8ea33d6adb2b11d93d9a35bef277cd2c0b1b5af8e8d0b1e",
"size": 7816589186,
"details": {
"parent_model": "",
"format": "gguf",
"family": "mllama",
"families": [
"mllama"
],
"parameter_size": "10.7B",
"quantization_level": "Q4_K_M"
}
},
{
"model": "llama-guard3:1b",
"modified_at": "2025-08-01T15:46:28.963517-07:00",
"modified_at": "2025-07-25T14:39:44.978630-07:00",
"digest": "494147e06bf99e10dbe67b63a07ac81c162f18ef3341aa3390007ac828571b3b",
"size": 1600181919,
"details": {
@ -46,7 +78,7 @@
},
{
"model": "all-minilm:l6-v2",
"modified_at": "2025-07-29T15:07:06.295748-07:00",
"modified_at": "2025-07-24T15:15:11.129290-07:00",
"digest": "1b226e2802dbb772b5fc32a58f103ca1804ef7501331012de126ab22f67475ef",
"size": 45960996,
"details": {
@ -61,26 +93,10 @@
}
},
{
"model": "all-minilm:latest",
"modified_at": "2025-06-04T12:06:43.990073-07:00",
"digest": "1b226e2802dbb772b5fc32a58f103ca1804ef7501331012de126ab22f67475ef",
"size": 45960996,
"details": {
"parent_model": "",
"format": "gguf",
"family": "bert",
"families": [
"bert"
],
"parameter_size": "23M",
"quantization_level": "F16"
}
},
{
"model": "llama3.1:8b-instruct-fp16",
"modified_at": "2025-02-14T15:23:24.865395-08:00",
"digest": "4aacac4194543ff7f70dab3f2ebc169c132d5319bb36f7a7e99c4ff525ebcc09",
"size": 16068910253,
"model": "llama3.2:1b",
"modified_at": "2025-07-17T22:02:24.953208-07:00",
"digest": "baf6a787fdffd633537aa2eb51cfd54cb93ff08e28040095462bb63daf552878",
"size": 1321098329,
"details": {
"parent_model": "",
"format": "gguf",
@ -88,13 +104,45 @@
"families": [
"llama"
],
"parameter_size": "8.0B",
"parameter_size": "1.2B",
"quantization_level": "Q8_0"
}
},
{
"model": "all-minilm:latest",
"modified_at": "2025-06-03T16:50:10.946583-07:00",
"digest": "1b226e2802dbb772b5fc32a58f103ca1804ef7501331012de126ab22f67475ef",
"size": 45960996,
"details": {
"parent_model": "",
"format": "gguf",
"family": "bert",
"families": [
"bert"
],
"parameter_size": "23M",
"quantization_level": "F16"
}
},
{
"model": "llama3.2:3b",
"modified_at": "2025-05-01T11:15:23.797447-07:00",
"digest": "a80c4f17acd55265feec403c7aef86be0c25983ab279d83f3bcd3abbcb5b8b72",
"size": 2019393189,
"details": {
"parent_model": "",
"format": "gguf",
"family": "llama",
"families": [
"llama"
],
"parameter_size": "3.2B",
"quantization_level": "Q4_K_M"
}
},
{
"model": "llama3.2:3b-instruct-fp16",
"modified_at": "2025-01-21T13:46:43.514008-08:00",
"modified_at": "2025-04-30T15:33:48.939665-07:00",
"digest": "195a8c01d91ec3cb1e0aad4624a51f2602c51fa7d96110f8ab5a20c84081804d",
"size": 6433703586,
"details": {