phoenix-oss/llama-stack-mirror
0
0
Fork 1
mirror of https://github.com/meta-llama/llama-stack.git synced 2025-08-15 14:08:00 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions

feat(tests): record responses for evals and telemetry tests (#2954)
Some checks failed
Integration Auth Tests / test-matrix (oauth2_token) (push) Failing after 1s
Details
Integration Tests / discover-tests (push) Successful in 8s
Details
Vector IO Integration Tests / test-matrix (3.12, inline::sqlite-vec) (push) Failing after 6s
Details
SqlStore Integration Tests / test-postgres (3.13) (push) Failing after 10s
Details
SqlStore Integration Tests / test-postgres (3.12) (push) Failing after 10s
Details
Python Package Build Test / build (3.12) (push) Failing after 1s
Details
Vector IO Integration Tests / test-matrix (3.12, inline::milvus) (push) Failing after 8s
Details
Vector IO Integration Tests / test-matrix (3.12, remote::pgvector) (push) Failing after 9s
Details
Vector IO Integration Tests / test-matrix (3.13, inline::sqlite-vec) (push) Failing after 10s
Details
Vector IO Integration Tests / test-matrix (3.12, remote::chromadb) (push) Failing after 11s
Details
Test Llama Stack Build / build-custom-container-distribution (push) Failing after 5s
Details
Vector IO Integration Tests / test-matrix (3.12, inline::faiss) (push) Failing after 9s
Details
Vector IO Integration Tests / test-matrix (3.13, inline::milvus) (push) Failing after 7s
Details
Test Llama Stack Build / generate-matrix (push) Successful in 7s
Details
Vector IO Integration Tests / test-matrix (3.13, remote::pgvector) (push) Failing after 7s
Details
Test Llama Stack Build / build-single-provider (push) Failing after 10s
Details
Unit Tests / unit-tests (3.12) (push) Failing after 8s
Details
Test External API and Providers / test-external (venv) (push) Failing after 10s
Details
Test Llama Stack Build / build (push) Failing after 8s
Details
Integration Tests / test-matrix (push) Failing after 9s
Details
Unit Tests / unit-tests (3.13) (push) Failing after 11s
Details
Vector IO Integration Tests / test-matrix (3.13, remote::chromadb) (push) Failing after 29s
Details
Test External Providers Installed via Module / test-external-providers-from-module (venv) (push) Failing after 26s
Details
Vector IO Integration Tests / test-matrix (3.13, inline::faiss) (push) Failing after 39s
Details
Python Package Build Test / build (3.13) (push) Failing after 38s
Details
Test Llama Stack Build / build-ubi9-container-distribution (push) Failing after 41s
Details
Pre-commit / pre-commit (push) Successful in 2m2s
Details

Browse source 
Continuing with https://github.com/meta-llama/llama-stack/pull/2952

This also includes a "fix" to inference store related tests so that we
pull a large number of inference responses from the DB so as to always
find the one we just wrote.
This commit is contained in:
Ashwin Bharambe 2025-07-29 15:46:21 -07:00 • committed by GitHub
parent 81c7d6fa2e
commit 0ac503ec0d
No known key found for this signature in database
GPG key ID: B5690EEEBB952194
13 changed files with 881 additions and 41 deletions
Download patch file Download diff file Expand all files Collapse all files

4
tests/integration/inference/test_openai_completion.py
View file

@ -345,7 +345,7 @@ def test_inference_store(compat_client, client_with_models, text_model_id, strea
response_id = response.id
content = response.choices[0].message.content
responses = client.chat.completions.list()
responses = client.chat.completions.list(limit=1000)
assert response_id in [r.id for r in responses.data]
retrieved_response = client.chat.completions.retrieve(response_id)
@ -410,7 +410,7 @@ def test_inference_store_tool_calls(compat_client, client_with_models, text_mode
response_id = response.id
content = response.choices[0].message.content
responses = client.chat.completions.list()
responses = client.chat.completions.list(limit=1000)
assert response_id in [r.id for r in responses.data]
retrieved_response = client.chat.completions.retrieve(response_id)