phoenix-oss/llama-stack-mirror
0
0
Fork 1
mirror of https://github.com/meta-llama/llama-stack.git synced 2025-08-12 04:50:39 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions

fix: post_training ci (#2984)
Some checks failed
Integration Tests / discover-tests (push) Has been skipped
Details
Vector IO Integration Tests / test-matrix (3.12, inline::faiss) (push) Failing after 5s
Details
Python Package Build Test / build (3.12) (push) Failing after 10s
Details
Test External Providers Installed via Module / test-external-providers-from-module (venv) (push) Failing after 4s
Details
Integration Auth Tests / test-matrix (oauth2_token) (push) Failing after 25s
Details
Test External API and Providers / test-external (venv) (push) Failing after 6s
Details
Vector IO Integration Tests / test-matrix (3.13, remote::chromadb) (push) Failing after 24s
Details
Vector IO Integration Tests / test-matrix (3.12, remote::chromadb) (push) Failing after 26s
Details
Integration Tests / record-tests (push) Has been skipped
Details
SqlStore Integration Tests / test-postgres (3.12) (push) Failing after 28s
Details
Python Package Build Test / build (3.13) (push) Failing after 14s
Details
Vector IO Integration Tests / test-matrix (3.12, inline::sqlite-vec) (push) Failing after 28s
Details
Integration Tests / run-tests (push) Has been skipped
Details
Vector IO Integration Tests / test-matrix (3.12, inline::milvus) (push) Failing after 31s
Details
Vector IO Integration Tests / test-matrix (3.13, inline::faiss) (push) Failing after 26s
Details
Vector IO Integration Tests / test-matrix (3.13, inline::milvus) (push) Failing after 29s
Details
Unit Tests / unit-tests (3.13) (push) Failing after 12s
Details
Unit Tests / unit-tests (3.12) (push) Failing after 14s
Details
Vector IO Integration Tests / test-matrix (3.13, remote::pgvector) (push) Failing after 27s
Details
Vector IO Integration Tests / test-matrix (3.12, remote::pgvector) (push) Failing after 42s
Details
Vector IO Integration Tests / test-matrix (3.13, inline::sqlite-vec) (push) Failing after 40s
Details
SqlStore Integration Tests / test-postgres (3.13) (push) Failing after 45s
Details
Pre-commit / pre-commit (push) Successful in 1m30s
Details

Browse source
This commit is contained in:
Charlie Doern 2025-07-31 11:26:06 -04:00 • committed by GitHub
parent cf73146132
commit 5c33bc1353
No known key found for this signature in database
GPG key ID: B5690EEEBB952194
1 changed files with 5 additions and 2 deletions
Download patch file Download diff file Expand all files Collapse all files

7
tests/integration/post_training/test_post_training.py
View file

@ -194,9 +194,12 @@ class TestPostTraining:
# DPO algorithm configuration
algorithm_config = DPOAlignmentConfig(
beta=0.1,
loss_type=DPOLossType.sigmoid,
loss_type=DPOLossType.sigmoid, # Default loss type
reward_scale=1.0, # Scaling factor for reward signal (neutral scaling)
reward_clip=5.0, # Maximum absolute value for reward clipping (prevents extreme values)
epsilon=1e-8, # Small value for numerical stability
gamma=1.0,
)
data_config = DataConfig(
dataset_id=dataset.identifier,
batch_size=1,