llama-stack-mirror/.github/workflows
Ashwin Bharambe 74196fce26 feat: add backward compatibility tests for run.yaml
Add automated testing to catch breaking changes to StackRunConfig
before they reach users.

- Schema validation: pytest-based test validates old run.yaml files
  parse with current StackRunConfig
- Integration tests: run full test suite with old ci-tests run.yaml
  to catch runtime semantic issues
- Dual baseline: test against both main (blocks PRs) and latest
  release (informational)
- Breaking change acknowledgment: require '!:' in PR title or
  'BREAKING CHANGE:' in commit message to merge breaking changes

Resolves #3311
Related to #3237
2025-10-28 16:33:15 -07:00
..
backward-compat.yml feat: add backward compatibility tests for run.yaml 2025-10-28 16:33:15 -07:00
changelog.yml chore(github-deps): bump actions/checkout from 4.2.2 to 5.0.0 (#3178) 2025-08-20 16:51:40 -07:00
conformance.yml feat(api)!: BREAKING CHANGE: support passing extra_body through to providers (#3777) 2025-10-10 16:21:44 -07:00
install-script-ci.yml chore: use dockerfile for building containers (#3839) 2025-10-20 10:23:01 -07:00
integration-auth-tests.yml chore(package): migrate to src/ layout (#3920) 2025-10-27 12:02:21 -07:00
integration-sql-store-tests.yml chore(package): migrate to src/ layout (#3920) 2025-10-27 12:02:21 -07:00
integration-tests.yml chore(package): migrate to src/ layout (#3920) 2025-10-27 12:02:21 -07:00
integration-vector-io-tests.yml chore(package): migrate to src/ layout (#3920) 2025-10-27 12:02:21 -07:00
pre-commit.yml chore(package): migrate to src/ layout (#3920) 2025-10-27 12:02:21 -07:00
precommit-trigger.yml chore(package): migrate to src/ layout (#3920) 2025-10-27 12:02:21 -07:00
providers-build.yml chore(package): migrate to src/ layout (#3920) 2025-10-27 12:02:21 -07:00
providers-list-deps.yml chore(package): migrate to src/ layout (#3920) 2025-10-27 12:02:21 -07:00
python-build-test.yml chore(package): migrate to src/ layout (#3920) 2025-10-27 12:02:21 -07:00
README.md feat: add backward compatibility tests for run.yaml 2025-10-28 16:33:15 -07:00
record-integration-tests.yml feat(tests): make inference_recorder into api_recorder (include tool_invoke) (#3403) 2025-10-09 14:27:51 -07:00
semantic-pr.yml chore(github-deps): bump amannn/action-semantic-pull-request from 6.1.0 to 6.1.1 (#3248) 2025-08-25 17:34:17 +02:00
stale_bot.yml chore(github-deps): bump actions/stale from 10.0.0 to 10.1.0 (#3684) 2025-10-08 12:16:54 +02:00
test-external-provider-module.yml chore(package): migrate to src/ layout (#3920) 2025-10-27 12:02:21 -07:00
test-external.yml chore(package): migrate to src/ layout (#3920) 2025-10-27 12:02:21 -07:00
ui-unit-tests.yml chore(package): migrate to src/ layout (#3920) 2025-10-27 12:02:21 -07:00
unit-tests.yml chore(package): migrate to src/ layout (#3920) 2025-10-27 12:02:21 -07:00

Llama Stack CI

Llama Stack uses GitHub Actions for Continuous Integration (CI). Below is a table detailing what CI the project includes and the purpose.

Name File Purpose
Backward Compatibility Check backward-compat.yml Check backward compatibility for run.yaml configs
Update Changelog changelog.yml Creates PR for updating the CHANGELOG.md
API Conformance Tests conformance.yml Run the API Conformance test suite on the changes.
Installer CI install-script-ci.yml Test the installation script
Integration Auth Tests integration-auth-tests.yml Run the integration test suite with Kubernetes authentication
SqlStore Integration Tests integration-sql-store-tests.yml Run the integration test suite with SqlStore
Integration Tests (Replay) integration-tests.yml Run the integration test suites from tests/integration in replay mode
Vector IO Integration Tests integration-vector-io-tests.yml Run the integration test suite with various VectorIO providers
Pre-commit pre-commit.yml Run pre-commit checks
Pre-commit Bot precommit-trigger.yml Pre-commit bot for PR
Test Llama Stack Build providers-build.yml Test llama stack build
Test llama stack list-deps providers-list-deps.yml Test llama stack list-deps
Python Package Build Test python-build-test.yml Test building the llama-stack PyPI project
Integration Tests (Record) record-integration-tests.yml Run the integration test suite from tests/integration
Check semantic PR titles semantic-pr.yml Ensure that PR titles follow the conventional commit spec
Close stale issues and PRs stale_bot.yml Run the Stale Bot action
Test External Providers Installed via Module test-external-provider-module.yml Test External Provider installation via Python module
Test External API and Providers test-external.yml Test the External API and Provider mechanisms
UI Tests ui-unit-tests.yml Run the UI test suite
Unit Tests unit-tests.yml Run the unit test suite