mirror of
https://github.com/meta-llama/llama-stack.git
synced 2025-10-05 12:21:52 +00:00
c662d8aa31
This PR refactors the integration test system from suite-specific "contexts" to global "setups". This provides better separation of concerns: **suites = what to test, setups = how to configure.** Key changes: - New `tests/integration/setups.py` with global, reusable configurations (ollama, vllm, gpt, claude) - Simplified `tests/integration/suites.py` to only define test collection roots + default setup references - Updated CLI from `--context` to `--setup` parameter that works with any suite - Modified `scripts/integration-tests.sh` to use `--test-setup` instead of `--test-context` - Updated documentation to reflect the new global setup system Benefits: - Setups can be reused across multiple suites (e.g., use "gpt" with any suite) - Clear separation between test selection (suites) and configuration (setups) - Easier to add new configurations without modifying existing suites - Centralized configuration management Usage examples: - `pytest tests/integration --suite=responses --setup=gpt` - `pytest tests/integration --suite=vision --setup=ollama` - `pytest tests/integration --suite=base --setup=vllm` |
||
|---|---|---|
| .. | ||
| github | ||
| check-init-py.sh | ||
| check-workflows-use-hashes.sh | ||
| distro_codegen.py | ||
| gen-changelog.py | ||
| gen-ci-docs.py | ||
| generate_prompt_format.py | ||
| install.sh | ||
| integration-tests.sh | ||
| provider_codegen.py | ||
| run-ui-linter.sh | ||
| setup_telemetry.sh | ||
| unit-tests.sh | ||