Skip to content

CI-036 - Release Certification Test Matrix

Status

Done

Summary

The workspace now has a first-class release certification command:

python -m emule_workspace test certification --profile fast
python -m emule_workspace test certification --profile overnight

The command composes existing build, native, Python, UI, REST, live-network, Arr, aMuTorrent, stress, shutdown, and crash-smoke harnesses into one two-tier gate. It writes a single certification report under workspaces\v0.72a\state\certification\<timestamp>-<profile>\result.json.

Implementation

  • Build orchestration commit: 0d6d861 CI-036 add certification test matrix.
  • fast runs validation, app/test builds, Python tests, native/debug-release test flow, and focused UI/REST live proof.
  • overnight runs fast plus controller-surface live proof, full release live proof, stabilization stress, and the aMuTorrent clean-start/UI/resilience lanes.
  • Child report directories touched during each step are recorded in the aggregate report.
  • Child inconclusive live evidence is preserved as inconclusive instead of being flattened into a generic failure.

Validation

  • python -m pytest tests\test_certification.py tests\test_cli.py -q passed with 25 tests.
  • python -m pytest -q passed with 57 tests.
  • python -m compileall emule_workspace passed.
  • python -m emule_workspace test certification --help exposes the new operator-facing command.
  • python -m emule_workspace validate --config Release --platform x64 --build-output-mode ErrorsOnly passed.