Add fault injection testing CI infrastructure #73

Closed
opened 2026-01-21 15:44:52 +00:00 by jabber.developer2 · 0 comments
Collaborator

Summary

Add infrastructure for fault injection testing to verify that tests correctly detect failures and CI pipeline properly reports them.

Motivation

Currently there's no automated way to verify that:

  1. Unit tests actually fail when expected behavior is broken
  2. CI pipeline correctly reports test failures
  3. Cached Docker images don't mask test failures

Requirements

  1. Test failure verification at CI startup

    • Create a deliberately failing test
    • Verify exit code is non-zero
    • Abort CI if failure detection is broken
  2. Parallel failure detection verification

    • Simulate parallel test execution with mixed results
    • Verify that failures in background processes are caught
  3. Run automatically on every CI build

    • No manual trigger needed
    • Clear output showing verification status

Acceptance Criteria

  • CI aborts with clear error if test failures are not detected
  • Parallel test failures are properly caught
  • Verification runs before actual tests
### Summary Add infrastructure for fault injection testing to verify that tests correctly detect failures and CI pipeline properly reports them. ### Motivation Currently there's no automated way to verify that: 1. Unit tests actually fail when expected behavior is broken 2. CI pipeline correctly reports test failures 3. Cached Docker images don't mask test failures ### Requirements 1. **Test failure verification at CI startup** - Create a deliberately failing test - Verify exit code is non-zero - Abort CI if failure detection is broken 2. **Parallel failure detection verification** - Simulate parallel test execution with mixed results - Verify that failures in background processes are caught 3. **Run automatically on every CI build** - No manual trigger needed - Clear output showing verification status ### Acceptance Criteria - [ ] CI aborts with clear error if test failures are not detected - [ ] Parallel test failures are properly caught - [ ] Verification runs before actual tests
jabber.developer2 added this to the Plans (2025-2026) project 2026-01-21 15:44:59 +00:00
jabber.developer2 self-assigned this 2026-01-21 15:45:04 +00:00
jabber.developer2 added reference feat/parallel-tests-clean 2026-01-21 15:45:14 +00:00
jabber.developer2 added the
Kind/Testing
label 2026-01-21 15:45:31 +00:00
jabber.developer2 changed title from Add fault injection testing infrastructure to Add fault injection testing CI infrastructure 2026-01-21 15:50:34 +00:00
jabber.developer moved this to Done in Plans (2025-2026) on 2026-01-21 15:55:10 +00:00
Sign in to join this conversation.
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: devs/cproof#73
No description provided.