Design · 3.13
Validation, acceptance and regression
Time: about 11–14 minutes including the task; estimate
Guiding question: What must be established before a trial so its result can support a decision?
Learning objective: You distinguish demonstration, validation, acceptance and regression.
Prerequisites: Previous lessons through 3.12, particularly the case file developed there.
The test must support a decision
Talbahn plans a transmission-path change. A video shows that the call continued once. This is a demonstration: an observable display of a capability. A substantiated decision additionally needs a defined expected result, known conditions and a repeatable procedure.
Conformity means compliance with specified requirements. The claim remains bounded by the named requirements and assessment scope. Validation checks whether the solution fulfils its intended purpose in the use being considered. It connects the technical result to intended use. Acceptance is formal approval of a result by the responsible party against agreed criteria. It records an accountable decision to accept, including any conditions. These terms address different questions, even if one trial supports several of them.
A test case with boundaries
| Field | TB-T-041: controlled failure of one transmission path |
|---|---|
| Purpose | Test an ongoing MCPTT group call's behaviour when path A is lost |
| Reference | Project requirement for service continuation; add its identifier and approved expected behaviour |
| Starting state | Named devices and software; authorised participants; ongoing call; paths A and B available |
| Intervention | Interrupt path A under control at the specified point |
| Observation | Service state, media reception, interruption duration, indications and path used |
| Expectation | Behaviour matches the previously approved requirement; no unintended incorrect participant assignment |
| Counter-test | Same intervention with path B unavailable; test expected failure handling |
| Evidence | Configurations, time base, records, results and deviations |
This table is a test template. It becomes executable only when the specific expected behaviour, intervention point and necessary safeguards in the test environment are established. An empty expectation field must not be replaced afterwards with “looked good”.
Limit and measurement must answer the same question
To assess an interruption, its beginning and end must be defined. A packet-delay value from 3.7 is not a substitute for a speech-interruption requirement.
For a pure learning exercise, Talbahn may use an explicitly fictional threshold. For project acceptance, the value must instead come from applicable requirements and operational assessment. The test report identifies its origin.
Failure is a useful result too
A failed test is documented with observed behaviour, expected behaviour and the affected requirement. Root-cause analysis follows separately. It then remains traceable whether configuration must be corrected, implementation changed or a requirement clarified.
A regression test rechecks previously considered functions after a change if that change could affect them. Scope and selection follow the dependencies identified by traceability. Not every fault requires repeating every trial, but the selection must be justified.
The case file receives an executable version of TB-T-041 and its allocation to migration transitions. Without a passing result, a transition may remain restricted.
Check your understanding
The trial works with two available paths. The supplier removes the counter-test without path B because it is “not normal operation”. Why does the test remain relevant?
Model answer
The counter-test checks whether intended failure detection and handling occur when no alternative is available. Without it, continuation has only been observed under the favourable condition of an available second path. Operational and rollback planning also need to know how the system responds when that prerequisite is absent.
What to remember
A test supports a decision when expected behaviour, conditions, intervention and observations are established before the result.
Your Talbahn case file
Complete TB-T-041 with approved expected behaviour and measurement boundaries. Plan the counter-test without an available second path.
Your progress is stored in this browser on this device.