Test Configuration Guard
Test configuration errors are a common source of avoidable statistical mistakes in published research. Paired vs. unpaired mismatches, missing multiple comparison corrections, and undisclosed one-sided tests each have predictable, detectable patterns. The pages below describe how the current product surfaces these risks.
What is Test Configuration Guard?
The Test Configuration Guard covers four areas of test selection and configuration. Each page describes a specific decision point and how the current product handles it. Implementation depth varies; see each page for current product behavior and known limitations.
Guards vs. recommendations: Guards do not recommend a specific test. They detect configurations that are internally inconsistent or that require mandatory disclosure, and they require the user to resolve the inconsistency explicitly before proceeding. The choice of analysis always remains with the researcher.