Statistical Audit Overview Statistical Validity Score ↳ Normality & Homoscedasticity ↳ Effect Size Reporting ↳ CI Reporting ↳ Power & Sample Size ↳ Multiple Comparison ↳ Replication Type ↳ Missing Data Disclosure ↳ Outlier Pre-Registration Robustness & Sensitivity ↳ Sensitivity Analysis Engine ↳ Conclusion Sensitivity Profile ↳ Multiverse Analysis ↳ Outlier Sensitivity Report Estimation Methods ↳ Bootstrap CI ↳ Permutation Test ↳ Bayes Factor Supplement ↳ Assumption & Robustness Guard Test Configuration Guard ↳ Paired vs Unpaired Guard ↳ Multiple Comparison Enforce. ↳ One-Sided Test Lock ↳ Proportion OLS Prevention Experimental Design Guard ↳ Pseudoreplication Detection ↳ Bio vs Technical Replicate ↳ Batch / Plate Confounding ↳ Repeated Measures Suggestion Confounding & Independence ↳ Independence Formal Check ↳ Confounding Disclosure ↳ Covariate Selection Audit Regression & Modeling Guard ↳ Regression Diagnostics Guard ↳ Compositional Data Warning ↳ Sample Size Justification

Robustness & Sensitivity

A result that changes with small perturbations to the data or analysis choices is not a robust result. Robustness testing is not a supplementary activity — it is the mechanism by which you evaluate whether your conclusion would survive replication under slightly different conditions.

What is Robustness & Sensitivity?

Licklider's Robustness & Sensitivity module targets parallel analyses across defined variations — outlier handling, parametric paths, and (where supported) alternative estimators — to produce a conclusion stability profile. Full parity for non-parametric branches is not guaranteed in the current product (see Non-Parametric Alternatives). If the primary conclusion holds across tested variations, the result is robust; if it depends on a specific choice, that dependency is disclosed.

Robustness testing does not change your result. It evaluates the sensitivity of your existing result to reasonable analytical alternatives. The primary result remains the primary result; the robustness tests appear as supporting evidence that the conclusion is not an artifact of a specific decision.

Four Components