Reporting Checklists Overview

How Licklider's quality checks relate to common scientific reporting guidelines, and which checklist items are covered by the current implementation.

Scientific reporting guidelines — such as ARRIVE for animal studies, CONSORT for clinical trials, and STROBE for observational studies — specify which methodological details must be reported in a publication. Many of the statistical reporting items in these guidelines correspond to quality checks that Licklider runs automatically.

This page maps Licklider's current quality checks to the statistical reporting requirements of common guidelines. It is a static reference, not an automated checklist validator. Automated checklist generation is planned for a future release.

Statistical reporting items covered by Licklider

The following items appear in common reporting guidelines and are addressed by Licklider's current implementation:

Sample size and attrition The number of observations used in the analysis, how many were excluded, and why, are recorded in the analysis record and available for export. → see N Disclosure and Attrition Trail

Statistical test selection and justification The test used, the basis for selection (normality check results, design structure), and any manual overrides are recorded. → see Normality and Homoscedasticity, Choose the Right Test

Effect size and confidence intervals Effect size and 95% confidence intervals are reported alongside p-values for all applicable analyses. → see Effect Size, CI, and N Reporting

Multiple comparisons When pairwise comparisons are requested across three or more groups, a correction method must be declared. The method used is recorded in the analysis record. → see Multiplicity and Analysis Families

Outlier handling Whether outliers were excluded, which observations were affected, and the sensitivity of the result to their inclusion or exclusion are recorded. → see Outlier Exclusion Log, Outlier Sensitivity Report

Randomization and independence Whether the data structure suggests non-independent observations (pseudoreplication, batch effects) is checked automatically. → see Pseudoreplication Detection, Batch and Plate Confounding

Missing data The mechanism and extent of missing data are evaluated and disclosed. → see Missing Data and Attrition

Items not currently covered

The following items appear in reporting guidelines but are not currently addressed by Licklider's implementation:

  • Randomization method and sequence generation
  • Allocation concealment and blinding
  • Ethical approval and animal welfare statements
  • Study registration details
  • Funding and conflicts of interest

These items require information that exists outside the data and analysis, and cannot be inferred from the dataset alone.

Guideline-specific notes

ARRIVE (animal research) The statistical items in ARRIVE 2.0 — sample size justification, inclusion/exclusion criteria, outlier handling, and statistical test reporting — are largely covered by the items listed above. Animal welfare, housing, and procedural details are outside scope.

CONSORT (clinical trials) Statistical items including randomization, sample size, and outcome reporting are partially covered. Trial registration, allocation concealment, and blinding are outside scope.

STROBE (observational studies) Statistical items including confounding, missing data, and sensitivity analyses are partially covered. Study design description and participant selection criteria are outside scope.

What this page does not cover