TRANSDUCTIVE SCIENCESCIENCE AFTER HUMANS / 001ED. 01 / 2026
W23 / Bias

Data dredging

Exploratory searches are routinely mistaken for tests whose evidential threshold was fixed beforehand.

01 / Source of departure [W23] ↗

What the reference describes.

Data dredging, also known as data snooping or p-hacking, is the misuse of data analysis to find patterns in data that can be presented as statistically significant, thus dramatically increasing and understating the risk of false positives. This is done by performing many statistical tests on the data and only reporting those that come back with significant results. Thus data dredging is also often a misused or misapplied form of data mining. The process of data dredging involves testing multiple hypotheses using a single data set by exhaustively searching—perhaps for combinations of variables that might show a correlation, and perhaps for groups of cases or observations that show differences in their mean or in their breakdown by some other variable.
Shortened extract from “Data dredging”, English Wikipedia contributors, revision 1377936004; original text licensed CC BY-SA 4.0. Excerpt shortened, line breaks normalized. For full article references and edit history, open the fixed source revision. The independent critique below is not Wikipedia text.
02 / Inherited constraint

What the process still cannot guarantee.

Exploratory searches are routinely mistaken for tests whose evidential threshold was fixed beforehand.

That is a design criticism of how this research operation may be used, not a claim that the encyclopedia endorses the limitation. In this domain, the general redesign question is: human and machine distortions move from behavioral advice into enforceable evidence-lineage constraints.

03 / Machine-native reconstruction

Replace the mechanism.

Permit unlimited exploration but quarantine confirmatory evidence and record dataset exposure.

Implementation requires a typed scientific claim, explicit operational definitions, controlled access to evidence, an immutable record of relevant transformations, and independent checking appropriate to the kind of assertion. An AI-generated interpretation without those checks would reproduce the underlying failure at greater speed.

04 / Adversarial acceptance test

What would demonstrate improvement?

Have agents explore thousands of predictors then verify discoveries on untouched data.

Compare with a defined baseline under matched resources, keep evaluation cases independent of the system under test, and measure both false alarms and undetected errors. Publish any negative or inconclusive result as part of the same investigation record.

Unresolved requirement. These are proposed experiments, not completed demonstrations. Better generated explanations are not proof of better scientific inference.
05 / Adjacent evidence

Continue across concepts.

Each related title has its own revision-specific Wikipedia source and a separate critical dossier. Crosslinks are exploratory; they do not imply the encyclopedia articles support the proposed replacement.

06 / Verification & provenance

No single authority.

The reference article establishes the historical and methodological subject under examination. The proposed criticism and replacement must earn their own support through reproducible tests and independent validation. Record disagreements instead of silently overwriting them.

Current Wikipedia article ↗ · Exact reference revision ↗ · Complete source ledger ↗