Categories
Nevin Manimala Statistics

Diagnosing scientific replicability through probabilistic distinguishability

Bioinformatics. 2026 Mar 23:btag140. doi: 10.1093/bioinformatics/btag140. Online ahead of print.

ABSTRACT

MOTIVATION: Despite the widely recognized importance of replicability in biological research, computational methods to quantify irreplicability and identify irreplicable instances remain underdeveloped. This paper presents an efficient and robust computational framework to address this gap.

RESULTS: To tackle the challenge of defining an acceptable level of intrinsic heterogeneity among replicable studies, we introduce a distinguishability criterion, ensuring that replicable effects, while potentially heterogeneous, can be distinguished from zero effects and maintain consistent directions with high probability. We implement a Bayesian model criticism approach, reporting a Bayesian p-value to identify potential irreplicable instances. Through numerical experiments, we demonstrate the efficacy of the proposed methods in detecting batch effects in high-throughput experiments and identifying instances of the publication bias. Finally, we apply the framework to multi-tissue eQTL data from the GTEx consortium, uncovering tissue-specific eQTLs that represent biological heterogeneity across tissues.

AVAILABILITY: An R package DiscRep implementing our method is available on GitHub (https://github.com/PengWang96/DiscRep).

SUPPLEMENTARY INFORMATION: Supplementary data are available at Bioinformatics online.

PMID:41872019 | DOI:10.1093/bioinformatics/btag140

By Nevin Manimala

Portfolio Website for Nevin Manimala