Publication Bias and the Institutional Response: The Case of Nullius in Verba — Journal of Negative, Null and Failed Results

Authors

  • Editorial Author

Abstract

Scientific knowledge can advance soundly only when it records not merely confirmed hypotheses but also refuted assumptions and unsuccessful results. Yet for more than half a century, peer-reviewed publishing has systematically excluded negative, null, and failed results, causing the scientific literature to reflect not a faithful record of what science has learned but a biased subset of it. Named the "file drawer problem" by Rosenthal (1979), this phenomenon produces cascading consequences: inflated effect sizes, distorted meta-analyses, wasted research effort, and the erosion of scientific trust. This article examines the historical origins, statistical and epistemological foundations, and empirical evidence of this problem in the literature; presents historical and contemporary null result examples from various disciplines within a fluent narrative; and then evaluates, within an academic framework, the aims, scope, and editorial model of Nullius in Verba — Journal of Negative, Null and Failed Results, designed as an institutional response to this structural problem. The journal's Diamond Open Access model, open peer review process, Registered Reports format, and original metrics such as the "Negative Impact Factor" are analyzed as structural interventions aimed at reducing publication bias.

40 7

Downloads

Download data is not yet available.

References

Akil AM, Cserjési R, Nagy T, Demetrovics Z, Németh D, Logemann HNA. The relationship between frontal alpha asymmetry and behavioral and brain activity indices of reactive inhibitory control. J Neurophysiol. 2024 Aug 1;132(2):362-374. doi: 10.1152/jn.00046.2024.

Bem, D. J. (2011). Feeling the future: Experimental evidence for anomalous retroactive influences on cognition and affect. Journal of Personality and Social Psychology, 100(3), 407–425.

Bem, D. J., Tressoldi, P. E., Rabeyron, T., & Duggan, M. (2016). Feeling the future: A meta-analysis of 90 experiments on the anomalous anticipation of random future events. F1000Research, 4, 1188.

Button, K. S., Ioannidis, J. P. A., Mokrysz, C., Nosek, B. A., Flint, J., Robinson, E. S. J., & Munafò, M. R. (2013). Power failure: Why small sample size undermines the reliability of neuroscience. Nature Reviews Neuroscience, 14(5), 365–376.

Chambers, C. D. (2013). Registered Reports: A new publishing initiative at Cortex. Cortex, 49(3), 609–610.

Chalmers, I., & Glasziou, P. (2009). Avoidable waste in the production and reporting of research evidence. The Lancet, 374(9683), 86–89.

Egger, M., Davey Smith, G., Schneider, M., & Minder, C. (1997). Bias in meta-analysis detected by a simple, graphical test. BMJ, 315(7109), 629–634.

Franco, A., Malhotra, N., & Simonovits, G. (2014). Publication bias in the social sciences: Unlocking the file drawer. Science, 345(6203), 1502–1505.

Galak, J., LeBoeuf, R. A., Nelson, L. D., & Simmons, J. P. (2012). Correcting the past: Failures to replicate psi. Journal of Personality and Social Psychology, 103(6), 933–948.

Greenwald, A. G. (1975). Consequences of prejudice against the null hypothesis. Psychological Bulletin, 82(1), 1–20.

Ioannidis, J. P. A. (2005). Why most published research findings are false. PLoS Medicine, 2(8), e124.

Kulinskaya, E., Morgenthaler, S., & Staudenmayer, J. (2018). Meta-analysis of studies with publication bias: A review. Research Synthesis Methods, 9(4), 475–492.

Open Science Collaboration. (2015). Estimating the reproducibility of psychological science. Science, 349(6251), aac4716.

Rosenthal, R. (1979). The file drawer problem and tolerance for null results. Psychological Bulletin, 86(3), 638–641.

Royal Society. (1660/2024). Nullius in verba. The Royal Society. https://royalsociety.org

Smart, R. G. (1964). The importance of negative results in psychological research. Canadian Psychologist, 5(4), 225–232.

Sterling, T. D. (1959). Publication decisions and their possible effects on inferences drawn from tests of significance—or vice versa. Journal of the American Statistical Association, 54(285), 30–34.

Strack, F., Martin, L. L., & Stepper, S. (1988). Inhibiting and facilitating conditions of the human smile: A nonobtrusive test of the facial feedback hypothesis. Journal of Personality and Social Psychology, 54(5), 768–777.

Turner, E. H., Matthews, A. M., Linardatos, E., Tell, R. A., & Rosenthal, R. (2008). Selective publication of antidepressant trials and its influence on apparent efficacy. New England Journal of Medicine, 358(3), 252–260.

Wagenmakers, E.-J., et al. (2016). Registered Replication Report: Strack, Martin, & Stepper (1988). Perspectives on Psychological Science, 11(6), 917–928.

Published

2026-10-02