On the public citation graph

A statistical definition for reproducibility and replicability

https://doi.org/10.1101/066803
0 signed · 108 inferred · view as graph

Inferred edges come from two machine sources: sweeps of open repository metadata (mostly SSRN and Zenodo), and a bulk OpenAlex citation snapshot. Every row below is labelled with the one it came from. Neither is a complete citation index — absence here is not evidence of absence.

Is this your work? Sign in with ORCID and put your name on the claims that are yours.
Claim with ORCID
Reference health. See whether every reference in this work resolves to a known work and none has been retracted — and get a dated CiteStamped badge you can embed.
See reference health

What this work says

Outgoing claims: the papers this work cites, builds on, or argues with.

inferredcites →https://doi.org/10.1007/s00704-015-1597-5openalex-snapshot
Learning from mistakes in climate research
inferredcites →https://doi.org/10.1016/j.bbrc.2011.11.117openalex-snapshot
G-protein-coupled receptor GPR21 knockout mice display improved glucose tolerance and increased insulin response
inferredcites →https://doi.org/10.1038/483531aopenalex-snapshot
Raise standards for preclinical cancer research
inferredcites →https://doi.org/10.1038/nature09299openalex-snapshot
Enhancement of proteasome activity by a small-molecule inhibitor of USP14
inferredcites →https://doi.org/10.1038/ng.120openalex-snapshot
Meta-analysis of genome-wide association data and large-scale replication identifies additional susceptibility loci for type 2 diabetes
inferredcites →https://doi.org/10.1038/ng.295openalex-snapshot
Repeatability of published microarray gene expression analyses
inferredcites →https://doi.org/10.1073/pnas.1421412111openalex-snapshot
Reproducible research can still be wrong: Adopting a prevention approach
inferredcites →https://doi.org/10.1093/cje/bet075openalex-snapshot
Does high public debt consistently stifle economic growth? A critique of Reinhart and Rogoff
inferredcites →https://doi.org/10.1097/00004583-199910000-00011openalex-snapshot
Psychometric Properties of the Screen for Child Anxiety Related Emotional Disorders (SCARED): A Replication Study
inferredcites →https://doi.org/10.1126/science.1213847openalex-snapshot
Reproducible Research in Computational Science
inferredcites →https://doi.org/10.1126/science.1217697openalex-snapshot
ApoE-Directed Therapeutics Rapidly Clear β-Amyloid and Reverse Deficits in AD Mouse Models
inferredcites →https://doi.org/10.1126/science.351.6277.1037-aopenalex-snapshot
Government: Plan for ecosystem services
inferredcites →https://doi.org/10.1126/science.aac4716openalex-snapshot
Estimating the reproducibility of psychological science
inferredcites →https://doi.org/10.1126/science.aad7243openalex-snapshot
Comment on “Estimating the reproducibility of psychological science”
inferredcites →https://doi.org/10.1126/scitranslmed.aaf5027openalex-snapshot
What does research reproducibility mean?
inferredcites →https://doi.org/10.1146/annurev-statistics-060116-054104openalex-snapshot
Is Most Published Research Really False?
inferredcites →https://doi.org/10.1172/jci61953openalex-snapshot
G protein–coupled receptor 21 deletion improves insulin sensitivity in diet-induced obese mice
inferredcites →https://doi.org/10.1177/0956797611417632openalex-snapshot
False-Positive Psychology
inferredcites →https://doi.org/10.1177/1745691612462588openalex-snapshot
An Open, Large-Scale, Collaborative Effort to Estimate the Reproducibility of Psychological Science
inferredcites →https://doi.org/10.1214/09-aoas291openalex-snapshot
Deriving chemosensitivity from cell lines: Forensic bioinformatics and reproducible research in high-throughput biology

What points at this work

Incoming claims: where this work appears in other papers’ reference lists and arguments.

inferred← citeshttps://doi.org/10.1002/aaai.70004openalex-snapshot
What is reproducibility in artificial intelligence and machine learning research?
inferred← citeshttps://doi.org/10.1002/pds.4722openalex-snapshot
How pharmacoepidemiology networks can manage distributed analyses to improve replicability and transparency and minimize bias
inferred← citeshttps://doi.org/10.1002/sta4.653openalex-snapshot
Reproducible research practices: A tool for effective and efficient leadership in collaborative statistics
inferred← citeshttps://doi.org/10.1007/978-3-030-23987-9_2openalex-snapshot
An Overview of Platforms for Reproducible Research and Augmented Publications
inferred← citeshttps://doi.org/10.1007/978-3-031-36336-8_11openalex-snapshot
How to Open Science: Promoting Principles and Reproducibility Practices Within the Artificial Intelligence in Education Community
inferred← citeshttps://doi.org/10.1007/978-3-319-55849-3_7openalex-snapshot
Improving the Reproducibility of Genetic Association Results Using Genotype Resampling Methods
inferred← citeshttps://doi.org/10.1007/978-3-319-56414-2_4openalex-snapshot
Reproducible Pattern Recognition Research: The Case of Optimistic SSL
inferred← citeshttps://doi.org/10.1007/s12144-021-01554-5openalex-snapshot
A solution for factorial validity testing of three-item scales: An example of tau-equivalent strict measurement invariance of three-item loneliness scale
inferred← citeshttps://doi.org/10.1007/s42081-018-0009-3openalex-snapshot
Data science vs. statistics: two cultures?
inferred← citeshttps://doi.org/10.1007/s42519-025-00459-xopenalex-snapshot
Statistical Perspectives on Reproducibility: Definitions and Challenges
inferred← citeshttps://doi.org/10.1007/s42803-023-00073-yopenalex-snapshot
Repetitive research: a conceptual space and terminology of replication, reproduction, revision, reanalysis, reinvestigation and reuse in digital humanities
inferred← citeshttps://doi.org/10.1007/s44217-024-00190-yopenalex-snapshot
Replication to first-year undergraduate students’ knowledge of academic misconduct
inferred← citeshttps://doi.org/10.1016/b978-0-12-818697-8.00165-5openalex-snapshot
Open Science and Clinical Psychology
inferred← citeshttps://doi.org/10.1016/b978-0-12-819166-8.00121-3openalex-snapshot
Machine Learning for Understanding Inland Water Quantity, Quality, and Ecology
inferred← citeshttps://doi.org/10.1016/j.chemolab.2021.104429openalex-snapshot
Robust bootstrapped Mandel's h and k statistics for outlier detection in interlaboratory studies
inferred← citeshttps://doi.org/10.1016/j.envsoft.2020.104885openalex-snapshot
Socio-technical scales in socio-environmental modeling: Managing a system-of-systems modeling approach
inferred← citeshttps://doi.org/10.1016/j.jclinepi.2020.01.010openalex-snapshot
Inferential reproduction analysis demonstrated that “paracetamol for acute low back pain” trial conclusions were reproducible
inferred← citeshttps://doi.org/10.1016/j.jclinepi.2021.11.014openalex-snapshot
Replicability in the context of systematic reviews: A call for a framework with considerations regarding duplication, overlap, and intentionality
inferred← citeshttps://doi.org/10.1016/j.neubiorev.2018.07.016openalex-snapshot
A systematic review of Drosophila short-term-memory genetics: Meta-analysis reveals robust reproducibility
inferred← citeshttps://doi.org/10.1016/j.neuroimage.2019.116048openalex-snapshot
Replication and generalization in applied neuroimaging
inferred← citeshttps://doi.org/10.1017/cts.2020.523openalex-snapshot
A framework for clinical and translational research in the era of rigor and reproducibility
inferred← citeshttps://doi.org/10.1021/acs.jcim.3c00744openalex-snapshot
LISTER: Semiautomatic Metadata Extraction from Annotated Experiment Documentation in eLabFTW
inferred← citeshttps://doi.org/10.1038/s41591-026-04667-1openalex-snapshot
Reproducibility in biomedical research
inferred← citeshttps://doi.org/10.1080/10691898.2020.1860725openalex-snapshot
Teaching Creative and Practical Data Science at Scale
inferred← citeshttps://doi.org/10.1080/15230406.2018.1512421openalex-snapshot
In-depth examination of spatiotemporal figures in open reproducible research
inferred← citeshttps://doi.org/10.1080/15230406.2024.2409920openalex-snapshot
A systematic approach for assessing the importance of visual differences in reproduced maps
inferred← citeshttps://doi.org/10.1090/bull/1597openalex-snapshot
Statistical proof? The problem of irreproducibility
inferred← citeshttps://doi.org/10.1093/beheco/arx003openalex-snapshot
Striving for transparent and credible research: practical guidelines for behavioral ecologists
inferred← citeshttps://doi.org/10.1097/j.pain.0000000000001254openalex-snapshot
Reproducible and replicable pain research: a critical review
inferred← citeshttps://doi.org/10.1098/rsos.231003openalex-snapshot
Replicability of simulation studies for the investigation of statistical methods: the RepliSims project
inferred← citeshttps://doi.org/10.1101/144071openalex-snapshot
The influence of study characteristics on coordinate-based fMRI meta-analyses
inferred← citeshttps://doi.org/10.1101/827527openalex-snapshot
A statistical framework for measuring reproducibility and replicability of high-throughput experiments from multiple sources
inferred← citeshttps://doi.org/10.1101/865881openalex-snapshot
Standardized Effect Sizes and Image-Based Meta-Analytical Approaches for fMRI Data
inferred← citeshttps://doi.org/10.1109/ismar-adjunct54149.2021.00030openalex-snapshot
Reducing the Human Factor in Virtual Reality Research to Increase Reproducibility and Replicability
inferred← citeshttps://doi.org/10.1111/insr.12591openalex-snapshot
Statistical Analysis of Data Repeatability Measures
inferred← citeshttps://doi.org/10.1111/phc3.12633openalex-snapshot
Philosophy of science and the replicability crisis
inferred← citeshttps://doi.org/10.1145/3313831.3376448openalex-snapshot
Transparency of CHI Research Artifacts: Results of a Self-Reported Survey
inferred← citeshttps://doi.org/10.1145/3544548.3580848openalex-snapshot
Changes in Research Ethics, Openness, and Transparency in Empirical Studies between CHI 2017 and CHI 2022
inferred← citeshttps://doi.org/10.1145/3573051.3596166openalex-snapshot
How to Open Science: Analyzing the Open Science Statement Compliance of the Learning @ Scale Conference
inferred← citeshttps://doi.org/10.1145/3576050.3576071openalex-snapshot
How to Open Science: A Principle and Reproducibility Review of the Learning Analytics and Knowledge Conference
inferred← citeshttps://doi.org/10.1145/3640792.3675730openalex-snapshot
Changing Lanes Toward Open Science: Openness and Transparency in Automotive User Research
inferred← citeshttps://doi.org/10.1145/3779439openalex-snapshot
Evaluating Acoustic Data Transmission Schemes for Ad-Hoc Communication Between Nearby Smart Devices
inferred← citeshttps://doi.org/10.1146/annurev-biodatasci-072018-021237openalex-snapshot
Computational and Informatic Advances for Reproducible Data Analysis in Neuroimaging
inferred← citeshttps://doi.org/10.1146/annurev-statistics-060116-054104openalex-snapshot
Is Most Published Research Really False?
inferred← citeshttps://doi.org/10.1162/tacl_a_00074openalex-snapshot
Replicability Analysis for Natural Language Processing: Testing Significance with Multiple Datasets
inferred← citeshttps://doi.org/10.1177/01623532251372590openalex-snapshot
Robust and Semi-Robust Findings From Giftedness and Talent Research: Results of a Secondary-Order Scoping Review on Meta-Analyses
inferred← citeshttps://doi.org/10.1177/10422587211057422openalex-snapshot
Advancing Entrepreneurship Theory Through Replication: A Case Study on Contemporary Methodological Challenges, Future Best Practices, and an Entreaty for Communality
inferred← citeshttps://doi.org/10.1177/2378023119849803openalex-snapshot
Successes and Struggles with Computational Reproducibility: Lessons from the Fragile Families Challenge
inferred← citeshttps://doi.org/10.1186/s12874-021-01342-6openalex-snapshot
A new method for testing reproducibility in systematic reviews was developed, but needs more testing
inferred← citeshttps://doi.org/10.13105/wjma.v7.i3.66openalex-snapshot
Reproducibility and replicability of systematic reviews
inferred← citeshttps://doi.org/10.1371/journal.pcbi.1007664openalex-snapshot
Tximeta: Reference sequence checksums for provenance identification in RNA-seq
inferred← citeshttps://doi.org/10.1371/journal.pone.0212390openalex-snapshot
Facilitating reproducible project management and manuscript development in team science: The projects R package
inferred← citeshttps://doi.org/10.1515/hsz-2021-0393openalex-snapshot
On the reproducibility of enzyme reactions and kinetic modelling
inferred← citeshttps://doi.org/10.1590/1981-3821201900020001openalex-snapshot
Seven Reasons Why: A User’s Guide to Transparency and Reproducibility
inferred← citeshttps://doi.org/10.2200/s00994ed1v01y202002hlt045openalex-snapshot
Statistical Significance Testing for Natural Language Processing
inferred← citeshttps://doi.org/10.26686/wgtn.21220838openalex-snapshot
Strategic Communication for Pro-Environmentalism: Is Political Polarisation Reduced by Environmental Messages that Emphasise Conservative Worldviews?
inferred← citeshttps://doi.org/10.30534/ijatcse/2020/289942020openalex-snapshot
Using Neural Network for Simulations to Improve the Quality of Disease Diagnosis: Technical Aspects
inferred← citeshttps://doi.org/10.3102/0013189x18788047openalex-snapshot
Supporting a Culture of Replication: An Examination of Education and Special Education Research Grants Funded by the Institute of Education Sciences
inferred← citeshttps://doi.org/10.31219/osf.io/3bu6topenalex-snapshot
Transparency of CHI Research Artifacts: Results of a Self-Reported Survey
inferred← citeshttps://doi.org/10.31222/osf.io/b4v8popenalex-snapshot
Foundations for Open Scholarship Strategy Development
inferred← citeshttps://doi.org/10.31223/x5964sopenalex-snapshot
Machine learning for understanding inland water quantity, quality, and ecology
inferred← citeshttps://doi.org/10.31237/osf.io/mcdrnopenalex-snapshot
Publishing Reproducible Geoscientific Papers: Status quo, benefits, and opportunities
inferred← citeshttps://doi.org/10.31237/osf.io/racx9openalex-snapshot
Multiverse Meta-Analysis: Proposing an Exploratory Framework
inferred← citeshttps://doi.org/10.3233/faia231136openalex-snapshot
Epistemic Metadata for Computational Engineering Information Systems
inferred← citeshttps://doi.org/10.32614/cran.package.scifigureopenalex-snapshot
scifigure: Visualize 'Reproducibility' and 'Replicability' in a Comparison of Scientific Studies
inferred← citeshttps://doi.org/10.3389/fninf.2017.00076openalex-snapshot
Reproducibility vs. Replicability: A Brief History of a Confused Terminology
inferred← citeshttps://doi.org/10.3389/fninf.2018.00081openalex-snapshot
Rigorous Neural Network Simulations: A Model Substantiation Methodology for Increasing the Correctness of Simulation Results in the Absence of Experimental Validation Data
inferred← citeshttps://doi.org/10.3389/fnins.2017.00745openalex-snapshot
The Influence of Study-Level Inference Models and Study Set Size on Coordinate-Based fMRI Meta-Analyses
inferred← citeshttps://doi.org/10.3389/fpsyg.2017.00862openalex-snapshot
Replicability and Reproducibility in Comparative Psychology
inferred← citeshttps://doi.org/10.3410/f.734610015.793554734openalex-snapshot
Faculty Opinions recommendation of Analysis validation has been neglected in the Age of Reproducibility.
inferred← citeshttps://doi.org/10.3410/f.734610015.793554867openalex-snapshot
Faculty Opinions recommendation of Analysis validation has been neglected in the Age of Reproducibility.
inferred← citeshttps://doi.org/10.35542/osf.io/4hn8qopenalex-snapshot
How to Open Science: Debugging Reproducibility within the Educational Data Mining Conference
inferred← citeshttps://doi.org/10.35542/osf.io/xkmfwopenalex-snapshot
How to Open Science: A Reproducibility Author Survey of the Artificial Intelligence in Education Conference
inferred← citeshttps://doi.org/10.36314/cunori.v6i1.181openalex-snapshot
Reproducibilidad, Replicación y Prácticas de Investigación Cuestionables en Estudios de Revistas Académicas Arbitradas en México y Guatemala
inferred← citeshttps://doi.org/10.36850/9ec0-4fabopenalex-snapshot
A Conceptual Framework for Computational Reproductions: Formal Definitions and Epistemic Functions
inferred← citeshttps://doi.org/10.46780/cunzac.v5i1.60openalex-snapshot
Reproducibilidad, Replicación y Prácticas de Investigación Cuestionables en Estudios de Repositorios de Tesis de Maestría y Doctorado en México y Guatemala
inferred← citeshttps://doi.org/10.48550/arxiv.1809.10024openalex-snapshot
Computational and informatics advances for reproducible data analysis in neuroimaging
inferred← citeshttps://doi.org/10.48550/arxiv.2011.09851openalex-snapshot
Digital trace data collection through data donation
inferred← citeshttps://doi.org/10.5334/pb.494openalex-snapshot
Open Up – the Mission Statement of the Control of Impulsive Action (Ctrl-ImpAct) Lab on Open Science
inferred← citeshttps://doi.org/10.5860/crl.79.1.2openalex-snapshot
The Reproducibility Crisis and Academic Libraries
inferred← citeshttps://doi.org/10.59350/9gfjs-pey70openalex-snapshot
Grundlagen für die Entwicklung einer Open Scholarship-Strategie
inferred← citeshttps://doi.org/10.6002/ect.2016.0266openalex-snapshot
De Novo IgA Nephropathy in a Renal Allograft
inferred← citeshttps://doi.org/10.7287/peerj.5597v0.1/reviews/1openalex-snapshot
Peer Review #1 of "Explanation of observational data engenders a causal belief about smoking and cancer (v0.1)"
inferred← citeshttps://doi.org/10.7287/peerj.5597v0.1/reviews/2openalex-snapshot
Peer Review #2 of "Explanation of observational data engenders a causal belief about smoking and cancer (v0.1)"
inferred← citeshttps://doi.org/10.7287/peerj.5597v0.1/reviews/3openalex-snapshot
Peer Review #3 of "Explanation of observational data engenders a causal belief about smoking and cancer (v0.1)"
inferred← citeshttps://doi.org/10.7287/peerj.5597v0.2/reviews/2openalex-snapshot
Peer Review #2 of "Explanation of observational data engenders a causal belief about smoking and cancer (v0.2)"
inferred← citeshttps://doi.org/10.7287/peerj.5597v0.2/reviews/3openalex-snapshot
Peer Review #3 of "Explanation of observational data engenders a causal belief about smoking and cancer (v0.2)"
inferred← citeshttps://doi.org/10.7717/peerj.5597openalex-snapshot
Explanation of observational data engenders a causal belief about smoking and cancer
Editorial review for independent work. ICSAC — the Institute for Complexity Science and Advanced Computing — runs a structured editorial panel for researchers publishing outside journals, and publishes on CiteStamp rails. Submission is free and goes through ORCID: icsacinstitute.org/submit.