Every claim, with its source

Authors of empirical papers accepted by AEA journals deposit their data and code in the AEA Data and Code Repository at openICPSR, where the AEA Data Editor reruns them before acceptance. Scope: Economics.

The Pittsburgh report was published in Physical Review B (113, 119601) on 20 March 2026 and gives recommendations for researchers, publishers, universities and research laboratories, and government and funding organizations, drawn from a conference at the University of Pittsburgh on 9 to 11 May 2024.

The report says that reputation and authority serve as substitutes for which results to consider trustworthy, and that in more than a few cases the presentation of results lacks sufficient detail to facilitate replication and verification.

The report says that behind every disproven claim are months of work, funding not dedicated to replication, and diverted careers, often those of young researchers.

The report notes that some fields responded to the replication crisis with preregistration of hypotheses and study design, and says such preregistration may not be helpful in the context of exploratory research.

The report says solutions for data sharing are already available except for primary data above about 1 TB, and that for gigabyte-scale datasets there are robust repositories such as Zenodo, Harvard Dataverse, OSF, Figshare, HEPData and Dryad.

The report recommends that authors release as much primary data as possible and practical, sharing materials in the form they have them when full FAIR standards aren't possible; include the full ranges of experimental parameters studied, all reasonable presentations of the data, all plausible interpretations and the number of samples tested; and give all authors access to all primary data and analysis files before they consent to publication.

The report asks funders to consider funding work that explicitly aims to replicate prior results, publishers to formulate clear acceptance criteria for replication efforts, and universities to consider datasets and code as research outputs alongside publications.

APS announced on 1 August 2024 that every Physical Review article must carry a statement saying where the data needed to support or replicate its claims can be accessed, from late 2024; public sharing is encouraged but not required, and authors who don't share publicly must share with referees and editors on request. Scope: Physical Review journals.

arXiv lists 17,022 condensed matter articles for 2024, plus 4,938 cross-lists.

Data and software from the JADE experiment, which ran at the PETRA collider from 1979 to 1986, were resurrected and reanalyzed with modern simulation and state-of-the-art QCD calculations to measure the strong coupling.

In 110 papers from leading economics and political science journals, the authors found coding errors in about 25% of studies after excluding minor issues such as missing packages or broken file paths. Scope: 110 papers in leading economics and political science journals.

Reproducing and robustness-checking 110 articles from leading economics and political science journals with mandatory data and code sharing, the authors found more than 85% of claims computationally reproducible and 72% of statistically significant estimates still significant and in the same direction under robustness checks. Scope: 110 articles in leading economics and political science journals with data and code sharing policies.

In an experiment that randomly assigned 288 researchers to 103 teams reproducing results from leading social science journals, human-only teams reproduced 94% of results and AI-assisted teams 91%, though human-only teams found significantly more major coding errors. Scope: Quantitative social science; ChatGPT models of the GPT-4 era.

cascad, a non-profit certification agency of CNRS, HEC Paris and the University of Orleans, states a certification fee of 500 euros, with possible extra costs, and through a partnership with the French secure data center CASD can certify results that rely on confidential data.

Authors deposit crystal structure files with the Cambridge Crystallographic Data Centre before publication, where they stay confidential but available to referees, and the IUCr checkCIF service produces an automated report that flags inconsistencies. Scope: Chemistry and crystallography.

The Center for Open Science says funding from the Laura and John Arnold Foundation provided the initial funding to launch it in 2013; WIRED reports the initial grant was $5.25 million.

Registered Reports are a publishing format in which protocols and analysis plans are peer reviewed and registered before data collection, then published regardless of outcome.

Since 2005 the major medical journals have refused to consider a trial unless it was registered in a public registry such as ClinicalTrials.gov, run by the US National Library of Medicine, before the first patient enrolled. Scope: Clinical trials.

On CMT-Benchmark, 50 condensed matter theory problems designed and verified by expert researchers, frontier models struggled with all of the problems, and the best model, GPT-5, solved 30%. Scope: Condensed matter theory problems; models evaluated in 2025.

Consensus is an AI academic search engine for peer-reviewed literature, searching over 200 million research papers.

The head of a quantum device lab told David that AI already writes instrument drivers and runs measurement sweeps in their lab.

A solar physicist told David that a funding gap isn't always a scientific gap: some areas get little funding because they are largely solved.

A condensed matter lab head told David that honest misinterpretation is common because data on new phenomena is hard to interpret, researchers usually don't know all the literature related to their experiment, and the pull to publish high for funding and reputation favors the fancier interpretation over the simpler one, on a spectrum of intent; testing the trivial explanation can take another experiment on a modified platform.

FAIRmat, a consortium of Germany's National Research Data Infrastructure, is building data infrastructure for condensed matter physics; its software NOMAD supports experimental data through the NeXus standard, instrument integration and electronic lab notebooks.

Across 2,434 papers that tested a hypothesis, the share reporting positive support ranged from 70.2% in space science to 91.5% in psychology and psychiatry, and the odds of a positive result were 2.3 times higher in the social sciences than in the physical sciences.

In 221 social science experiments funded through the NSF's Time-sharing Experiments for the Social Sciences, with a full accounting of what was and wasn't published, strong results were 40 percentage points more likely to be published than null results and 60 percentage points more likely to be written up. Scope: Social science survey experiments, not physics.

In a Science paper published on 8 January 2026, Frolov and 11 co-authors showed limited data consistent with four topological phenomena and, by considering additional data, found the most likely origins of the observed patterns to be trivial. They argue that releasing comprehensive datasets, discussing alternative scenarios and disclosing the total volume of study would make smoking gun claims more reliable. Scope: Four case studies of topological effects in nanoscale superconducting and semiconducting devices.

PaperQA2, a language model agent, matched or exceeded subject matter experts on three realistic literature research tasks, and identified about 2.3 contradictions per paper in a random subset of biology papers, 70% of which human experts validated. Scope: Biology literature; 2024 models.

HEPData at Durham University, funded by the UK's Science and Technology Facilities Council, holds the numbers behind the plots of several thousand particle physics papers, and each submission passes a designated reviewer before release. Scope: Particle physics.

instrMCP is an open-source server suite that lets large language models interact with quantum device lab instruments through QCoDeS and JupyterLab, read-only by default with an optional mode that executes commands.

AlphaFold was trained on experimentally determined structures from the Protein Data Bank released up to 30 April 2018, plus a set of its own high-confidence predictions.

An automatically text-mined dataset of 56,037 Curie and Neel temperature records from 108,181 papers had an estimated precision of 72% and recall of 61%. Scope: Magnetic transition temperatures only, mined with a rule-based parser.

Mandatory Protein Data Bank deposit before publication was guided by the International Union of Crystallography in 1989 ('no PDB deposition, no structural publication'); most journals now also ask for an official validation report at submission, and deposit, validation and curation are free to depositors. Scope: Structural biology.

Living Reviews in Relativity is a diamond open-access journal that publishes invited reviews in all areas of relativity, and is unique in maintaining a suite of reviews that are regularly updated by their authors.

Building a concept graph from about 221,000 materials science abstracts (1955 to 2022), the authors observe that concept centralization increases over time, with fewer concepts accounting for a larger share of connections. Scope: Materials science abstracts.

Nature Communications publishes reviewer comments and author rebuttal letters for all original research articles submitted from 1 November 2022, and Nature made publishing referee reports and author responses standard for new research submissions from 16 June 2025.

NOMAD uploads can be shared read-only with reviewers, embargoed for up to 36 months, and become unchangeable once published.

Pittwire reports that when Frolov's group submitted replication findings to the journals that had published the original papers, editors rejected them as not novel or no longer relevant.

Pittwire reports that when a collaborator asked for 15-year-old data, Frolov found and sent the raw data in less than 20 minutes, that he tells his students to be ready to do the same, and that he says colleagues in astrophysics treat sharing data as a matter of course.

A 2020 review of hybrid superconductor-semiconductor nanowires covers Andreev and Majorana bound states and the techniques for detecting them, including different types of robust zero modes that may emerge without a band-topological transition.

QCoDeS is an open-source Python data acquisition framework from the Copenhagen, Delft, Sydney and Microsoft quantum computing consortium; each measurement run is stored in an SQLite database with metadata and a snapshot of the instrument settings.

QuTech says two of its Nature papers were withdrawn over irregularities in data processing, selection and publication, that the authors shared the data of both in public repositories, and that from April 2022 it requires publishing at least all raw data behind published figures plus processing scripts.

A machine learning model trained on about 4,000 recorded syntheses of templated vanadium selenites, including failed 'dark' reactions kept in lab notebooks, predicted conditions for new products with an 89% success rate, beating the strategies of the chemists who ran the experiments. Scope: One family of chemical syntheses.

The worldwide Protein Data Bank passed 200,000 entries in 2023.

Modeling millions of biomedical papers and patents over 30 years, the authors found that scientists follow a conservative strategy focused on well-studied molecules, which supports careers but is inefficient for science as a whole; more risk-taking and publishing failures would substantially speed discovery. Scope: Biomedicine.

scite is a citation index that shows the context of each citation and uses a deep learning model to classify whether the citing statement provides supporting or contrasting evidence for the cited work, or simply mentions it.

On five fully reproducible R-based social science studies with deliberately injected failures, agent-based repair workflows succeeded in 69 to 96 percent of cases, against 31 to 79 percent for prompt-based workflows. Scope: Five R-based social science studies; a preprint.

Requesting data from corresponding authors of Nature and Science papers in nine disciplines, the authors obtained it for 39.4% of requests on average, from 27.9% to 56.1% across fields. Scope: Nature and Science papers across nine disciplines.

In a survey of 1,329 scientists, the leading reasons given for not making data electronically available to others were insufficient time (54%) and lack of funding (40%). Scope: Respondents mostly from environmental sciences and ecology; 2011.

The University of Pittsburgh's news release says the 2026 Science paper was submitted in September 2023 and spent a record two years under peer and editorial review.

Nanoscale maps of magic-angle twisted bilayer graphene showed that even state-of-the-art superconducting devices have local twist angles varying by close to 0.1 degree, with gradients, jumps and some areas showing no magic-angle behavior at all.

The AEA Data Editor's lab checks the replication package of every article with a computational component in AEA journals before publication (Papers and Proceedings get a cursory review) and handles about 400 articles a year; from December 2022 to November 2023 it received 646 verification requests covering 527 manuscripts. Scope: Economics; American Economic Association journals only.

Requesting the data behind biology papers 2 to 22 years old, the authors found that, for papers where the status of the data was given, the odds of a data set being extant fell by 17% per year. Scope: Biology papers.

In Wiley's ExplanAItions survey of 2,430 researchers in August 2025, 84% were using AI tools for some aspect of their work, up from 57% in 2024, and 62% were using AI for research or publication tasks, up from 45%. Scope: Researchers across fields worldwide; a publisher's survey.

In a sample of 2014 articles from the top 10 journals in biology, chemistry, mathematics and physics, physics shared original data at the lowest rate: none of the sampled physics articles with original data made it available, and 8% of all sampled physics articles made any data available. Scope: A small sample: articles from 2014 top journals.

By default, Zenodo registers DOIs for all uploads when they are published on Zenodo.

On 8 March 2021 the authors retracted their 2018 Nature paper claiming quantized Majorana conductance, after Sergey Frolov and Vincent Mourik pointed out inconsistencies between the raw data made available to them and the published figures.

On a benchmark of 13 AI research papers, the average cost for AutoReproduce to reproduce one experiment was $1.87 with o3-mini as the model. Scope: 13 machine learning papers; a preprint.