The case / Part 4 of 5
Who has to act, and what would move them
Journal editors and senior, tenured academics decide what counts. Here's why each group would say yes or wait, and what would move them.
The path
- Researchers use the assistant before submitting, if it catches problems before a referee does.
- Journals run it on submissions and give the report to referees, wherever their rules allow.
- Journals offer it to every author before submission.
- Labs record what they've tried, and those that want it start logging every run.
- Once the field values them, the report and the run log become the default, as deposit and registration did in other fields.
| Who | Why they would | Why they wouldn't | What moves them in phase 1 | What moves them long term |
|---|---|---|---|---|
| Physics journals | Claims that are never confirmed and quietly fade cost journals trust, and retractions most of all. Physical Review journals already require a data availability statement, so this is the next step on a path they're on.1 | Checks cost money and can slow review, and authors may take papers to journals without the requirement. | Offering the assistant to authors, and to referees through the journal's own deployment, piloted in one journal first. | Making the report, and later the run log, the default once the field values it, with a place for notes on what didn't work. |
| High-profile multidisciplinary journals | Their names are on the most visible retractions. They already publish referee reports and offer reviewers private access to data and code.2 | Novelty and speed are what they sell. | Offering the referee assistant through their own approved deployment. | Visible cases, and a competitor moving first. |
| Private foundations | They can move fast, care about the health of a field and not only single results, and have launched shared infrastructure before.3 | Shared infrastructure is slow to pay off, and grantees may see new tools as extra work. | Paying to build the assistant and curate the library, as a pilot with willing grantees. | Paying for the shared record, and a view of the field that shows where money is going and where it isn't. |
| Government funders | They already require data management plans, and they pay for the false leads. | Enforcing plans costs money, and attention is elsewhere. | Tools that help grantees meet the data plans they already require. | A view of what the field is working on and where nobody is investing, from records that cost them nothing to collect. |
| Lab heads and senior academics | Nothing is lost when a student leaves, methods and figures are easier to write, revisions are faster, and a collaborator's mistake gets caught before publication. | Time, fear of being scooped, and exposing mistakes. | An assistant that catches problems before a referee does. | Logging that runs in the background with tools they already use, and credit that counts for grants and hiring. |
| Students and postdocs | Their careers absorb the cost when a claim falls apart. The Pittsburgh report counts diverted careers, often of young researchers, among the costs of every disproven claim.4 | They have the least power and the most to lose. | Senior people going first, and tools that package their data and analysis as they go. | Reproducible work showing up in the papers and letters that hiring committees read. |
| Universities | Integrity cases are costly, and the Pittsburgh report asks them to count datasets and code as research outputs.5 | Hiring and promotion run on publication metrics. | Approving the tools under their existing AI and data agreements. | Peer institutions and funders moving first, and counting datasets and code in hiring and promotion. |
| Quantum computing and AI materials companies | Their roadmaps depend on the physics being right, and AI models need measured data they can trust. | Their own data is proprietary. | An open lookalike library they can use and add to. | Shared, checked measured data they can train and test against. |
One adopter showing results is the example others copy. A single journal offering the assistant to its authors and referees, or a single funder paying for it for its grantees, would be enough to start.