Skip to main content

Write a PREreview

Tracking claim changes from preprint to publication across 72,644 biomedical studies using large language models

Posted
Server
bioRxiv
DOI
10.64898/2026.06.30.735556

Preprints disseminate biomedical research before peer review, but how much those scientific claims change before publication in journals remains uncertain. Here, we matched 72,644 bioRxiv preprints to their peer-reviewed publications by DOI and used a large language model (Claude Sonnet 4.6) to extract one primary and two secondary claims. Content change (unchanged, minor, major) and hedging shift (more cautious, more confident, unchanged) were compared. Four raters independently labelled a 550-pair subset; model–rater agreement (quadratic-weighted Cohen’s κ = 0.67) approached agreement among the raters themselves (κ = 0.76). The primary claims were unchanged in 39.8% of abstract pairs, minorly revised in 50.0%, and substantially revised in 10.2%. Claims became more cautious twice as often as more confident (8.4% vs 4.2%). Major revisions correlated with longer preprint-to-publication interval. Therefore, among bioRxiv preprints that later publish, central abstract claims remain stable through the preprint-to-publication transition.

You can write a PREreview of Tracking claim changes from preprint to publication across 72,644 biomedical studies using large language models. A PREreview is a review of a preprint and can vary from a few sentences to a lengthy report, similar to a journal-organized peer-review report.

Before you start

We will ask you to log in with your ORCID iD. If you don’t have an iD, you can create one.

What is an ORCID iD?

An ORCID iD is a unique identifier that distinguishes you from everyone with the same or similar name.

Start now