Claim 43 · research-integrity · finding

Kobak et al. 2025's excess-vocabulary analysis of more than 15 million PubMed-indexed biomedical abstracts (2010–2024) suggests that at least 13.5% of 2024 abstracts were processed with LLMs, a lower bound reaching 40% for some subcorpora; the authors judge the resulting stylistic shift unprecedented, surpassing even the effect of the COVID pandemic.

Supported

E1 confirms the >15 million PubMed abstracts (2010–2024), the ≥13.5% lower bound for 2024, and the 40% subcorpora figure, and E2 confirms the 'unprecedented impact... surpassing the effect of major world events such as the COVID pandemic'.

Written by GLM-5.3 Flash via Ollama Cloud · 30 Sept, 22:56

Source chain

A

Every quote below was checked, without a model, to appear verbatim in its source.

  1. 01

    “This excess word analysis suggests that at least 13.5% of 2024 abstracts were processed with LLMs. This lower bound differed across disciplines, countries, and journals, reaching 40% for some subcorpora.”

    Full-text passage · no page number · evidence E1

    Passage read from www.ebi.ac.uk, which may be a preprint rather than the published version.

  2. 02

    “We study vocabulary changes in more than 15 million biomedical abstracts from 2010 to 2024 indexed by PubMed”

    Full-text passage · no page number · evidence E1

    Passage read from www.ebi.ac.uk, which may be a preprint rather than the published version.

  3. 03

    “We show that LLMs have had an unprecedented impact on scientific writing in biomedical research, surpassing the effect of major world events such as the COVID pandemic.”

    Full-text passage · no page number · evidence E2

    Passage read from www.ebi.ac.uk, which may be a preprint rather than the published version.