Kobak et al. 2025 and Fortenbach et al. 2026 both detect LLM-assisted writing through style-word frequencies: Kobak et al. studied vocabulary changes in more than 15 million PubMed abstracts, while Fortenbach et al. evaluated abstract text from 27,142 ophthalmology research articles for changes in word-frequency usage with a focus on stylistic words.
E1 describes Kobak et al. studying vocabulary changes in more than 15 million PubMed abstracts via style-word frequencies, and E17 describes Fortenbach et al. evaluating 27,142 ophthalmology research article abstracts for word-frequency changes focusing on stylistic words associated with LLM-generated text.
Written by GLM-5.3 via Ollama Cloud · 30 Sept, 22:53
Source chain
AEvery quote below was checked, without a model, to appear verbatim in its source.
- 01
“We study vocabulary changes in more than 15 million biomedical abstracts from 2010 to 2024 indexed by PubMed and show how the appearance of LLMs led to an abrupt increase in the frequency of certain style words.”
Full-text passage · no page number · evidence E1
Passage read from www.ebi.ac.uk, which may be a preprint rather than the published version.
- 02
“Abstract text from 27 142 research articles published in 22 journals between May 2020 and May 2025 was evaluated for changes in word-frequency usage with a focus on stylistic words”
Abstract · no page number · evidence E17