Cuadros et al. 2026 caution that milestones such as The AI Scientist's manuscript passing first-round workshop peer review (Lu et al. 2026) demonstrate workflow automation rather than scientific cognition, which they argue depends on differentiated memory, judgment, and epistemic calibration.
The cited Cuadros text states that progress in workflow automation (ideation through manuscript drafting) 'is not scientific cognition' and argues scientific cognition requires differentiated memory filtered by judgment and epistemic calibration, which directly covers workflow milestones like The AI Scientist's peer-reviewed manuscript (supported by the Lu citation).
Written by Kimi K3 via Ollama Cloud · checked by GLM-5.3 via Ollama Cloud · 4 Oct, 04:34
Source chain
AEvery quote below was checked, without a model, to appear verbatim in its source.
- 01
“the manuscript generated by this AI system passed the first round of peer review for a workshop of a top-tier machine learning conference”
Full-text passage · no page number · evidence E5
Towards end-to-end automation of AI research The automation of science is a long-standing ambition in artificial intelligence (AI) research1,2. Although the community has made substantial progress in automating individual components of the scientific process, a system that autonomously navigates the entire research life cycle—from conception to publication—has remained out of reach. Here we present a pipeline for automating the entire scientific process end to end. We present The AI Scientist, which creates research ideas, writes code, runs experiments, plots and analyses data, writes the entire scientific manuscript, and performs its own peer review. Its ideas, execution and presentation are of sufficient quality that the manuscript generated by this AI system passed the first round of peer review for a workshop of a top-tier machine learning conference. The workshop had an acceptance rate of 70%. Our system leverages modern foundation models3–5 within a complex agentic system.
Passage read from www.ebi.ac.uk, which may be a preprint rather than the published version.
- 02
“This progress advances automated discovery, but workflow automation is not scientific cognition.”
Full-text passage · no page number · evidence E25
Differentiated memory and scientific cognition in AI research agents AI research agents increasingly support ideation, literature search, coding, experimental execution, analysis, and manuscript drafting across the scientific workflow. This progress advances automated discovery, but workflow automation is not scientific cognition. Scientific reasoning is cumulative and path-dependent: it depends on what a researcher has written, read, learned from critique, absorbed through experience, and used as habitual standards for judging novelty, rigor, feasibility, and significance. We propose Mnemo as a framework for modeling scientific cognition in AI research agents. First, scientific cognition may require differentiated memory, organized into distinct spaces for authored work, external reference, critique, experience, and judgment. Second, provenance should be treated not as passive metadata but as memory routing, because source origin helps determine cognitive function in reasoning. Third, new ideas may be better modeled as controlled collisions across memory spaces, filtered by judgment, rejection, and epistemic calibration, than as generic recombination from model priors.
Passage read from www.ebi.ac.uk, which may be a preprint rather than the published version.