AI Analysis Reveals Over 250,000 Cancer Research Papers Show Signs of Paper Mill Fabrication
Key Insights
An AI tool called BERT (search) flagged more than 250,000 cancer research papers published between 1999 and 2024 as having writing patterns consistent with paper mill fabrication.
Suspicious papers receive up to double the citations of genuine articles, suggesting coordinated citation manipulation inflates journal impact metrics.
Flagged papers surged from approximately 1% in the early 2000s to a peak of over 16% in 2022, with molecular cancer biology and early-stage lab research most affected.
An international research team led by Professor Adrian Barnett at the Queensland University of Technology has deployed an artificial intelligence tool to scan 2.6 million cancer research papers, uncovering evidence that more than 250,000 articles bear the textual fingerprints of paper mill fabrication. The findings, published in The BMJ, represent the largest-scale analysis of its kind and suggest the problem of fraudulent research in oncology is far more extensive than previously recognized.
"Paper mills are companies that sell fake or low-quality scientific studies. They are producing 'research' on an industrial scale, and our findings suggest the problem in cancer research is far larger than most people realized," Professor Barnett said.
How the Detection System Works
The research team trained a language model called BERT (search) to identify subtle textual patterns that repeatedly appear in known paper mill products. Paper mills typically mass-produce manuscripts using boilerplate templates, fabricated data sets, manipulated images, and unusual or "tortured" phrases designed to evade plagiarism detectors.
When evaluated against verified examples, the model correctly detected suspicious papers 91% of the time. "We've essentially built a scientific spam filter," Professor Barnett explained. "Just like your email system can spot unwanted messages, our tool flags papers that match the writing style and structure we see in retracted, fraudulent work."
The Scale of the Problem
The analysis, spanning papers published between 1999 and 2024, revealed several alarming trends. Flagged papers rose sharply over the past two decades, increasing from about 1% in the early 2000s to a peak of more than 16% in 2022. Suspicious papers were especially common in molecular cancer biology and early-stage laboratory research, with certain cancer types — including gastric, liver, bone, and lung cancer (search) — showing particularly high rates of flagged studies.
In a complementary analysis posted on the preprint server bioRxiv, Barnett and colleagues examined 33,159 papers published between 2012 and 2023 across 20 high-impact molecular-oncology journals. The BERT (search) tool flagged 4,085 papers — 12.3% of the total — as having characteristics associated with paper mill articles. Potentially fraudulent papers were identified in 19 out of the 20 journals examined; Nature Cancer was the only journal in the analysis that had not published any suspicious papers.
Citation Manipulation Inflates Journal Metrics
The bioRxiv study also uncovered evidence of coordinated citation manipulation. Suspicious articles were cited by other papers up to twice as many times as non-flagged papers, with the difference in citation rates peaking in the first few years after publication before dropping off over time.
The researchers identified a pattern of suspicious papers citing other suspicious papers, suggesting paper mills are systematically gaming citation metrics. "When a dishonest researcher buys a paper mill product, they not only get a published paper, but also get citations to that paper as part of the bargain," Barnett said.
In some journals, the problem was particularly acute. For Molecular Cancer and the Journal of Experimental & Clinical Cancer Research, 57% of citations came from flagged papers. Both journals are published by the BMC portfolio, owned by Springer Nature (search). Selene Carey, publishing director for BMC journals, said that she and her team are reviewing the preprint's findings and will take action where appropriate.
Implications for Patient Care
The infiltration of fabricated research into the scientific literature carries direct consequences for clinical medicine. "Cancer research influences clinical trials, drug development and patient care," Professor Barnett said. "If fabricated studies make their way into the evidence base, they can mislead real scientists and ultimately slow progress for patients. That's why it's vital we get ahead of this problem."
René Aquarius, a neurosurgery researcher at Radboud University Medical Center in Nijmegen, the Netherlands, noted that research-integrity sleuths have long suspected paper mills of inflating citations. "But it's nice to see this confirmed in such an elegant way," he added.
Limitations and Next Steps
The researchers emphasized that papers identified by the system should not automatically be treated as fraudulent. The results serve as warning signals rather than confirmed findings of misconduct, and each case still requires review by human experts. Adam Day, founder of research-integrity firm Clear Skies in London, noted that BERT (search) has shown false positives in previous studies, though Barnett countered that given the large sample size, such cases would not change the general patterns observed.
Three scientific journals are already testing the system as part of their editorial review process, aiming to help editors identify potentially fabricated manuscripts before they are sent for peer review. The research team also plans to adapt the tool for use in other scientific fields, with accuracy expected to improve as more confirmed examples of paper mill activity become available.