Researchers Find 3 Signs That Spot Questionable Journals

Scientific sleuths have cracked the code on spotting journals that might be cutting corners on quality.

Researchers in India and Germany identified three red flags that signal a journal might need a closer look. The signs include doubling publication output in a single year, having more than 70% of articles from one country, and getting at least 15% of papers flagged by quality screening tools.

Using these signals, they scanned thousands of journals and found dozens in Scopus, a major scholarly database, that showed warning signs. About 5% of flagged journals had already been removed from the database.

The discovery matters because Scopus inclusion often determines which researchers get promoted and which institutions get funding. When problematic journals sneak into the database, it can distort the entire system for evaluating scientific work.

Achal Agrawal, the freelance data scientist who co-authored the study, calls these "rudimentary flags" that prompt investigation rather than prove guilt. Some journals have legitimate reasons for sudden growth, like being newly launched or expanding as part of a business plan.

Anna Abalkina, a research integrity expert at the Free University of Berlin, agrees that one flag alone doesn't condemn a journal. A new publication might naturally double its output, she notes. But when all three signals appear together, finding innocent explanations becomes much harder.

The Ripple Effect

Scopus already reviews its listed journals regularly, using similar detection methods. Last year, the database delisted 156 journals, with 100 more removed so far this year. The company's spokesperson emphasized that no single signal determines a journal's fate, and each gets individual assessment.

The roughly 3,500 journals flagged by at least one signal have published more than half a million papers during their warning periods. Nearly 300 showed two red flags, while 28 triggered all three warnings.

Research integrity specialists caution against using the flags as automatic disqualifiers. Small journals naturally have concentrated authorship by country. Context matters when interpreting the data.

The new screening method gives both databases and individual researchers a simple checklist for spotting potential problems before they waste time or damage their careers by publishing in the wrong places.