Loading...

Are Good Practices In Peer Review Really Good?

By   Haseeb Irfanullah Jul 14, 2025 799 16

Over the past five decades or so, ‘peer review’ has become an inseparable element of academic journal publishing. In my recent articles in the Scholarly Kitchen, however, I’ve strongly criticised the effectiveness and importance of the current peer-review system given its numerous flaws, especially from ethical and justice points of view. Still, we can’t ignore the millions of hours volunteer reviewers are putting into the journal publishing industry every year.

In this article, I discuss some good practices in peer review under six themes. On 22 & 23 June 2025, I shared and discussed these with BanglaJOL’s journal editors in a workshop organised by the Bangladesh Academy of Sciences in Dhaka. Here, however, I also include my critical thoughts on these practices.

Finding peer reviewers

As a general rule, editorial board members of a journal shouldn’t be its reviewers. But, many society journals don’t, or can’t, follow this rule as they don’t get good feedback from sufficient number of reviewers to make a decision. Nevertheless, the Open Access Journals Toolkit lists several strategies that editors could use to find peer reviewers: i) ask authors to suggest names, ii) check the reference list of the submitted manuscript, iii) use automated tools to identify relevant researchers, iv) use personal networks, v) invite previous peer reviewers, and vi) ask declining peer reviewers to suggest alternative candidates. Another obvious source of peer reviewers would be the authors who have recently published similar articles in your journal. But, as an editor, I’ve seen such authors promptly declining my invitations.

The first strategy listed above may seem a conflict of interest. But here a couple of things may happen: a) editors trust authors to share names who would review the manuscript unbiasedly, and b) this would help editors to create a pool of relevant reviewers for future use. Back in 2006, when I became the first executive editor of Bangladesh Journal of Plant Taxonomy, I practiced this strategy to create a potential reviewers' pool. This is still useful today, especially when a journal doesn’t have access to AI-run reviewer search engine. This strategy could also be the last resort for some journals. After waiting for almost six months and failing to have a single reviewer accepting to review our paper, the editorial office asked us to share some potential reviewers.

Reducing peer-review time

While it is a good practice to publicly mention the average duration of peer-review process, it is becoming increasingly difficult for journals to maintain shorter review time due to i) not finding sufficient suitable reviewers, ii) invited reviewers being reluctant to accept invitations, iii) those who accept, do not give feedback on time, or iv) they becoming completely silent. Of course, sending repeated reminders to the reviewers (by automated system, email, message, and/or call) 7, 3, and 1 days before the deadline often works to get a quicker review report, as many of them tend to work near or on the deadline.

Manuscript quality may also be related to a quicker response. Therefore, initial manuscript screening by the editorial office needs to be more efficient; if needed, should be followed by a 'desk rejection' (return without review). In this way, only quality submissions reach reviewers, in turn shortening feedback time, and potentially improving acceptance rate.

Many journals, which use automated review platforms, send a manuscript to numerous peer reviewers simultaneously. Once they receive a sufficient number of reviews, they send a message to the rest of the reviewers that their reviews are no longer required. I personally won’t be happy if I knew I am one of 10 reviewers, when the journal needs only two to make a decision. It seems to me, here the editors are not only ‘rolling the dice’ to get a review by chance, they are also undermining reviewers’ specific expertise and considering peer review as a mere ‘compliance’ to accept a manuscript for publication.

There are other extreme examples on this topic. In the recent BanglaJOL editors’ workshop I mentioned above, a very senior editor argued that, if the second reviewer’s comments are not received after a long wait, it is OK for the chief editor to check the article thoroughly (to cover that review gap), as they are supposed to read it anyway as their editorial duty. This example underscores how different editors understand and manage peer-review system. While this approach was OK before peer review became the ‘peer review’ as we know now, it is not right as per the current peer-review standards promoted by global authorities. But considering the local context and a good intention to expedite science communication, can we really ignore the realities of a resource-constraint and technologically-weak society?

Editor-author relationship in peer review

Continuing with the last theme, a long delay in getting a decision on a manuscript is painful for all authors. While getting reviewers’ comments faster isn’t always under editors’ control, the editors can at least promptly respond to any queries from the authors regarding the peer-review process, even if the journal portal updates the manuscript status. Editors should also help authors to understand reviewers' comments if these are not clear enough. Sometimes we see contradictory comments/recommendations from two reviewers. One option would be to send the manuscript to the third reviewer, thus delaying further. But, I think, as editors, we should let authors decide on what to respond and how. In this connection I must add that editors should accept logical arguments of the authors, even if those challenge a reviewer's stand. I can still remember, about 20 years ago, I found an editor by my side when one of two reviewers recommended rejection. 

Recognising peer reviewers

While paying the reviewers is a form of recognition, as discussed separately below, peer reviewers could be recognised in many other ways. These can, for example, include issuing certificates to reviewers, or thanking them by publishing their names (without linking them to any published articles) in the last issue of a volume/year or by publishing on the journal website, or as happens now-a-days, by citing reviewers’ names in the published articles. Further, good reviewers could be invited to join the editorial board or invited as resource persons of relevant capacity building programmes. Journals/publishers can collaborate with global initiatives (e.g., Web of Science, Reviewer Credits) to enhance their reviewers' recognition. 

Also, journals could update their policies to encourage senior peer reviewers to collaborate with early-career researchers to review a manuscript, which is already happening in many regions, in many disciplines, silently. In such a case, both will get due credit for their reviews. This arrangement is called ‘co-review’, and publishers like IOP Publishing have been practicing this for a while now. But, as I argued elsewhere, if peer review is fundamentally flawed by treating peer reviewers as ‘free labourers’, could co-review risk becoming another mechanism to reinforce the unpaid labor model at the heart of peer review?

Paying/compensating peer reviewers

Globally, in almost all contexts, any payment to the reviewers is seen negatively. It is because this may bias the reviewers in making the recommendations or can cause a conflict of interest. (Ironically, we don’t hear the same argument when authors pay article processing charges (APCs) to gold open access journal publishers, where the final decision-maker editors are paid from the APCs).

Nevertheless, if a journal needs to pay/compensate its reviewers, it should be clearly mentioned on its journal website. Non-monetary compensation may include free society membership, free access to published articles, and free conference/other event registration. In a Scholarly Kitchen article, I proposed a novel ‘Voluntary Contribution Transaction System’ for the publishing industry to appreciate all voluntary work individuals do, including peer review. This could be translated at the individual publisher’s level as well.

I know that in some journals, only the reviewers from the host country are paid an honorarium, but not the international reviewers. If payment/compensation is practiced by a journal, it must not create such an inequality among its reviewers.

Peer-review policy

Although I’m writing about it as the last point, every journal should have a clear peer review policy, approved by its editorial board or the publisher. The policy should note if the journal is single anonymous (reviewers' identity is hidden from the authors), double anonymous (authors and reviewers are unaware of each other), triple anonymous (editors, authors, and reviewers are unaware of each other), open (editors, authors and reviewers are aware of each other), or transparent peer review (reviews are published along with respective articles).

Such a policy should be publicly available (on the journal website) and be updated as needed. It is essentially a public declaration of transparency to ensure the quality of the publications. Regular updating of the policy is essential because of many evolving issues in the publishing industry. For example, peer review policy should now include the journal's position on if peer reviewers can use Generative AI to review a manuscript. It is because, use of AI can violate data protection laws related to journal publishing.

Finally, peer review is supposed to be a collaborative process between the authors and the peer reviewers, facilitated by the journal editors. But it often seems to be a box-ticking activity for journals. We need to come out of such a mentality. Journal editorial office must ensure that all stakeholders involved in the peer-review process show integrity, transparency, accountability, and cooperation.

Keywords

Peer review reviewer recognition editorial practices co-review review time management reviewer compensation peer review policy ethical publishing

Haseeb Irfanullah
Haseeb Irfanullah

Dr. Haseeb Md. Irfanullah is a biologist-turned-development facilitator, who often introduces himself as a research enthusiast. Over the past 26 years, Haseeb has been working for different international environment and development organisations, academic and research institutions, funders, and government agencies in different capacities. Currently, he is an independent consultant in environment, climate change and research system, and a visiting research fellow at the University of Liberal Arts Bangladesh (ULAB), Dhaka. Advisory cabinet member of Asian Council of Science Editors (ACSE), co-chair of Environment & Sustainability Committee of European Association of Science Editors (EASE), an associate editor of Learned Publishing, an associate at INASP and Research Consulting Ltd., and a Chef of the Scholarly Kitchen, Haseeb advocates for justice, sustainability, climate action, and resilience of the scholarly publishing ecosystem. Haseeb has a PhD in aquatic ecology from the University of Liverpool, UK.

View All Posts by Haseeb Irfanullah

Recent Articles

Gatekeeping Reimagined: Elevating Editorial Workflows Through Responsible AI
Gatekeeping Reimagined: Elevating Editorial Workflows Through Responsible AI

The scholarly publishing landscape is undergoing rapid transformation, driven by advances in AI, automation, and the growing ...

Read more ⟶

Forging New Alliances: Contrimetric Partners with ACSE to Support Smarter Research Workflows
Forging New Alliances: Contrimetric Partners with ACSE to Support Smarter Research Workflows

The Asian Council of Science Editors (ACSE) is delighted to welcome Contrimetric as its newest corporate member, a partnersh...

Read more ⟶

Spotlight Interview: Dr. Mingfang Lu on China's Evolving Academic Publishing Landscape
Spotlight Interview: Dr. Mingfang Lu on China's Evolving Academic Publishing Landscape

As China's role in global research continues to expand, questions about visibility, quality, and innovation in its scholarl...

Read more ⟶