2 Opportunities and Challenges in Peer Review
Introduction
In this module we dive a little deeper into the nuances of peer review. The peer-review system has been the subject of much debate. In this module we will take a cursory look at some of the opportunities that peer review affords and the challenges it presents.
Although the activities and exercises in this module will offer you exposure to some of the opportunities and challenges, it is important that I present them here.
Opportunities:
- Authors/researchers get meaningful feedback on their work
- Process helps to ensure the quality of scholarly work/knowledge production
Challenges:
- Long publication timelines
- Acknowledging referees’ hidden labor
- Ethical dilemmas
These are certainly not exhaustive lists, and subsequent modules will offer you space and time to reflect on these challenges, as well as the power structures and biases within peer-review systems and processes.
At the end of this module you should be able to:
- Identify some positive aspects of and problems with peer review
- Consider ethical dimensions of the peer-review process
- Interpret peer-review challenges and compose responses to them
This module begins the unveiling of what I hope will be an opportunity for you to discover the multitude of layers of complexity in current peer-review systems and processes, but it is not the end of this discovery. In fact, all subsequent modules will build on the understandings you have gained from this module and future exercises will ask you to dive more deeply into challenges and opportunities.
Activities and Exercises
Do: Brainstorm (2:1)
Set a timer for five minutes and write down (or record yourself thinking aloud) what you think are the opportunities and challenges presented by peer review. Save this list; you will use it later.
Read and Do: Why Peer Review? (2:2)
Read Peer Review in Scholarly Publishing Part A: Why Do It? by Kiron Koshy and co-authors. Make a list of the arguments presented in this short piece. Save this list; you will use it later. Identify one of the arguments presented and compose a social media post (e.g. Twitter, TikTok, Facebook, etc.) substantiating your agreement or your disagreement with the argument. If you feel comfortable sharing what you have composed on social media, please use the course hashtag: #PeerReviewPrimer.
Listen and Reflect: Scientists Aim To Pull Peer Review Out of the 17th Century (2:3)
Listen to this four-minute segment from NPR’s Weekend Edition program. While you’re listening, or after, reflect on the problems presented by the individuals interviewed in the piece. What lingering questions do you have about these problems?
Listen and Read: Peer Review Labor (2:4)
Listen to two minutes of the audiobook What is Peer Review? (A Short Guide) by Jo VanEvery, minutes 11:30-13:30, discussing the labor of peer review.
Read Recognition in Peer Review by Haseeb Irfanullah posted on the Scholarly Kitchen and this editorial from Nature Geneti