Javascript must be enabled to continue!
Rethinking Grant Peer Review
View through CrossRef
The author is a professor in the Department of Opthalmology and the Program in Cell and Molecular Biology at the Saint Louis University School of Medicine, St. Louis, MO. I and other members of the Society for Glycobiology were recently sent a letter marked “URGENT—IMPORTANT—PLEASE RESPOND” from the society's president, Ajit Varki, bemoaning the fact that the number of reviewers with expertise in glycobiology serving on National Institutes of Health (NIH) Initial Review Groups (IRGs) has rapidly diminished, and that potential reviewers in the scientific community at large are simply refusing to serve on IRGs when asked. This has created a significant problem for NIH's Division of Research Grants in assigning glycobiology-related grant applications for review. The plight Varki brought to our attention (astutely, I believe) is not peculiar to the glycobiology community nor to the IRGs charged with reviewing glycobiology-related grant applications. IRGs throughout the various branches of NIH are faced with the perennial and increasingly difficult problem of how to attract “the best and the brightest” to serve on IRGs, thereby maintaining a high and broad level of expertise for review of the thousands of grant applications submitted each year.
It is no wonder that many researchers lack the desire to serve as regular members of IRGs. Such service requires a substantial commitment of one's time, typically over a 4-year period, which can detract substantially from one's research productivity as well as compromising one's time for other pursuits. In addition, the lack of remuneration for one's labors is a negative incentive. Faced with the prospect of either serving on an IRG or spending an equivalent amount of time as a professional consultant to the pharmaceutical or biomedical industry, many researchers undoubtedly would choose the more financially rewarding option. Adding salt to the wound, so to speak, many reviewers find that their own grant applications do not fare well in the peer review system after they have completed such service. Finally, although serving on an NIH IRG used to be considered quite an honor, membership in this elite corps can also bring with it the status of pariah in the eyes of those whose applications are not approved for funding.
Faced with the inability to recruit established investigators, the scientific review administrators of some IRGs have resorted to recruiting relatively unseasoned, though arguably bright and talented, individuals (such as recently appointed assistant professors) who have little experience in the peer review system, including the unparalleled exhilaration (!) of submitting their own competitive renewal applications. Although this practice may lessen the reviewer shortage problem, it is not only unwise but unfair, both to the reviewers and to the grant applicants. The applicants are not served well by such novice (and typically hypercritical) reviewers. Likewise, unseasoned reviewers should not be burdened by the time-consuming chore of grant review; rather, they should be given the time and resources to foster the development of their own research careers.
I offer the following solution to this dilemma: Provide the chosen reviewers with a year of federal grant support for every year of IRG service, equivalent to the average of yearly direct-cost support for grants funded over the time of service. A person chosen to serve on an IRG because of his or her expertise and stature surely merits such support. The criteria for service on an IRG should be adjusted so that only researchers who have been awarded a minimum of two full grant cycles of funding (that is, an initial award and a competing renewal) will be considered eligible for service. In addition, the term of service should be no more than 3 years (4 years is almost punitive). However, such service would then make one ineligible to serve again, for a period of no less than four full cycles (12 years) from the date of service termination.
There is apparently no lack of competent, eligible reviewers—only of willing ones. Not only will the proposed modification of the peer review system solve the present reviewer shortage crisis, it will improve the quality of IRG panels. How to deal with the throngs of would-be reviewers vying for selection to IRGs may pose a heretofore unencountered problem, but I submit that such a problem is far less dire than the current one.
Title: Rethinking Grant Peer Review
Description:
The author is a professor in the Department of Opthalmology and the Program in Cell and Molecular Biology at the Saint Louis University School of Medicine, St.
Louis, MO.
I and other members of the Society for Glycobiology were recently sent a letter marked “URGENT—IMPORTANT—PLEASE RESPOND” from the society's president, Ajit Varki, bemoaning the fact that the number of reviewers with expertise in glycobiology serving on National Institutes of Health (NIH) Initial Review Groups (IRGs) has rapidly diminished, and that potential reviewers in the scientific community at large are simply refusing to serve on IRGs when asked.
This has created a significant problem for NIH's Division of Research Grants in assigning glycobiology-related grant applications for review.
The plight Varki brought to our attention (astutely, I believe) is not peculiar to the glycobiology community nor to the IRGs charged with reviewing glycobiology-related grant applications.
IRGs throughout the various branches of NIH are faced with the perennial and increasingly difficult problem of how to attract “the best and the brightest” to serve on IRGs, thereby maintaining a high and broad level of expertise for review of the thousands of grant applications submitted each year.
It is no wonder that many researchers lack the desire to serve as regular members of IRGs.
Such service requires a substantial commitment of one's time, typically over a 4-year period, which can detract substantially from one's research productivity as well as compromising one's time for other pursuits.
In addition, the lack of remuneration for one's labors is a negative incentive.
Faced with the prospect of either serving on an IRG or spending an equivalent amount of time as a professional consultant to the pharmaceutical or biomedical industry, many researchers undoubtedly would choose the more financially rewarding option.
Adding salt to the wound, so to speak, many reviewers find that their own grant applications do not fare well in the peer review system after they have completed such service.
Finally, although serving on an NIH IRG used to be considered quite an honor, membership in this elite corps can also bring with it the status of pariah in the eyes of those whose applications are not approved for funding.
Faced with the inability to recruit established investigators, the scientific review administrators of some IRGs have resorted to recruiting relatively unseasoned, though arguably bright and talented, individuals (such as recently appointed assistant professors) who have little experience in the peer review system, including the unparalleled exhilaration (!) of submitting their own competitive renewal applications.
Although this practice may lessen the reviewer shortage problem, it is not only unwise but unfair, both to the reviewers and to the grant applicants.
The applicants are not served well by such novice (and typically hypercritical) reviewers.
Likewise, unseasoned reviewers should not be burdened by the time-consuming chore of grant review; rather, they should be given the time and resources to foster the development of their own research careers.
I offer the following solution to this dilemma: Provide the chosen reviewers with a year of federal grant support for every year of IRG service, equivalent to the average of yearly direct-cost support for grants funded over the time of service.
A person chosen to serve on an IRG because of his or her expertise and stature surely merits such support.
The criteria for service on an IRG should be adjusted so that only researchers who have been awarded a minimum of two full grant cycles of funding (that is, an initial award and a competing renewal) will be considered eligible for service.
In addition, the term of service should be no more than 3 years (4 years is almost punitive).
However, such service would then make one ineligible to serve again, for a period of no less than four full cycles (12 years) from the date of service termination.
There is apparently no lack of competent, eligible reviewers—only of willing ones.
Not only will the proposed modification of the peer review system solve the present reviewer shortage crisis, it will improve the quality of IRG panels.
How to deal with the throngs of would-be reviewers vying for selection to IRGs may pose a heretofore unencountered problem, but I submit that such a problem is far less dire than the current one.
Related Results
Challenges faced in the peer review system in open access journals
Challenges faced in the peer review system in open access journals
The whole mechanism of academic journal’s peer review system process effectively depends on how editors manage the journal work. The handling of the peer review system will determi...
Non-Recommended Publishing Lists: Strategies for Detecting Deceitful Journals
Non-Recommended Publishing Lists: Strategies for Detecting Deceitful Journals
Abstract
The rapid growth of open access publishing (OAP) has significantly improved the accessibility and dissemination of scientific knowledge. However, this expansion has also c...
Evaluating the Science to Inform the Physical Activity Guidelines for Americans Midcourse Report
Evaluating the Science to Inform the Physical Activity Guidelines for Americans Midcourse Report
Abstract
The Physical Activity Guidelines for Americans (Guidelines) advises older adults to be as active as possible. Yet, despite the well documented benefits of physical a...
Identifying Patterns and Motivations of ‘Mega’ Peer-Reviewers
Identifying Patterns and Motivations of ‘Mega’ Peer-Reviewers
Abstract
Background. The demand for peer reviewers is disproportionate to the supply and availability of reviewers. Identifying the factors associated with peer review beha...
Rethinking Scientific Publishing
Rethinking Scientific Publishing
Dear Reader,
Welcome to the inaugural Editorial of a unique journal: ScienceOpen Research.
The birth of the academic journal goes back more than 300 years, when the very first vol...
Towards Theorizing Peer Review
Towards Theorizing Peer Review
Despite more than 50 years of research, academic peer review and its contexts remain seriously undertheorized. Studies on peer review focus on discovering and confirming phenomena,...
538 Peer MRCS Teaching Among Surgical Trainees in the East Midlands Deanery, UK
538 Peer MRCS Teaching Among Surgical Trainees in the East Midlands Deanery, UK
Abstract
Background
During the covid-19 pandemic, the East Midlands South Deanery ran virtual peer-MRCS OSCE teaching. We analys...
Trends in Peer Review
Trends in Peer Review
Peer review is primarily discussed in the literature with respect to its deficits, e.g. bias or inefficiency. In contrast, our synthesis asks why peer review is used ubiquitously a...

