Tagged: random selection

This is a guest post by Louis Larue, Marie Skłodowska-Curie Postdoctoral Fellow at Aalborg University.

Applying for external funding is an integral part of academic life. Universities dedicate huge amounts of resources, and often have entire teams of administrators and advisors, to help researchers obtain external grants and manage the immense load of paperwork required to administrate successful applications. Researchers and teachers, at all stages of their careers, spend considerable time and resources to write, read, revise, and submit applications. If successful, they will then have to write various reports and will be required to master the complex and often obscure language of funding agencies. At a more advanced stage of their careers, they will also dedicate a significant share of their time to reviewing and evaluating applications submitted by others and to sit in various selection committees.

In general, the evaluation procedure involves (in one or several steps) the evaluation of the scientific quality of the submitted application, by one or several peers. When all evaluations have been gathered, a selection committee usually selects successful applicants. The ideal behind this procedure (which I have only sketched here and which varies across countries and institutions) is to select, impartially, the “best” applications, that is, those with the highest level of scientific quality, properly defined.

I do not deny the value of this ideal, but it is far from realized in practice. The reform proposal that I defend below is meant to reinvigorate this ideal and salvage it from several threats.