Survey on the Research Council's assessment system:
Expert referees very pleased
A full 98 per cent of the respondents to a survey on the Research Council's system for expert referees are very or extremely satisfied with the electronic evaluation application they must use, and with the administrative procedures. They are equally satisfied with their contact with the Research Council administration.
(Photo: Shutterstock)
The Research Council employs peer review as an important factor in its efforts to ensure that project funds are awarded to the grant applications with the highest scientific merit. What do Norwegian and international experts think about the Research Council's peer review system? What do they think about the technical aspects, the general procedures and their experience of dealing with the Research Council and its employees?
Over 3 300 researchers received these questions in connection with a survey that was carried out in January this year. As many as 90 per cent of those invited to take part in the survey were from institutions abroad. Common to all of them was the fact that they had assessed grant applications for the Research Council during the course of 2007 and 2008. A total of 58.7 per cent of those who received the survey responded, which is regarded as extremely satisfactory.
The embedded asset has been deleted:
Asset Type: ImageFile_flex
Asset Id: 1098976570767
PAGENAME: ForskningsradetEngelsk/ImageFile_flex/VisBildeVenstrestiltMedTekst"The results show that the Research Council can be very pleased with the peer review system in general. However, when it came to the more detailed questions in the survey the level of satisfaction varied from 70 to 90 per cent. The answers we received give us some clear indicators of areas where improvement is warranted," explains Svein Erik Høst, Director on the Director General's staff at the Research Council.
What's in it for me?
The peer review system is dependent on the willingness of researchers and academics around the world to take the time to evaluate the input of others to research projects, and the task of recruiting enough qualified experts to assess grant applications poses a constant challenge.
Thus, one of the questions in the survey was concerned with what motivates experts to do this job. While many stated that they assess applications because it strengthens their academic network, most replied that they take on the task because they feel a responsibility for academic development within their field.
Great need for international referees
The Research Council makes widespread use of international referees in its assessment of grant proposals.
"International referees bring new, important perspectives to Norwegian research and their involvement enhances our own development within our respective fields and our ability to produce research of high international calibre. It is essential that we have an assessment system in place that makes it easy for international experts and others to work for us in this capacity," says Høst.
Valuable comments
Some 600 of the respondents also provided useful insights in the form of individual comments.
"We note, in particular, that the expert referees would like to know the outcome for the projects they have assessed: did the grant proposal receive funding from the Research Council or was it rejected?"
Other important comments were related to the assessment process itself.
"One negative element that was brought to our attention is that many referees report late or non-payment of their remuneration. This may to some degree be connected to the requirements set by the Norwegian authorities on disbursement of payment abroad, but that is probably not the whole explanation. Clearly, we need to find better routines in this respect," states Høst.
- Published:
- 05.03.2009
- Last updated:
- 06.03.2009
