Administrative procedure for Researcher Project applications in 2023

As soon as the application deadline has passed, the Research Council conducts a preliminary administrative review of the applications received. Applications that do not meet the formal requirements described in the call may be rejected.

8 February: The applications are assessed by a set of referee panels composed on the basis of which topic the applicant has selected from the call.

15 March (FRIPRO): The applications are distributed between a number of referee panels based on the applications’ scientific scope and the number of applications received under the research area in question. It is the applications scientific scope that determines which panel will assess the application. 

In the period 2019-2022, FRIPRO funding was awarded through joint calls for Researcher Projects, and applications were assessed in about 90 different panels each year. For the 15 March call, we plan to distribute the applications to about 25 panels, where each panel will cover a significantly broader research area. The referees will therefore, to a lesser extent, have specialist expertise for each individual application because they have to cover a broad research area.

With support from a machine learning algorithm, the applications that we receive are distributed in groups. The algorithm is trained with previous years placement of applications in panels and is based on the text in the project descriptions. This pre-sorting of the applications frees up a lot of our case officer's time.

The case officers of each panel distribute each proposal to the panel that will give the best possible assessment. The project's title, objectives and summary are the main sources of information we use when assigning applications to panels. We strongly encourage applicants to write these texts clearly with case officers and referees with a general scientific understanding of the field in mind.

Many applications are considered for more than one panel. This includes interdisciplinary proposals and proposals where it is difficult to find similarities to other applications. The boundaries between each panel, can and will vary from year to year. It is not our preliminary classification before the application deadline that determine where the applications are placed, but how the applications best fit together, and how they are best covered by available referees.  

Recruiting referees to assess the applications starts before the application submission deadline but is not completed before proposals have been assigned to a panel.

Our referees must meet the following requirements:

• They must work abroad.
• They must be active researchers who have produced a significant body of work in terms of both quantity and quality. 
• They should qualify for professorship. The minimum requirement is qualifications as associate professor.  

Expert Lookup is our most important tool to find referees. We perform automated searches based on project titles, objectives and summaries, as well as manual searches. The case officers then make a thorough assessment whether the referees are a good match for one of our panels, or perhaps to assess individual applications. We supplement the findings in Expert Lookup with searches on other websites such as Web of Science and Google Scholar, as well as well-known foreign universities in the various fields. The list of sources varies from field to field. We also consider the applicant’s own suggestions for suitable referees or description of suitable expertise.

The main rule is that the same referee is not to be used more than three times in a row.

When the entire application process is finalized, the panels with their referees are published.

The researchers that have accepted to be a referee, receive a list of all project managers and partners of the applications assigned to their panel. The list is returned with statements regarding their impartiality towards everyone on the list. They are asked to pay special attention to the points in the impartiality provisions where collaboration, friendship and conflicts are discussed.

Referees do not get access to applications for which they are not impartial and do not participate in the panel meeting when these applications are discussed.

Impartiality in administrative proceedings.

The panel consists of minimum four referees. Overall, their competence must cover the scientific content of all the applications to be assessed by the panel. At least one panel member must have experience from interdisciplinary research when such applications are handled by the panel.

Before the referees get access to any content of the proposals they are to assess, they must consent to our provisions on confidentiality. Based on the title, objectives, and summary of the applications, the referees declare their level of expertise. We encourage applicants to word these texts in a way that enables the panel members to state their level of expertise as accurately as possible. The texts must be informative to referees with general expertise in the field.

The levels of expertise are defined as:

• Specialist (S): The proposal is within your primary area(s) of expertise or connected to your research interests. You are well qualified to evaluate the proposal.
• Generalist (G): You have a general knowledge of the main subject of the proposal (or at least one of the main subjects if there are several). You are qualified to evaluate the proposal
• Minor (M): You have only minor relevant expertise on the main subject(s) of the proposal.

According to our standards, for each application there must be least two panel members with generalist or specialist expertise. If the mapping of the panel’s expertise shows that some applications are not adequately covered, we will find additional external referees with specialist expertise. These external referees evaluate only individual applications and provide a similar assessment as the panel members.

15 March (FRIPRO): The applications will mainly be assessed by referees with general expertise.

When referees are formally appointed to serve as a panel member, they receive information about the administrative procedure through the document Guidelines for referee panels assessing Researcher Projects 2023 orGuidelines for FRIPRO referee panels 2023 (see the links below). The document describes the whole process and the referees’ role before, during and after the panel meeting.

The four assessment criteria (Potential for advancing the state-of-the-art, Quality of R&D activities, Impact and Implementation) are also described in detail and the scale of marks is defined. We emphasise the importance of consistent marking and the quality of the feedback to the applicants.

8 February: Guidelines for referee panels assessing Researcher Projects 2023 (PDF).

15 March (FRIPRO): Guidelines for FRIPRO referee panels 2023 (PDF).

All panel members read and assess all applications. The grant application form, project description and CVs form the basis of the assessment. Each application is given special attention by a principal and a second assessor.

• Prior to the panel meeting, the members submit their individual assessment of each application. This is made available to the other referees when everyone has submitted their assessments. On this basis they may prepare for the discussions in the panel meeting.
• The principal assessor submits a draft for a complete written assessment and a mark for each of the four assessment criteria.
• The second assessor submits a brief written assessment and a mark for each criterion.
• The other panel members submit a mark for each criterion.
• Any external referees who are not part of the panel will submit a complete written assessment and a mark for each criterion.

Panel meeting procedures are described in the Guidelines for referee panels assessing Researcher Projects 2023 and Guidelines for FRIPRO referee panels 2023 (see the links below).

The members attend the panel meeting with their different professional views, various emphasis on the elements of the application and their own interpretations of the scale of marks. All panel meetings start with a review of the general instructions, including how to use the scale of marks, the assessment criteria, and expectations related to the content of the written feedback to the applicant. The panel reaches a consensus-based assessment and a unified use of the scale of marks.

The Research Council's case officer will not participate in the scientific discussions. Their role is to provide guidance and ensure progress in the meeting, a joint interpretation of the assessment criteria and scale of marks, and that everyone contributes. They also handle impartiality according to the rules and stop discussions about matters that are outside the panel's tasks.

The case officer reads the written assessments, making sure they are in accordance with the panel’s decision and meet the quality requirements described below:

8 February: Guidelines for referee panels assessing Researcher Projects 2023 (PDF).

15 March (FRIPRO): Guidelines for FRIPRO referee panels 2023 (PDF).

Only 8 February: The panels have access to the priorities described within each topic in the call, which allows them to see the context in which the application is written. However, the panel will not assess its relevance. The application’s relevance to the topic, i.e. how well it addresses the priorities, will be assessed by the Research Council after the panel meetings.

The relevance assessment is conducted by the RCN administration. As a general rule, only applications given the mark 5 or better on all criteria are eligible for funding and will be assessed for relevance to the topic selected by the applicant. For some topics, if the number of applications is very large compared to available funding, stricter mark requirements might be set for the applications that are to be assessed for relevance. Applications targeting Ground-breaking Research are exempt from relevance assessment.

The panel’s judgment of the application’s impact addresses the project’s general potential for scientific or societal impact. The Research Council assesses if the application addresses the priorities described under each topic in the call for proposals. These priorities are based on the ministries’ Letters of Allocation to the Research Council.

Primarily, the attachment Relevance to the topic is the basis for our assessment, but the application, project description and the referee panel's assessment may also be used. For Researcher projects we have internal guidelines for assessing relevance to the topic (only in Norwegian).

Applications received to the call deadline 15 March (FRIPRO) will not be assessed for relevance, because applications targeting Ground-breaking Research (FRIPRO) are exempt from relevance assessment.

8 February: When the portfolio assessment begins, the applications have been awarded five separate marks and written assessments: Potential for advancing the state-of-the-art, Quality of R&D activities, Impact and Implementation and Relevance.

When we prioritise proposals and prepare ranked lists for the portfolio boards, we carry out a portfolio assessment that includes:

• the assigned marks based on the assessments;
• a good distribution of projects in relation to priorities set out for the specific topic;
• the relative volume and quality of grant applications within the same topic under other calls in 2023;
• any changes in the financial or scientific framework set by the ministries;
• priority will be given to projects with female project managers when the applications otherwise are considered to be on a par.

All these factors are included in the portfolio assessment, which forms the basis for the ranked lists we present to the portfolio boards.

15 March (FRIPRO): When the portfolio assessment begins, the applications have been awarded four separate marks and written assessments: Potential for advancing the state-of-the-art, Quality of R&D activities, Impact and Implementation.

The competition for FRIPRO funding is tough. Applications must therefore meet a mark requirement to be considered for FRIPRO funding. Only applications awarded a mark of 6 or 7 by the panels for all of the assessment criteria are eligible for funding.

When we prioritise proposals and prepare ranked lists for the three portfolio boards, we carry out a portfolio assessment that includes:

• the assigned marks based on the assessments;
  • among the eligible applications, we will place most emphasis on the criteria Potential for advancing the state-of-the-art and Quality of R&D activities when selecting which projects to grant funding to
• any changes in the financial or scientific framework set by the ministries;
• priority will be given to projects with female project managers when the applications otherwise are considered to be on a par.

8 February: The portfolio boards decide which proposals that are granted funding. There are 16 portfolio boards with significant variation in available budget, number of announced application types, number of Researcher Project applications for processing, thematic span and expected number of granted applications.

The various boards may emphasise the factors mentioned above (see the section ‘Portfolio assessment’) differently. However, they are not allowed to deviate from the priorities described under the topics of the call. Commonly, the administration presents alternative ranked lists to the portfolio board where the factors are differently emphasized. The lists form the basis for the portfolio board’s discussion of the considerations they want to prioritise, within the available budget and the priorities described in the call. Their final decisions may differ from the lists presented by the Research Council.

15 March (FRIPRO): The following three portfolio boards decide which proposals are granted funding from FRIPRO: humanities and social sciences, life sciences, and natural sciences and technology.

The administration presents separate ranked lists to each of the portfolio boards. The lists form the basis for the portfolio board’s discussion of the considerations they want to prioritise, within the available budget and the priorities described in the call. The portfolio boards' discussion may result in final decisions that differ from the suggestions presented by the Research Council.

For applications that are not grated funding, the applicant will receive a letter of rejection in MyRCN as soon as possible.

All applicants will receive feedback from the panel in terms of marks with written assessments on the four criteria.

For applications assessed for relevance the written relevance assessment will be included in the feedback.

The letter of decision will also provide information on

• Which panel assessed your application
• Which referees participated in the panel
• Which portfolio board made the funding decision
• The principles applied in the portfolio assessments
• Statistics about the applications and marks

8 February: Which applications that were grated funding will be published on our website and in our newsletter in the end of June 2023.

15 March (FRIPRO): Which applications that were granted funding will be published on our website and in our newsletter in the end of October 2023.