From March to November 2021, the European Commission consulted European and international stakeholders on how to facilitate and speed up reform to enable the quality, performance and impact of research and researchers to be assessed on the basis of more appropriate criteria and processes. In July 2022, after a co-creation process involving more than 350 organizations from more than 40 countries, including UOC, the Agreement on Reforming Research Assessment was published.
Based on 10 commitments, the agreement establishes a common direction for research assessment reform, while respecting organizations’ autonomy. The Agreement sets a shared direction for changes in assessment practices for research, researchers and research performing organizations, with the overarching goal to maximize the quality and impact of research. The Agreement includes the principles, commitments and timeframe for reforms and lays out the principles for a Coalition of organizations1 willing to work together in implementing the changes.
Organizations involved in research assessment (based in Europe or further afield) are warmly encouraged to sign the Agreement and to subsequently join the Coalition for Advancing Research Assessment (CoARA), constituted at the end of 2022.
Principles for assessment criteria
Quality and impact
-
Focus research assessment criteria on quality. Quality implies the originality of ideas, professional research conduct, a variety of research missions, transparent research processes and methodologies, openness of research, results are verifiable and reproducible, data sharing, and open collaboration.
- Recognize contributions that advance knowledge and the (potential) impact of research results (be it scientific, technological, economical and/or societal impact).
Diversity, inclusiveness and collaboration
-
Recognize the diversity of research activities and practices, with a diversity of outputs, and reward early sharing and open collaboration.
-
Respect the variety of scientific disciplines, research types and research career stages.
-
Acknowledge and valorize diversity in research roles and careers.
- Ensure gender equality, equal opportunities and inclusiveness.
Commitments established in the Agreement
Core commitments
Recognize the diversity of research contributions and careers in accordance with the needs and nature of the research.
Base research assessment primarily on qualitative evaluation, for which peer review is central, supported by responsible use of quantitative indicators.
Abandon inappropriate uses in research assessment of journal- and publication-based metrics, in particular inappropriate uses of the Journal Impact Factor (JIF) and h-index.
Avoid the use of rankings of research organizations in research assessment.
Supporting commitments
Commit resources to reforming research assessment as is needed to achieve the organizational changes committed to.
Review and develop research assessment criteria, tools and processes.
Raise awareness of research assessment reform and provide transparent communication, guidance, and training on assessment criteria and processes as well as their use.
Exchange practices and experiences to enable mutual learning within and beyond the Coalition.
Communicate progress made on adherence to the Principles and implementation of the Commitments.
Evaluate practices, criteria and tools based on solid evidence and the state of the art in research on research, and make data openly available for evidence gathering and research.
Additional points of interest
- FAQs about the European Agreement on Reforming Research Assessment
- Scoping report laying the groundwork for research assessment reform (November 2021)
- ERA Talk video on reforming research assessment (11 minutes of informative conversation)
- European Commission web page on the process towards an agreement on reforming research assessment
- Erasmus Universiteit Rotterdam short video (3 minutes)