Project: Research Evaluation and Epistemic Change

Aim

The project addresses a long-standing question in Science Studies: How do evaluations of research by the state and by universities affect the content of research?

Approach

In response to the previous failure of many studies to answer this question, we will apply a new strategy of causal analysis. We adopt from political science the strategy of “causal reconstruction” (Mayntz). This approach starts from observable change – in our case: changes in the content of research – and traces the process leading to this change backwards to its causes. We ask if state and university evaluations are partial causes of changes in research content and look for other partial causes, most importantly the internal evaluation systems of scientific communities.


Establishing causality requires a comparative approach that reconstructs processes leading to different effects under different conditions. Specifically, we compare:

  • the development of three innovations
  • three different fields with field-specific internal evaluation systems
  • three countries with different national evaluation systems


Data and methods

The empirical investigation combines:

  • the analysis of documents like researchers’ publications, websites of research groups, and university websites describing evaluations
  • bibliometric methods for the analysis of publication networks and their development
  • interviews with researchers and university managers
  • observations of events at which researchers evaluate each other’s research (e.g. conferences and seminars)

Team

Jochen Gläser (Technical University Berlin)

Grit Laudel (Technical University Berlin)

Emiel Bottenheft (Technical University Berlin)

Thomas Franssen (Centre for Science and Technology Studies, Leiden)

Richard Woolley (INGENIO (CSIC-UPV), Valencia)
Laura Soto Díaz (INGENIO (CSIC-UPV), Valencia)

Lee Ann Reyneke (Student assistant, Technical University Berlin)
Karl Homuth (Student assistant, Technical University Berlin)

BMBF-funded research project

This research project is supported by the German Federal Ministry of Education and Research (BMBF).