Project: Research Evaluation and Epistemic Change
Aim
The project addresses a long-standing question in Science Studies: How do evaluations of research by the state and by universities affect the content of research?
Approach
In response to the previous failure of many studies to answer this question, we will apply a new strategy of causal analysis. We adopt from political science the strategy of “causal reconstruction” (Mayntz). This approach starts from observable change – in our case: changes in the content of research – and traces the process leading to this change backwards to its causes. We ask if state and university evaluations are partial causes of changes in research content and look for other partial causes, most importantly the internal evaluation systems of scientific communities.
Establishing causality requires a comparative approach that reconstructs processes leading to different effects under different conditions. Specifically, we compare:
- the development of three innovations
- three different fields with field-specific internal evaluation systems
- three countries with different national evaluation systems

Data and methods
The empirical investigation combines:
- the analysis of documents like researchers’ publications, websites of research groups, and university websites describing evaluations
- bibliometric methods for the analysis of publication networks and their development
- interviews with researchers and university managers
- observations of events at which researchers evaluate each other’s research (e.g. conferences and seminars)
Team
Jochen Gläser (Technical University Berlin)
Grit Laudel (Technical University Berlin)
Emiel Bottenheft (Technical University Berlin)
Thomas Franssen (Centre for Science and Technology Studies, Leiden)
Richard Woolley (INGENIO (CSIC-UPV), Valencia)
Laura Soto Díaz (INGENIO (CSIC-UPV), Valencia)
Lee Ann Reyneke (Student assistant, Technical University Berlin)
Karl Homuth (Student assistant, Technical University Berlin)
This research project is supported by the German Federal Ministry of Education and Research (BMBF).