Table of Contents – Prometheus Assessed?

Table of Contents

Cover image

Title page


List of figures and tables

List of abbreviations


About the authors

Chapter 1: Prometheus assessed?


Bibliometric measures

Panel review models

Decentralised models

But models overlap

The philosophy of science and research assessment

What use, if any, is the philosophy of science to research assessment?

Prometheus assessed – towards a study of the processes and assessment of research

Chapter 2: Publication, citation and bibliometric assessment of research


Publication and its centrality to research assessment

Judging research by publication outlet

Measuring publication

Ranking journals – impact factor and professional association listings

Citation analysis

Limitations to citations


Chapter 3: Peer review, refereeing and their discontents: a failed model or simply the least worst option?


The development of the refereeing process

The process of review

Valuing peer review

Questions and problems regarding peer review and refereeing

Conclusion: is refereeing a failed model? Or just the least worst option?

Chapter 4: From the Research Assessment Exercise to the Research Excellence Framework: changing assessment models in the United Kingdom?


Research and science in the United Kingdom

The United Kingdom university system

The Research Assessment Exercise

Evolution of the RAE

Process and cost of the RAE

Evaluating the RAE

The Research Excellence Framework


Chapter 5: Perils of peer review in a small country? The Performance Based Research Fund in New Zealand


Higher education policy framework

The Performance Based Research Fund – design and operation

Quality assessment process

PBRF panel process

An evaluation of the PBRF by surveying panel members

Assessing research outputs

Assessing peer esteem

Contribution to research environment

Respondents’ views of what makes an ‘A’ researcher

The process of assessment

Respondents’ view of the PBRF scheme

Assessing the assessors


Evaluating the PBRF

Conclusion: limitations of the PBRF and suggested improvements

Chapter 6: Research evaluation in Japan: the case of the National University Corporations


Research in Japan

The Japanese university system

Research assessment and national universities

Evaluating the performance of the national universities

Implementation and results

Analysis and hypotheses



Chapter 7: Conclusion: Prometheus assessed and lessons for research assessment


Research and university evaluation in the United States

Assessing research – investigating the issues

Peer and panel review

Problems of group decision-making

Disciplinary power, panel review and citation analysis

Bureaucratic control and research assessment

The dichotomy between bibliometric and panel assessment is a false one

Impact, relevance and new directions in research assessment