Related Experiment Video
Updated: Aug 11, 2025

Involving Individuals with Developmental Language Disorder and Their Parents/Carers in Research Priority Setting
Published on: June 6, 2020
Let's agree to agree: The situational academic quality of the UK REF as consensual public knowledge
Sveta Milyaeva1, Daniel Neyland1
1Bristol University, Bristol, UK.
Abstract:
The Research Excellence Framework (REF) is a UK policy tool for distributing government funding and an important indicator of the academic status of a UK university. The legitimacy of the policy comes from peers' consensus on what academic quality is. We are interested in how the REF enables this funding distribution by determining the academic quality of a broad array of different forms of research through a single peer-review process. As they search for academic quality that is contingent to a specific epistemology and requires more time than the REF allows, how do academics agree to agree, and within constraints of a given timeframe? Interviews with REF panellists and their accounts of the process lead us to suggest that the consensus is enacted by setting up a situation: the mechanics of the REF with its practices of benchmarking, scoring, calibrating, and normalizing. This situation sets the boundaries of reviewing and, in doing so, propels peers to shift from assessment contingent on epistemic commitments to evaluation on a single scale. We argue that this shift renders academic quality distinct from scientific or epistemic quality.
More Related Videos
08:33A Cross-Disciplinary and Multi-Modal Experimental Design for Studying Near-Real-Time Authentic Examination Experiences
Published on: September 4, 2019
12:55Multimodal Protocol for Assessing Metacognition and Self-Regulation in Adults with Learning Difficulties
Published on: September 27, 2020
Related Concept Videos
Social Proof
Social Facilitation
Self-Evaluation: Self-Enhancement and Self-Verification
The Sense of Self: Reflected Self-Appraisal and Social Comparison
Critical Region, Critical Values and Significance Level
In hypothesis testing, a sample statistic is converted to a test statistic using z, t, or chi-square distribution. A critical region is an area under the curve in probability distributions demarcated by the critical value. When the test statistic falls in this region, it suggests that the null hypothesis must be rejected. As this region contains all those values of the...
Ethics in Research