Document Type : Research Paper
Authors
1
PhD Student in Assessment and Measurement, Division of Research and Assessment, Faculty of Psychology and Education, University of Tehran
2
Associate Professor of Educational Assessment,, Division of Research and Assessment, Department of Methods, Educational Planning and Curriculum, Faculty of Psychology and Education, University of Tehran, Tehran, Iran.
10.22054/jem.2026.88601.3652
Abstract
Student performance evaluation is one of the most important mechanisms for ensuring educational quality in universities. However, evaluators' judgments are always exposed to biases and cognitive errors, which can disrupt the accuracy and fairness of the assessment. Despite numerous studies on different types of biases, no comprehensive framework has been established for classifying, managing, and designing tools to measure these biases. This study aims to develop a conceptual framework for designing a tool to identify cognitive biases among faculty members in the student evaluation process. This study employed a qualitative approach, documentary method, and scoping review based on a six-stage protocol. A systematic search of international sources from 1960 to 2025 yielded 207 sources, of which 150 were fully analyzed after final screening. The analysis was conducted with a conceptual approach to identify various types of cognitive biases. The results revealed 50 identifiable cognitive errors, categorized into three sources: individual, organizational, and social, and across three temporal dimensions: short-term, medium-term, and long-term.
Additionally, the process of bias occurrence was mapped in a four-stage model, ranging from motivation to social consolidation. Based on this framework, a tool with six main criteria and 50 items was developed, which can be used as a cognitive checklist to improve the accuracy and fairness of evaluations. This tool helps faculty members identify potential cognitive biases before finalizing grades or announcing assessment results by posing precise questions about various judgment scenarios. The results indicate that employing such a tool in higher education can enhance educational quality and assessment fairness, thereby bolstering students' trust in the educational system. Conversely, if cognitive biases go unaddressed, they will not only be perpetuated in individual judgment but also become entrenched within the institutional culture of higher education.
Keywords