Document Type : Research Paper

Authors

1 : Associate Professor , Assessment & Measurment Department,psychology & Education Faculty, Allame tabatabaei University. Tehran,Iran

2 Education department. pardis bentolhoda Faculty, Farhangiyan University. Tehran,Iran

3 Assistant Professor, Assessment & Measurment Department,psychology & Education Faculty, Allame tabatabaei University. Tehran,Iran

4 Professor, Department of Emergency Medicine, Department of Medical Education, School of Medicine, Tehran University of Medical Sciences, Tehran, Iran

Abstract

The Item Response Theory (IRT) has been extensively used in the development of tools in recent years. The present study aimed at determining the standard and cut score of the medical basic sciences comprehensive test using the IRT model, the item map method. The statistical population in this study was all the candidates for the medical basic sciences comprehensive test of the tenth pole of Iran (n=324), and the responses of all candidates were analyzed to determine the standard and cut score. The tool used in this research was the basic science comprehensive test with 200 four-option items that was taken in September of 2016. In this cross-sectional study, Winsteps was used to analyze the items. The findings of this study showed that the test has an item reliability of PR=0.98 and an person reliability of IP=0.92 which indicated that the sample variance and test length were appropriate and the items were appropriately selected from the nine domains. Performance of the reviewers’ panel and evaluation of the items with the item map method showed that the agreement of the reviewers after three review stages included a difficulty parameter of b=1.3 and a raw score of 103. The result of this research showed that the item map method can result in higher agreement among reviewers to determine the cut score

Keywords