Ali Baniasadi; Keyvan Salehi; Ebrahim Khodaie; Khosro Bagheri; Balal Izanloo
Abstract
The present study aimed to investigate the psychometric properties of fair classroom assessment Rubric based on Item-Response theory. For this purpose, a sample of 511 students of the University of Tehran was selected by the available sampling method and answered Rubric questions. At this stage, to determine ...
Read More
The present study aimed to investigate the psychometric properties of fair classroom assessment Rubric based on Item-Response theory. For this purpose, a sample of 511 students of the University of Tehran was selected by the available sampling method and answered Rubric questions. At this stage, to determine the application of unidimensional or multidimensional models, DETECT and parallel analysis methods were used. The results of both methods rejected the unidimensionality of the data and the results of the parallel analysis showed the extraction of three factors from the data. Also, the comparison of unidimensional and multidimensional model fit indices including log-likelihood, likelihood ratio, Root Mean Square Error of Approximation and comparison of Bayesian and Akaike information criteria confirmed the better fit of the multidimensional model for the data. Thus, due to the polytomous of the answers to the questions, the multidimensional graded response model was used to estimate the parameters of the questions. The reliability of each of the subscales of procedural fairness, nature of assessment and interactional fairness were 0.85, 0.69 and 0.63, respectively. Estimation of the discrimination parameters ranged from 1.048 to 5.802, which showed that all the questions performed well in the discrimination of the upper and lower levels of the fair classroom assessment, and after controlling the false discovery rate, the S-X2 statistic showed a good fit of all Rubric questions. In general, the results of this study show that the developed Rubric has appropriate psychometric properties to evaluate the quality of fairness in the classroom assessment.
Masoomeh Estaji
Abstract
Classroom assessment, as the complementary part of the language learning process, is a powerful decision-making instrument. Nonetheless, more research is required regarding the ways teachers cope with these requirements, and how they affect their pedagogical practices. This study is an attempt to examine ...
Read More
Classroom assessment, as the complementary part of the language learning process, is a powerful decision-making instrument. Nonetheless, more research is required regarding the ways teachers cope with these requirements, and how they affect their pedagogical practices. This study is an attempt to examine EFL teachers’ perceptions of assessment literacy and the criteria they consider to assess their students. Moreover, it examines whether graduate and undergraduate teachers differ in terms of their assessment literacy. To this end, by using a survey and Ex-Post Facto research design and through a two-part questionnaire on assessment literacy (adapted from Plake, 1993; Plake, Impara, & Fager, 1993), a comparison was made between undergraduate (N=22) and graduate teachers (N=10) of English as a Foreign Language (EFL), English Literature, Translation studies, and Linguistics selected through purposive sampling on their perceptions of assessment literacy. The research results revealed a statistically significant difference between undergraduate and graduate teachers’ perceptions of assessment literacy. Results also showed that graduate teachers had higher perceptions of assessment literacy than their undergraduate counterparts, representing the effect of their level of education and educational background. Thus, this study highlights the significance of giving sufficient and proper training to all soon-to-be language teachers on language assessment, argues for the need, suggests ways by which teachers can become more literate in the domain of language assessment, and presents ways teacher educators and language testing experts can assist in this path.