Masoud Geramipour; Maryam Moghadasin; Reyhaneh Rezazadeh
Abstract
Math skills include different content and cognitive processes domains which indicate the complexity of math skill and its latent traits. Until now, Study of these complexities has been done through traditional data analysis or subjective methods. Therefore, present research studied cognitive dimensions ...
Read More
Math skills include different content and cognitive processes domains which indicate the complexity of math skill and its latent traits. Until now, Study of these complexities has been done through traditional data analysis or subjective methods. Therefore, present research studied cognitive dimensions and latent variables of the math test of national university entrance examination through the application of Latent Class Multidimensional Item Response Theory (LCMIRT). In doing so, the math test data of national examinations in 2008, 2011 and 2015 were studied. Results showed that the math test, as a high stakes test in the national university entrance examination, encompasses a set of multidimensional cognitive traits. Results of the unified parallel analysis method showed that the tests do not fit with the unidimensional model and adding additional dimensions can significantly improve model fit. Moreover, cognitive domains of comprehension, problem solving and reasoning were recognized as three essential constructs which account for math skills and give more detailed information about items quality in clustering and analysis of the test items. This property of LCMIRT, in comparison with other approaches, increases the number of cognitive sub-clusters. At last, it is recommended that LCMIRT models are considered in constructing and analyzing educational and psychological tests, in order to more validly detect latent cognitive skills of the tests.
asghar minaei; Ali Delavar; Mohammad Reza Falsafinezhad; Ali Reza Kiamanesh; Yahya mohajer
Volume 4, Issue 16 , July 2014, , Pages 138-170
Abstract
Studies of internationalmathematics achievement such as the Trends in Mathematicsand Science Study (TIMSS) have employed classical test theory and item responsetheory to rank individuals within a latent ability continuum. Although these approacheshave provided insights into comparisons between countries, ...
Read More
Studies of internationalmathematics achievement such as the Trends in Mathematicsand Science Study (TIMSS) have employed classical test theory and item responsetheory to rank individuals within a latent ability continuum. Although these approacheshave provided insights into comparisons between countries, they have yet toexamine howspecific attributemastery affects student performance and howthey canprovide information for curricular instruction. In the 2007 administration of TIMSS,two benchmark participants—Massachusetts andMinnesota—were tested followingthe same procedural methods, providing an opportunity for comparison within andacross the United States. Overall comparison of their performance showed Massachusettsand Minnesota to significantly outperform the United States. However,this article shows that there is a greater wealth of fine-grained information that canbe translated directly for classroom application at the attribute level when a cognitivediagnostic model (CDM) such as the deterministic, inputs, noisy, “and” gate (Junker& Sijtsma, 2001) model is used. Results showed a significant disparity betweenproportions of correctly answering and mastering skills required to solve an item.Advantages ofCDMsare discussed aswell as a CDM-basedmethod to filter distractorresponse categories that can aid instructors to diagnose a student’s attribute mastery.
