saeid kiani; Parvin Kadivar; Hadi Keramati; Masoud gramipour
Abstract
One of the factors that can be the link between our intentions and actions and their external consequences is human agency, which indicates the conscious design and intentional execution of actions by the individual in order to influence future events.Objective and Method: This research with a developmental ...
Read More
One of the factors that can be the link between our intentions and actions and their external consequences is human agency, which indicates the conscious design and intentional execution of actions by the individual in order to influence future events.Objective and Method: This research with a developmental approach of psychometric method and method 1, examines the psychometric indices of the Human Factor Characteristics Scale using the classical theory of test score measurement and the graduated question-answer theory. The purpose of this study, which included high school students in Tehran, was selected by cluster sampling of 500 people as a sample size and statistical analysis was performed on 481 data. To collect the data, the ion Human Agent Characteristics Scale (2011) was used and the research questions were evaluated using IRTPRO and SPSS software.Results:The assumption of local independence based on Pearson x2 index was established by applying Simjima's calibrated question-answer theory and the assumption of being one-dimensional based on the analysis of multidimensional question-answer theory. Diagnosis parameters with question-answer approach and classical approach Test score Both item 25 approach had the lowest and item 2 had the highest diagnosis parameter. The answer thresholds for all the questions were so far apart that no option was covered by the other option, and the options were independently selected by individuals at intervals of theta. The total scale was calculated with Cronbach's alpha of 0.945, intentionality of 0.894, foresight of 0.780, self-reactivity of 0.871 and rethinking of 0.762. Also, the role of each item in internal consistency was investigated by the loop method, which all questions had a favorable role in internal consistency of this scale. The value of the validity coefficient obtained from the question-answer theory was obtained by marginal method for intentionality 0.92, forethought 0.85, self-reaction 0.91, rethinking 0.83..
Masoud Geramipour; Maryam Moghadasin; Reyhaneh Rezazadeh
Abstract
Math skills include different content and cognitive processes domains which indicate the complexity of math skill and its latent traits. Until now, Study of these complexities has been done through traditional data analysis or subjective methods. Therefore, present research studied cognitive dimensions ...
Read More
Math skills include different content and cognitive processes domains which indicate the complexity of math skill and its latent traits. Until now, Study of these complexities has been done through traditional data analysis or subjective methods. Therefore, present research studied cognitive dimensions and latent variables of the math test of national university entrance examination through the application of Latent Class Multidimensional Item Response Theory (LCMIRT). In doing so, the math test data of national examinations in 2008, 2011 and 2015 were studied. Results showed that the math test, as a high stakes test in the national university entrance examination, encompasses a set of multidimensional cognitive traits. Results of the unified parallel analysis method showed that the tests do not fit with the unidimensional model and adding additional dimensions can significantly improve model fit. Moreover, cognitive domains of comprehension, problem solving and reasoning were recognized as three essential constructs which account for math skills and give more detailed information about items quality in clustering and analysis of the test items. This property of LCMIRT, in comparison with other approaches, increases the number of cognitive sub-clusters. At last, it is recommended that LCMIRT models are considered in constructing and analyzing educational and psychological tests, in order to more validly detect latent cognitive skills of the tests.
Abstract
According to many experts, entrance examination is the most important test in Iran and demographic characteristics such as gender, region (socio-economic status) and province (language) can affect the performance of participants’ responses to the test items. Controlling for the ability of examinees, ...
Read More
According to many experts, entrance examination is the most important test in Iran and demographic characteristics such as gender, region (socio-economic status) and province (language) can affect the performance of participants’ responses to the test items. Controlling for the ability of examinees, if the answers to the test items are the function of demographic characteristics, the test items have Differential Item Functioning (DIF) toward them. The purpose of this investigation is to study Differential Item Functioning of the test items of Entrance Examinations of National Organization of Educational Testing across the demographic characteristics. The research sample consisted of all examinees of a test booklet which included some special exams of the experimental groups of Konkur from 2008 to 2011. Binary logisitic regression was used in order to analyzing DIF. After assuring unidimensionality through NOHARM approach, DIF analysis results indicated that the most number of detected DIF items were related to gender, region (socio-economic status) and province (language) variables respectively, but effect sizes were very small and negligible. Nevertheless, based on current research results, it is recommended that subject matter committees are formed to detect biased items based on final decisions of the committees and will be considered in designing test items in future.
masoud gerami pour; mohamad reza falsafi nejhad; ali delavar; nour ali farrokhi
Volume 3, Issue 9 , October 2012, , Pages 105-122
Abstract
Although numerous methods have been proposed for detecting biased items, but a few researches have empirically investigated the power and efficiency of these methods. The main goai of this research was to apply IRT-based likelihood ratio test and confirmatory factor analysis in detecting differential ...
Read More
Although numerous methods have been proposed for detecting biased items, but a few researches have empirically investigated the power and efficiency of these methods. The main goai of this research was to apply IRT-based likelihood ratio test and confirmatory factor analysis in detecting differential item functioning (DIF) in high stakes tests. Monte Carlo simulated methods were used to answer the research questions. Required data were simulated through WINGEN2 in the form of 100 tests with 30 items that were fitted to 2PL model. Distributions of item difficulties and discrimination powers of all the tests were normal. Responses of 1000 examinees were also simulated with normal ability distribution for each test. Estimation methods of marginal maximum likelihood and weighted least squares were used to detect type and magnitudes of DIF. Data analysis in consecutive replications showed that IRT based methods were superior to CFA methods in detecting DIF. This superiority was observed in ail DIF conditions (low, moderate and high). After all. differences between two methods were small at 1000 sample sizes. No differences were observed between two methods in detecting different types of DIF. Results of this study confirm the results of Meade and Lautenschlager (2004; 2006), but is in contrast with the results of Flowers et al (2002). Finally, Likelihood Ratio test is recommended if there is any limitation in applying methods of detecting DIF.
