نوع مقاله : مقاله پژوهشی
نویسندگان
1 دانشجوی دانشگاه علامه طباطبایی
2 هیئت علمی دانشگاه علامه طباطبایی
چکیده
زمینه: اگر چه روش های متعددی جهت شناسایی سوالات سودار معرفی شده است اما تحقیقات اندکی به صورت تجربی قدرت و کارایی هر یک این روش ها را مورد بررسی قرار داده است. هدف: هدف از تحقیق حاضر مقایسه آزمون نسبت درستنمایی مبتنی بر مدل پرسش – پاسخ و روش تحلیل عاملی تاییدی در شناسایی کنش افتراقی سوالات آزمون های سرنوشت ساز بود. روش: برای پاسخگویی به سوالات تحقیق از روش مطالعات شبیه سازی مونت کارلو استفاده شد. یافته ها: تجزیه و تحلیل داده ها در تکرار های متوالی نشان داد که روش های مبتنی بر IRT در شناسایی DIF نسبت به روش های CFA برتری دارند. این برتری در تمامی شرایط DIF مشاهده شد. با این همه تفاوت دو روش در حجمهای نمونه 1000 نفری، جزئی و قابل اغماض است. همچنین میان دو روش از نظر شناسایی نوع DIF تفاوتی دیده نشد.
کلیدواژه‌ها
عنوان مقاله [English]
Comparison of Confirmatory Factor Analysis (CFA) and Item Response Theory (IRT)-Based Likelihood Ratio in Detecting Differential Item Functioning at High Stakes Tests
نویسندگان [English]
- masoud gerami pour 1
- mohamad reza falsafi nejhad 2
- ali delavar 2
- nour ali farrokhi 2
چکیده [English]
Although numerous methods have been proposed for detecting biased items, but a few researches have empirically investigated the power and efficiency of these methods. The main goai of this research was to apply IRT-based likelihood ratio test and confirmatory factor analysis in detecting differential item functioning (DIF) in high stakes tests. Monte Carlo simulated methods were used to answer the research questions. Required data were simulated through WINGEN2 in the form of 100 tests with 30 items that were fitted to 2PL model. Distributions of item difficulties and discrimination powers of all the tests were normal. Responses of 1000 examinees were also simulated with normal ability distribution for each test. Estimation methods of marginal maximum likelihood and weighted least squares were used to detect type and magnitudes of DIF. Data analysis in consecutive replications showed that IRT based methods were superior to CFA methods in detecting DIF. This superiority was observed in ail DIF conditions (low, moderate and high). After all. differences between two methods were small at 1000 sample sizes. No differences were observed between two methods in detecting different types of DIF. Results of this study confirm the results of Meade and Lautenschlager (2004; 2006), but is in contrast with the results of Flowers et al (2002). Finally, Likelihood Ratio test is recommended if there is any limitation in applying methods of detecting DIF.
کلیدواژه‌ها [English]
- differential item functioning
- Likelihood Ratio Test. Confirmatory Factor Analysis. High Stakes Tests
)