Document Type : Research Paper

Authors

1 Assistant Professor, Department of Assessment and Measurement, Allameh Tabataba'i University, Tehran, Iran

2 Professor, Department of Assessment and Measurement, Allameh Tabataba'i University, Tehran, Iran

3 ATUAssociate Professor, Department of Assessment and Measurement, Allameh Tabataba'i University, Tehran, Iran

Abstract

In order to increase the precision of measurement, survey studies apply scales for the evaluation of latent features. This study aimed to examine differential item functioning (DIF) of Academic Alienation scale items in students based on the Item Response theory (IRT) framework. DIF analysis is used to test the hypothesis if the item parameters for the different groups of identical ability are invariant. DIF analyses of gender and education duration were performed using a sample of 1100 Psychology and educational sciences students in the city of Tehran. The Academic Alienation items (Burbach, 1972) studied were 4-point Likert-type scales. The questionnaire had three subscales: isolation, meaningless, and powerlessness. Analyses were conducted using the graded item response model with likelihood ratio (IRT-LR) tests of DIF. DIF analyses were conducted with 4 anchor items and after Bonferroni adjustment only 3 items based on gender and 2 items according to education duration were detected with meaningful DIF. The explanation of DIF detection can be discussed based on the cultural context of universities. Sexual inequality, teachers’ attitudes, university management policies, and finally educational injustice may be the reasons for the sense of academic alienation in students.

Keywords

آلن، م. ج.، ین، و. م. (1979). مقدمه‏ای بر نظریه‏های اندازه‏گیری. علی دلاور. (1392). تهران: سمت.
اسلامی هرندی، فاطمه، کریمی، فریبا، و نادی، محمدعلی. (1398). شناسایی مؤلفه‌های عدالت آموزشی در آموزش‌وپرورش ایران. پژوهش در نظام‌های آموزشی ایران، 13(47)، 55-75.
تیلور، ک. س. (2013). روایی و رواسازی. جلیل یونسی (1398). تهران: علامه طباطبایی.
میرزاصفی، اعظم، یعقوبی، ابوالقاسم، محققی، حسین، و کرد نوقابی، رسول. (1399). تدوین مدل ساختاری ناسازگاری تحصیلی بر اساس بی‌عدالتی آموزشی، فرسودگی، فریبکاری تحصیلی وعدم خود کارآمدی دانشجویان. پژوهش در نظام‌های آموزشی ایران، 14(49)، 41-54.
مایر، ج. پ. (2010). پایایی. جلیل یونسی (1398). تهران: علامه طباطبایی.
همتی، رضا، و پیرنیا، زهرا. (1396). تحلیلی بر بیگانگی تحصیلی دانشجویان و عوامل مرتبط با آن. مطالعات و تحقیقات اجتماعی در ایران، 6(1)، 91- 117.
Abdi, H. (2007). Bonferroni and Šidák corrections for multiple comparisons. Encyclopedia of measurement and statistics, 3, 103-107. DOI: 10.4236/cn.2014.62014.
Aloumani, A. C. (2006). Changing the role of women in Iran (Doctoral dissertation, University of Kansas).
American Educational Research Association. American Psychological Association & National Council of Measurement in Education (2014). Standards for educational and psychological testing.
Brown, M. R., Higgins, K., Pierce, T., Hong, E., & Thoma, C. (2003). Secondary students' perceptions of school life with regard to alienation: The effects of disability, gender and race. Learning Disability Quarterly, 26(4), 227-238. https://doi.org/10.2307/1593636.
Burbach, H. J. (1972). An empirical study of powerlessness among high school students. The High School Journal, 55(7), 343-354.
Burbach, H. J. (1972). The development of a contextual measure of alienation. Pacific Sociological Review, 15(2), 225-234.
Çağlar, Ç. (2013). The Relationship between the Levels of Alienation of the Education Faculty Students and Their Attitudes towards the Teaching Profession. Educational Sciences: Theory & Practice, 13(3), 1507–1513. DOI: 10.12738/estp.2013.3.1577.
Coleman, J. C., & Hendry, L. B. (1999). The nature of adolescence. Psychology Press.
Dodeen, H., & Johanson, G. A. (2003). An analysis of sex-related differential item functioning in attitude assessment. Assessment & Evaluation in Higher Education, 28(2), 129-134.
Enders, C. K. (2013). Dealing with missing data in developmental research. Child Development Perspectives, 7(1), 27-31.
Eslami Harandi, F., karimi, F., & Nadi, M. A. (2019). Identifying the Components of Educational Justice in Iran,s Education. Journal of Research in Educational Systems, 13(47), 55-75. doi: 10.22034/jiera.2019.150212.1645 [In Persian].
Flowers, C. P., Oshima, T. C., & Raju, N. S. (1999). A description and demonstration of the polytomous DFITframework. Applied Psychological Measurement, 23, 309–326.
Hemmati, R., & Pirniya, Z. (2017). Analysis of academic alienation among the students and its related factors. Quarterly of Social Studies and Research in Iran, 6(1), 91-117. doi: 10.22059/jisr.2017.61833[In Persian].
Holcomb‐McCoy, C. (2004). Alienation: A Concept for Understanding Low‐Income, Urban Clients. The Journal of Humanistic Counseling, Education and Development, 43(2), 188-196.
Jackson, D. W. (1973). Alienation and identity-role diffusion in late adolescence. The Journal of psychology, 83(2), 251-255.
Kheiltash, O. (2013). The New Majority: A View into the Motivations and Aspirations Of Iran's Women in Higher Education (Doctoral dissertation, UCLA).
Kreiner, S., & Christensen, K. B. (2007). Validity and objectivity in health related summated scales: Analysis by graphical loglinear Rasch models. In M. von Davier & C. H. Carstensen (Eds.), Multivariate and mixture distribution Rasch models. Extensions and applications. New York: Springer Verlag.
Mahmoudi, H., Brown, M. R., Saribagloo, J. A., & Jalilzadeh-Mohammadi, Z. (2018). The effects of sex and race on academic alienation among Iranian students. Educational studies, 44(5), 594-607.
Mann, S. J. (2005). Alienation in the learning environment: a failure of community? Studies in Higher Education, 30(1), 43-55.
mirzasafi, A., Yaghoobi, A., Mohagheghi, H., & kord Noghabi, R. (2020). Developing a Structural Model of Academic Incompatibility Based on Educational Injustice, Burnout, Academic Fraud, and Student Self-Efficacy. Journal of Research in Educational Systems, 14(49), 41-54 [In Persian].
Morinaj, J., Hadjar, A., & Hascher, T. (2020). School alienation and academic achievement in Switzerland and Luxembourg: a longitudinal perspective. Social psychology of education, 1-36.
Paek, I., & Wilson, M. (2011). Formulating the Rasch differential item functioning model under the marginal maximum likelihood estimation context and its comparison with Mantel–Haenszel procedure in short test and small sample conditions. Educational and Psychological Measurement, 71(6), 1023-1046.
Raju, N. S., van der Linden, W. J., & Fleer, P. F. (1995). IRTbased internal measures of differential functioning of items and tests. Applied Psychological Measurement, 19, 353–368.
Rani, A. (2015). A Study of the Problem of Alienation among Adolescents of Sirsa District of Haryanan. Golden Reaserch Thoughts, 4(7), 1–9.
Rayce, S. B., Kreiner, S., Damsgaard, M. T., Nielsen, T., & Holstein, B. E. (2018). Measurement of alienation among adolescents: construct validity of three scales on powerlessness, meaninglessness and social isolation. Journal of patient-reported outcomes, 2(1), 1-12.
Reeve, B. B. (2002). An introduction to modern measurement theory. National Cancer Institute, 1-67.
Safipour, J., Schopflocher, D., Higginbottom, G., & Emami, A. (2011). The mediating role of alienation in self-reported health among Swedish adolescents. Vulnerable Groups & Inclusion, 2(1), 5805.
Schmidt, D. M. K., & Sedlacek, W. E. (1970). Variables Related to University Student Alienation. Research Report No. 13-70.
Seeman, M. (1959). On the meaning of alienation. American sociological review, 783-791.
Seeman, M. (1972). Alienation and engagement. In A. Campbell & P. E. Converse (Eds.), The human meaning of social change. New York: Russel Sage Foundation.
Shavarini, M. K. (2005). The feminisation of Iranian higher education. International review of education, 51(4), 329-347.
Small, S., & Memmo, M. (2004). Contemporary models of youth development and problem prevention: Toward an integration of terms, concepts, and models. Family relations, 53(1), 3-11.
Swaminathan, H., & Rogers, H. J. (1990). Detecting differential item functioning using logistic regression procedures. Journal of Educational Measurement, 27, 361–370.
Teresi, J. A., Ocepek-Welikson, K., Kleinman, M., Eimicke, J. P., Crane, P. K., Jones, R. N., ... & Cella, D. (2009). Analysis of differential item functioning in the depression item bank from the Patient Reported Outcome Measurement Information System (PROMIS): An item response theory approach. Psychology Science.
Thissen, D. (1991). MULTILOGTM User’s Guide. Multiple, categorical item analysis and test scoring using item response theory. Chicago: Scientific Software Inc.
Thissen, D. (2001). IRTLRDIF v2.0b; Software for the computation of the statistics involved in item response theory likelihood- ratio tests for differential item functioning.
Thissen, D., Steinberg, L., & Wainer, H. (1988). Use of item response theory in the study of group differences in trace lines. In H. Wainer & H. I. Braun (Eds.). Test Validity, (pp. 147-170). Hillsdale, NJ: Lawrence Erlbaum Associates, Inc., Publishers.
Thissen, D., Steinberg, L., & Wainer, H. (1993). Detection of differential item functioning using the parameters of item response models. In P. W. Holland, & H. Wainer (Eds.). Differential item functioning, (pp. 130-215). Hillsdale, England: Lawrence Erlbaum Associates, Inc.
Tomé, G., de Matos, M. G., Camacho, I., Simões, C., Gomes, P., & de Almeida, J. C. (2015). Strangers, powerless and hopeless in their own town: Alienation among adolescents in times of recession. Journal of Education, Society and Behavioural Science, 247-255.
Vahedi, Sh., & Nazari, M. A. (2011). The relationship between self-alienation, spiritual well-being, economic situation and satisfaction of life: A structural equation modeling approach. Iranian Journal of Psychiatry and Behavioral Sciences, 5(1), 64-73.
Warner, R. W., & Hansen, J. C. (1970). The relationship between alienation and other demographic variables among high school students. The High School Journal, 54(3), 202-210.
Williamson, I., & Cullingford, C. (1997). The uses and misuses of ‘alienation’ in the social sciences and education. British journal of educational studies, 45(3), 263-275.
Woods, C. M. (2008). Likelihood-ratio DIF testing: Effects of nonnormality. Applied Psychological Measurement, 32(7), 511-526.