ویژگی‏ های روان‌سنجی مقیاس سواد هوش مصنوعی (AILS-CC) در دانشجویان ایرانی

نوع مقاله : مقاله پژوهشی

نویسندگان

1 دانشجوی دکتری، روان‌شناسی تربیتی، گروه روان‌شناسی تربیتی، دانشگاه لرستان، خرم‌آباد، ایران

2 گروه روان‌شناسی تربیتی، دانشگاه لرستان، خرم‌آباد، ایران.

3 دانشجوی دکتری، روان‌شناسی تربیتی، گروه روان‌شناسی تربیتی، دانشگاه لرستان، خرم‌آباد، ایران.

چکیده
همگام با پیشرفت فناوری و محصولات هوش مصنوعی، آمادگی، شناخت و مهارت در این زمینه به یک مسئله‏ی مهم برای کاربران این نوع از فناوری در شاخه‏های مختلف علمی، تجاری، صنعتی و حتی نظامی تبدیل شده است. ازاین‌رو پژوهش حاضر با هدف بررسی ویژگی‏های روان‌سنجی نسخه‏ی فارسی مقیاس سواد هوش مصنوعی ما و چن (2024) بر روی دانشجویان انجام شد. در این پژوهش 250 دانشجوی کارشناسی، کارشناسی ارشد و دکتری از سه دانشگاه قم، لرستان و صنعتی تفرش با استفاده از روش نمونه‏گیری در دسترس انتخاب‌شده و به این مقیاس پاسخ دادند. روایی محتوایی مقیاس با استفاده از روش باز ترجمه، نظر متخصصان تأیید شد. تحلیل عاملی اکتشافی با روش مؤلفه‌های اصلی و چرخش واریماکس، ساختار چهار عاملی (آگاهی، استفاده، ارزیابی و اخلاق) را آشکار ساخت. همچنین، تحلیل عامل تأییدی با استفاده از تحلیل عاملی مرتبه اول و دوم، ساختار سلسله‌مراتبی ابزار را مورد تأیید قرار داد. یافته‏ی مربوط به ضریب آلفای کرونباخ و ضریب پایایی ترکیبی (CR) نیز نشان داد که این مقیاس از همسانی درونی لازم برخوردار است. روایی همگرای این مقیاس با استفاده از روش میانگین واریانس استخراج‌شده (50/0< AVE) و روایی واگرا از طریق شاخص (90/0HTMT<) مورد تأیید قرار گرفت. یافته‌ها نشان‌دهنده‌ی اعتبار و پایایی مناسب نسخه‌ی فارسی مقیاس سواد هوش مصنوعی در بین دانشجویان ایرانی هستند. بر این اساس، این ابزار قابلیت استفاده در پژوهش‌ها و ارزیابی‌های مرتبط با سواد هوش مصنوعی در محیط دانشگاهی را دارد.

کلیدواژه‌ها


عنوان مقاله English

Psychometric Properties of the Artificial Intelligence Literacy Scale (AILS-CC) in Iranian Students

نویسندگان English

Masoud Jafari 1
Ezatolah Ghadampour 2
Shirin Emami Ale Agha 3
Erfan Bahrami 1
1 PhD Candidate, Educational Psychology, Lorestan University, Khorramabad, Iran
2 Department of Educational Psychology, Lorestan University, Khorramabad, Iran
3 PhD Candidate, Educational Psychology, Lorestan University, Khorramabad, Iran
چکیده English

The rapid advancement of artificial intelligence (AI) technologies has made user preparedness, awareness, and competency essential across scientific, commercial, industrial, and military domains. This study examined the psychometric properties of the Persian adaptation of Ma and Chen's (2024) Artificial Intelligence Literacy Scale in a student population. Using convenience sampling, 250 undergraduate, master’s, and doctoral students from Qom University, Lorestan University, and Tafresh University of Technology participated. The scale’s content validity was established through back-translation procedures and expert evaluation. Exploratory factor analysis (EFA), employing the principal component method with varimax rotation, revealed a four-factor structure consisting of awareness, usage, evaluation, and ethics. Furthermore, confirmatory factor analysis (CFA), using both first-order and second-order models, supported the hierarchical organization of the scale. The reliability analysis indicated acceptable internal consistency, as demonstrated by Cronbach's alpha coefficients and composite reliability (CR) indices. Convergent validity was established through the Average Variance Extracted (AVE > 0.50), while discriminant validity was confirmed using the Heterotrait-Monotrait Ratio of Correlations (HTMT < 0.90). Overall, the findings suggest that the Persian version of the Artificial Intelligence Literacy Scale possesses sound psychometric properties and can be effectively utilized in research and academic assessments related to AI literacy among Iranian university students.

کلیدواژه‌ها English

Artificial Intelligence Literacy Scale
Reliability
Exploratory Factor analysis
Confirmatory Factor Analysis
Antonenko, P., & Abramowitz, B. (2022). In-service teachers’ (mis)conceptions of artificial intelligence in K-12 science education. Journal of Research on Technology in Education, 55(1), 64–78. https://doi.org/10.1080/15391523.2022.2119450
Avinç, E., & Doğan, F. (2024). Digital literacy scale: Validity and reliability study with the rasch model. Education and Information Technologies. https://doi.org/10.1007/s10639-024-12662-7
Biagini, G., Cuomo, S., & Ranieri, M. (2023). Developing and Validating a Multidimensional AI Literacy Questionnaire: Operationalizing AI Literacy for Higher Education. AIxEDU@AI IA.
Brownsword, R., & Harel, A. (2019). Law, liberty and technology: criminal justice in the context of smart machines. International Journal of Law in Context, 15(2), 107–125. https://doi.org/10.1017/s1744552319000065
Carolus, A., Augustin, Y., Markus, A., & Wienrich, C. (2022). Digital interaction literacy model – Conceptualizing competencies for literate interactions with voice-based AI systems. Computers and Education Artificial Intelligence, 4, 100114. https://doi.org/10.1016/j.caeai.2022.100114
Carolus, A., Koch, M., Straka, S., Latoschik, M. E., & Wienrich, C. (2023). MAILS -- Meta AI Literacy Scale: Development and Testing of an AI Literacy Questionnaire Based on Well-Founded Competency Models and Psychological Change- and Meta-Competencies. arXiv (Cornell University). https://doi.org/10.48550/arxiv.2302.09319
Cattell, R. B. (1966). The Scree Test for the Number of Factors. Multivariate Behavioral Research, 1(2), 245–276. https://doi.org/10.1207/s15327906mbr0102_10
Çelebi̇, C., Yilmaz, F., Demi̇R, U., & Karakuş, F. (2023). Artificial Intelligence, AI literacy, Digital literacy, AI literacy scale. Öğretim Teknolojisi Ve Hayat Boyu Öğrenme Dergisi - Instructional Technology and Lifelong Learning. https://doi.org/10.52911/itall.1401740
Cetindamar, D., Kitto, K., Wu, M., Zhang, Y., Abedin, B., & Knight, S. (2022). Explicating AI Literacy of Employees at Digital Workplaces. IEEE Transactions on Engineering Management, 71, 810–823. https://doi.org/10.1109/tem.2021.3138503
Chen, Y. K., & Wen, C. R. (2020). Impacts of Attitudes toward Government and Corporations on Public Trust in Artificial Intelligence. Communication Studies, 72(1), 115–131. https://doi.org/10.1080/10510974.2020.1807380
Chiu, T. K. F., Meng, H., Chai, C., King, I., Wong, S., & Yam, Y. (2021). Creation and Evaluation of a Pretertiary Artificial Intelligence (AI) Curriculum. IEEE Transactions on Education, 65(1), 30–39. https://doi.org/10.1109/te.2021.3085878
Chung, M., Kim, J., & Hwang, H. (2021). A Study on Development and Validation of Digital Literacy Measurement Tool. Journal of Internet Computing and Services, 22(4), 51–63. https://doi.org/10.7472/jksii.2021.22.4.51
Davenport, T., Guha, A., Grewal, D., & Bressgott, T. (2019). How artificial intelligence will change the future of marketing. Journal of the Academy of Marketing Science, 48(1), 24–42. https://doi.org/10.1007/s11747-019-00696-0
Eshet-Alkalai, Y., Tel Hai Academic College, & the Open University of Israel. (2004). Digital Literacy: A Conceptual Framework for Survival Skills in the Digital Era. In Jl. Of Educational Multimedia and Hypermedia (Vols. 13–1, pp. 93–106).
Grassini, S. (2023b). Development and validation of the AI attitude scale (AIAS-4): a brief measure of general attitude toward artificial intelligence. Frontiers in Psychology, 14. https://doi.org/10.3389/fpsyg.2023.1191628
Henseler, J., Ringle, C. M., & Sarstedt, M. (2015). A new criterion for assessing discriminant validity in variance-based structural equation modeling. Journal of the Academy of Marketing Science, 43(1), 115–135. https://doi.org/10.1007/s11747-014-0403-8.
Hornberger, M., Bewersdorff, A., & Nerdel, C. (2023). What do university students know about Artificial Intelligence? Development and validation of an AI literacy test. Computers and Education Artificial Intelligence, 5, 100165. https://doi.org/10.1016/j.caeai.2023.100165
Hwang, H., Liu, C., & Cui, Q. (2023). Development and Validation of a Digital Literacy Scale in the Artificial Intelligence Era for College Students. KSII Transactions on Internet and Information Systems, 17(8). https://doi.org/10.3837/tiis.2023.08.016
Jang, M. (2024). AI Literacy and intention to use Text-Based GenAI for learning: The case of business students in Korea. Informatics, 11(3), 54. https://doi.org/10.3390/informatics11030054
Koch, M. J., Carolus, A., Wienrich, C., & Latoschik, M. E. (2024). Meta AI Literacy Scale: Further validation and development of a short version. Heliyon, 10(21), e39686. https://doi.org/10.1016/j.heliyon.2024.e396
Laupichler, M. C., Aster, A., Haverkamp, N., & Raupach, T. (2023). Development of the “Scale for the assessment of non-experts’ AI literacy” – An exploratory factor analysis. Computers in Human Behavior Reports, 12, 100338. https://doi.org/10.1016/j.chbr.2023.100338
Li, Y., Li, Y., Wei, M., & Li, G. (2024). Innovation and challenges of artificial intelligence technology in personalized healthcare. Scientific Reports, 14(1). https://doi.org/10.1038/s41598-024-70073-7
Lindner, A., & Berges, M. (2020). Can you explain AI to me? Teachers’ pre-concepts about Artificial Intelligence. . https://doi.org/10.1109/fie44824.2020.9274136
Long, D., & Magerko, B. (2020). What is AI Literacy? Competencies and Design Considerations. . https://doi.org/10.1145/3313831.3376727
Ma, S., & Chen, Z. (2024). The Development and Validation of the Artificial Intelligence Literacy Scale for Chinese College Students (AILS-CCS). IEEE Access, 1. https://doi.org/10.1109/access.2024.3468378
Marsh, H. W. (1987). The Hierarchical Structure of Self-Concept and the Application of Hierarchical Confirmatory Factor Analysis. Journal of Educational Measurement, 24(1), 17–39. https://doi.org/10.1111/j.1745-3984.1987.tb00259.x
Martínez-Alcalá, C. I., Rosales-Lagarde, A., De Los Ángeles Alonso-Lavernia, M., Ramírez-Salvador, J. Á., Jiménez-Rodríguez, B., Cepeda-Rebollar, R. M., López-Noguerola, J. S., Bautista-Díaz, M. L., & Agis-Juárez, R. A. (2018). Digital Inclusion in Older Adults: A Comparison Between Face-to-Face and Blended Digital Literacy Workshops. Frontiers in ICT, 5. https://doi.org/10.3389/fict.2018.00021
McDermid, J. A., Jia, Y., Porter, Z., & Habli, I. (2021). Artificial intelligence explainability: the technical and ethical dimensions. Philosophical Transactions of the Royal Society a Mathematical Physical and Engineering Sciences, 379(2207), 20200363. https://doi.org/10.1098/rsta.2020.0363
Mertala, P., Fagerlund, J., & Calderon, O. (2022). Finnish 5th and 6th grade students’ pre-instructional conceptions of artificial intelligence (AI) and their implications for AI literacy education. Computers and Education Artificial Intelligence, 3, 100095. https://doi.org/10.1016/j.caeai.2022.100095
Montag, C., Nakov, P., & Ali, R. (2024). On the need to develop nuanced measures assessing attitudes towards AI and AI literacy in representative large-scale samples. AI & Society. https://doi.org/10.1007/s00146-024-01888-1
Ng, D. T. K., Leung, J. K. L., Chu, S. K. W., & Qiao, M. S. (2021). Conceptualizing AI literacy: An exploratory review. Computers and Education Artificial Intelligence, 2, 100041. https://doi.org/10.1016/j.caeai.2021.100041
Norman, D. (2016). The Design of Everyday Things. https://doi.org/10.15358/9783800648108
            Reddy, S., Fox, J., & Purohit, M. P. (2018). Artificial intelligence-enabled healthcare delivery. Journal of the Royal Society of Medicine, 112(1), 22–28. https://doi.org/10.1177/0141076818815510
Rodríguez-García, J. D., Moreno-León, J., Román-González, M., & Robles, G. (2021). Evaluation of an Online Intervention to Teach Artificial Intelligence with LearningML to 10-16-Year-Old Students. . https://doi.org/10.1145/3408877.3432393
Rosemann, A., & Zhang, X. (2021). Exploring the social, ethical, legal, and responsibility dimensions of artificial intelligence for health – a new column in Intelligent Medicine. Intelligent Medicine, 2(2), 103–109. https://doi.org/10.1016/j.imed.2021.12.002
Russell, S., & Norvig, P. (2016). Artificial Intelligence: A Modern Approach, eBook, Global Edition. https://elibrary.pearson.de/book/99.150005/9781292153971
Schepman, A., & Rodway, P. (2022). The General Attitudes towards Artificial Intelligence Scale (GAAIS): Confirmatory Validation and Associations with Personality, Corporate Distrust, and General Trust. International Journal of Human-Computer Interaction, 39(13), 2724–2741. https://doi.org/10.1080/10447318.2022.2085400
Southworth, J., Migliaccio, K., Glover, J., Glover, J., Reed, D., McCarty, C., Brendemuhl, J., & Thomas, A. (2023). Developing a model for AI Across the curriculum: Transforming the higher education landscape via innovation in AI literacy. Computers and Education Artificial Intelligence, 4, 100127. https://doi.org/10.1016/j.caeai.2023.100127
Stahl, B. C., Antoniou, J., Bhalla, N., Brooks, L., Jansen, P., Lindqvist, B., Kirichenko, A., Marchal, S., Rodrigues, R., Santiago, N., Warso, Z., & Wright, D. (2023). A systematic review of artificial intelligence impact assessments. Artificial Intelligence Review, 56(11), 12799–12831. https://doi.org/10.1007/s10462-023-10420-8
Tinmaz, H., Lee, Y., Fanea-Ivanovici, M., & Baber, H. (2022). A systematic review on digital literacy. Smart Learning Environments, 9(1). https://doi.org/10.1186/s40561-022-00204-y
Wang, Y., & Chuang, Y. (2023b). DEVELOPMENT AND VALIDATION OF A SCALE TO MEASURE ARTIFICIAL INTELLIGENCE LITERACY ATTITUDES. INTED Proceedings. https://doi.org/10.21125/inted.2023.1236
Wang, Y., & Wang, Y. (2019). Development and validation of an artificial intelligence anxiety scale: an initial application in predicting motivated learning behavior. Interactive Learning Environments, 30(4), 619–634. https://doi.org/10.1080/10494820.2019.1674887
Xiao, J., Alibakhshi, G., Zamanpour, A., Zarei, M. A., Sherafat, S., & Behzadpoor, S. (2024). How AI literacy affects students’ educational attainment in online learning: Testing a Structural Equation Model in Higher Education context. The International Review of Research in Open and Distributed Learning, 25(3), 179–198. https://doi.org/10.19173/irrodl.v25i3.7720
Zhai, X., Chu, X., Chai, C. S., Jong, M. S. Y., Istenic, A., Spector, M., Liu, J., Yuan, J., & Li, Y. (2021). A Review of Artificial Intelligence (AI) in Education from 2010 to 2020. Complexity, 2021, 1–18. https://doi.org/10.1155/2021/8812542
Zhang, B., & Dafoe, A. (2019). Artificial Intelligence: American Attitudes and Trends. SSRN Electronic Journal. https://doi.org/10.2139/ssrn.3312874