Document Type : Research Paper

Authors

1 Department of Psychology, Faculty of Education and Psychology, Shahid Beheshti University, Tehran, Iran.

2 PhD Student, Department of Psychology, Faculty of Education and Psychology, Shahid Beheshti University, Tehran, Iran

3 Social and Crime Prevention Directorate Judiciary, Tehran, Iran.

4 Department of Communication Studies, Faculty of Communication Sciences, Allameh Tabataba'i University, Tehran, Iran.

5 Office of Educational Sciences and Counseling, Ministry of Education, Tehran, Iran.

6 . PhD Student, Faculty of Education and Psychology, Azaad University, Qom, Iran.

7 Assistant Professor, Department of Preschool Education, University of Social Welfare and Rehabilitation Sciences, Tehran, Iran.

Abstract

Due to the importance of identifying changes in students' mental health and the need for screening using accurate and valid tools appropriate to the ecological characteristics of Iranian society, the researchers decided to develop a short-scale electronic version of psychological health problems - teacher form for junior high school students. The statistical population of this study consists of junior high school students in 31 provinces of the country. In each province, two cities were selected by purposive sampling method and in each city, two schools were selected by simple random method and all junior high school students entered the sample group The sample consisted of 11,484 students (6,403 girls and 5,081 boys). Item analysis indicated appropriate psychometric properties for most items. The results of confirmatory factor analysis also showed that the eight-component model with forty items based on experts' views shows the best fit with the data. The standard path coefficients of the items were obtained between 0.34 and 0.87, which indicates the appropriate divergent validity and also the average variance extracted (between 0.46 and 0.73) of the items also indicates their convergent validity. The validity of the subscales was also optimally obtained based on the combined validity coefficient (between 0.83 and 0.93) and Cronbach's alpha (between 0.80 and 0.93). In other words, the short scale has the necessary internal coherence. The correlation between the components and with the total score was in the acceptable range. Comparing the factor structure of the girl and boy groups indicates a suitable and equivalent fit for both groups. Therefore, it can be concluded that psychometric properties indicate the appropriateness of the short form of the Mental Health Questionnaire for use in the screening process in the first grade high school students in Iran.

Keywords

اکبری زردخانه، سعید؛ آل بویه، مریم؛ زنگانه، علی­ محمد؛ منصورکیایی، نادر؛ جلالت دانش، محسن؛ مهدوی، مجتبی. (1396). نسخه گزارش والدین مقیاس سلامت روان شناختی کودکان: مطالعه مقدماتی ساخت و بررسی ویژگی های روان سنجی. فصلنامه سلامت روان کودک،  دوره 4، ش 4، 165-152.
اکبری زردخانه، سعید؛ شاهورانی، سیدمحمد؛ منصورکیایی، نادر؛ زنگانه، علی محمد؛ جلالت دانش، محسن؛ طهماسبی گرمتانی، سیامک؛ زارعیان، مسعود. (1397). ویژگی‌های روان‌سنجی نسخه الکترونیکی ابزار سلامت روان‌شناختی دانش‌آموزان دوره متوسطه یکم: فرم گزارش معلم و والدین. مجله روانپزشکی و روان‌شناسی بالینی ایران، دوره 24، ش 3، 339-324.
بشرپور، سجاد؛ طاهری­فردی، مینا؛ محمدی، گلاویژ. (1398). ویژگی­های روان­سنجی نسخه فارسی فرم کوتاه پرسش­نامه شخصیتی هگزاکو- 24 سؤالی در دانشجویان. فصلنامه اندازه­گیری تربیتی، 9 (36)، 89-65.
پرپنجی، معصومه؛ دلاور، علی؛ فرخی، نورعلی. (1398). نقش سلامت روان در رفتارهای خلاقانه دانش آموزان شهر تهران. ابتکار و خلاقیت در علوم انسانی، 8(4)، 153-170.
لومکس، ریچارد جی و شوماخر، رندال ای (1388). مقدمه­ای بر مدل­سازی معادله ساختاری با کاربرد برنامه­های AMOD، LISREL و EQS.. ترجمه وحید قاسمی. تهران: انتشارات جامعه­شناسان.
محبی، سمیه؛ شکری، امید؛ خدایی، علی. (1399). تحلیل روان­سنجی نسخه کوتاه سیاهه مقابله با موقعیت­های استرس­زا در دانشجویان. فصلنامه اندازه­گیری تربیتی، 10(40)، 113-87.
Andrade, C. (2018). Internal, External, and Ecological Validity in Research Design, Conduct, and Evaluation. Indian Journal of Psychological Medicine. 40(5): 498-499.
Bastos, J. L., Celeste, R. K., Faerstein, E., & Barros, A. J.D. (2010). Racial discrimination and health: A systematic review of scales with a focus on their psychometric properties. Social Science & Medicine. 70, 1091–1099.
Beebe, T. J., Rey, E., Ziegenfuss, J. Y., Jenkins, S., Lackore, K., Talley, N. J., & Locke, R. G. III. (2010). Shortening a survey and using alternative forms of prenotification: Impact on response rate and quality. BMC Medical Research Methodology, 10, 1-9.
Boateng, G. O., Neilands, T. B., Frongillo, E.A., Melgar-Quiñonez, H. R., & Young, S. L. (2018). Best Practices for Developing and Validating Scales for Health, Social, and Behavioral Research: A Primer. Frontiers in Public Health. 6, 149-167.
Brosnan, K., Grün, B., & Dolnicar, S. (2018). Identifying superfluous survey items. Journal of Retailing and Consumer Services. 43, 39-45
Bryman, A. (2015). Social research methods. Oxford: Oxford University Press.
Chen, F. F. (2007). Sensitivity of goodness of fit indexes to lack of measurement invariance. Structural Equation Modeling: A Multidisciplinary Journal. 14, 4654-504.
Cheung, G. W., and Rensvold, R. B. (2002). Evaluating goodness-of-fit indexes for testing measurement invariance. Structural Equation Modeling: A Multidisciplinary Journal. 9, 233–255.
Chien, C-W., Brown, T., MCDonald, R., & Rodger, S. (2011). Convergent and Discriminant Validity of a Naturalistic Observational Assessment of Children’s Hand Skills. Hong Kong Journal of Occupational Therapy, 21, 64-71.
Das, J. K., Salam, R. A., Lassi, Z. S., Khan, M. N., Mahmood, W., Patel, V., & Bhutta, Z. A. (2016). Interventions for Adolescent Mental Health: An Overview of Systematic Reviews. THE JOURNAL OF ADOLESCENT HEALTH. 59(4), 49-60.
Drost, EA. (2011). Validity and Reliability in Social Science Research. Education Research & Perspectives, 38(1): 105123
Eccles, J. S. (1999). The Development of Children Ages 6 to 14. THE FUTURE OF CHILDREN, 30-44.
Fink, E., Patalay, P., Sharp, H., Holley, S., Deighton, J., & Wolpert, M. (2015). Mental Health Difficulties in Early Adolescence: A Comparison of Two Cross-Sectional Studies in England from 2009 to 2014. Journal of Adolescent Health, 56, 502-507.
Fornell, C., Larcker, D. F. (1981). Evaluating structural equation models with unobservable variables and measurement error. Jurnal of marketing research, 39-50.
Furlong, M. J., Fullchange, A., & Dowdy, E. (2016). Effects of mischievous responding on universal mental health screening: I love rum raisin ice cream, I really do! School Psychology Quarterly. 32 (3): 320-335.
Galesic, M., & Bosnjak, M. (2009). Effects of questionnaire length on participation and indicators of response quality in a web survey. Public Opinion Quarterly, 73, 349–360.
Gulliksen, H. (1950). Theory of mental tests. New York: Wiley.
Hambleton, R. K. (1989). Principles and selected applications of item response theory. In R. L. Linn (Ed.), Educational measurement (3rd ed., pp. 147–200). Washington, DC: American Council on Education.
Herzog, A. R., & Bachman, J. G. (1981). Effects of questionnaire length on response quality. Public Opinion Quarterly, 45, 549–559.
Hill LG, Coie JD, Lochman JE, Greenberg MT. (2004). Effectiveness of early screening for externalizing problems: Issues of screening accuracy and utility. Journal of Consulting and Clinical Psychology. 72(5):809-20
Hunter, L. (2012). Challenging the reported disadvantages of e-questionnaires and addressing methodological issues of online data collection, Nurse Researcher. 20(1): 11-20.
Kline, R. B. (2005). Principles and practices of structural equation modeling (2nd ed.). New York: Guilford Press.
Knekta, E., Runyon, C., & Eddy, S. (2019). One Size Doesn’t Fit All: Using Factor Analysis to Gather Validity Evidence When Using Surveys in Your Research. CBE—Life Sciences Education. 18. 1-17.
Livingston, S. A., & Dorans, N. J. (2004). A graphical approach to item analysis (Research Report No. RR-04-10). Princeton: ducational Testing Service.
Lord, F. M., & Novick, M. R. (1968). Statistical theories of mental test scores. Reading: Addison-Wesley.
Maloney, P., Grawitch, M.J., & Barber, L.K. (2011). Strategic item selection to reduce survey length: Reduction in validity? Consulting Psychology Journal: Practice and Research, 63. 162-175.
McCoy S, Marks P. (2001). Using electronic surveys to collect data: Experiences from the field. The Americas Conference on Information Systems. 2-5.
Mitchell, M.L., & Jolley, J.M. (2004). Research design explained. 5th edition. Victoria: Wadsworth Publisher.
Moharreri, F., Habrani, P., & Heidari Vazdi, A. (2015). Epidemiological Survey of Psychiatric Disorders in Children and Adolescents of Mashhad in 2009. Journal of Fundamentals of Mental Health, 247-253.
Mokkink, LB., Terwee CB., Patrick DL., Alonso J., Stratford PW., Knol DL., Stratford, P. W., Konel, D. L., Bouter, L. M., & Vet. H. C. W. (2010) The COSMIN study reached international consensus on taxonomy, terminology, and definitions of measurement properties for health-related patient-reported outcomes. Journal of Clinical Epidemiology. 63. 737-45
Moses, T. (2017). A review of developments and applications in item analysis. Advancing Human Assessment, 19-46
Moses, T., Miao, J., & Dorans, N. J. (2010). A comparison of strategies for estimating conditional DIF. Journal of Educational and Behavioral Statistics, 6, 726–743.
Moyer VA, Calonge N, Teutsch SM, Botkin JR. Expanding newborn screening: process, policy, and priorities. Hastings Center Report.  38(3). 32-9.
Patel V, Flisher AJ, Nikapota A, Malhotra S. (2008). Promoting child and adolescent mental health in low and middle income countries. The Journal of Child Psychology and Psychiatry. 49(3):313-34.
Patel V. (2001). Cultural factors and international epidemiology Depression and public health. British Medical Bulletin.57(1):33-45.
Pearson, R. H. (2008). Recommended sample size for conducting exploratory factor analysis on dichotomous data. Colo Herit.
Petscher, Y., & Pfeiffer, S. I. (2019). Reconsidering the Psychometrics of the GRS-S: Evidence for Parsimony in Measurement. Assessment for Effective Intervention. 153450841882474.
Reneman, MF., Dijkstra, A., Geertzen, JH., & Dijkstra, PU. (2010). Psychometric properties of chronic           pain acceptance questionnaires: a systematic review. European Journal of Pain, (14). 457-465.
Robinson, M. A. (2018). Using multi-item psychometric scales for research and practice in human resource management. Hum Resour Manage. 57:739–750.
Rouquette, A., Nadot, T., Labitrie, P., Van den Broucke, S., Mancini, J., Rigal, L., et al. (2018). Validity and measurement invariance across sex, age, and education level of the French short versions of the European Health Literacy Survey Questionnaire. PLoS ONE 13(12): e0208091.
Rudnev, M., Vauclair, C-M., Aminihajibashi, S., Becker, M., Bilewicz, M., Castellanos Guevara, JL., et al. (2020). Measurement invariance of the moral vitalism scale across 28 cultural groups. PLoS ONE 15(6): e0233989
Satcher, D. (2004). Organizational Principles to Guide and Define the Child Health Care System and/or Improve the Health of All Children. American academy of pediatrics, 113, 1839-1835.
Sivadas, E., Bruvold, N. T., & Nelson, M. R. (2007). A reduced version of the horizontal and vertical individualism and collectivism scale: A four-country assessment. Journal of Business Research, 61, 201-210.
Stanton, J. M., Sinar, E. F., Balzer, W. K., & Smith, P. C. (2002). Issues and strategies for reducing the length of self-report scales. Personnel Psychology, 55, 167-193.
Stanton, J. M., Sinar, E. F., Balzer, W. K., Julian, A. L., Thoresen, P., Aziz, S., . . . Smith, P. C. (2002). Development of a compact measure of job satisfaction: The abridged job descriptive index. Educational and Psychological Measurement, 62, 173–191.
Stiffler, M. C., & Dever, B. V. (2015). Mental Health Screening at School: Instrumentation, Implementation, and Critical Issues. Springer International Publishing Switzerland, 91-105.
Tylka, T. L., & Wood-Barcalow, N. L. (2015). The Body Appreciation Scale-2: Item refinement and psychometric evaluation. Body Image, 12, 53-67.
Tyson, E. H. (2004). Ethnic Differences Using Behavior Rating Scales to Assess the Mental Health of Children: A Conceptual and Psychometric Critique. Child Psychiatry and Human Development, 34(3), 167-201.
Urdan, T., & Klein, S. (1998). Early Adolescence: A Review of the Literature. The Conference on Early Adolescence: The U.S. Department of Education Office of Educational Research and Improvement, Washington, D.C.
Wainer, H. (1989). The future of item analysis. Journal of Educational Measurement, 26(2), 191-208.
Yammarino, F. J., Skinner, S. J., & Childers, T. L. (1991). Understanding mail survey response behavior: A meta-analysis. Public Opinion Quarterly, 55, 613-639.
Zait, A., & Bertea, PSPE. (2011). Methods for testing discriminant validity. Management & marketing Journal. (9) 217-224.