Quarterly of Educational Measurement

Abstract The present study aimed to develop and validate a wisdom-based educational package and to determine its effectiveness on students’ psychological capital. This research was conducted using a quasi-experimental design (pretest–posttest with experimental and control groups) alongside an educational package development and validation approach. The statistical population in the quantitative phase consisted of students from the Faculty of Psychology and Educational Sciences at Allameh Tabataba’i University during the 2024–2025 academic year. A sample was selected through convenience sampling and then randomly assigned to experimental and control groups. In the first phase, the wisdom-based educational package was developed based on theoretical foundations and previous studies, and its content validity was examined and confirmed using content validity indices (CVR and CVI) and expert judgments from specialists in psychology and educational sciences. In the second phase, the experimental group participated in eight sessions of the wisdom-based educational package, while the control group received no intervention. Data were collected using the Psychological Capital Questionnaire, which was administered at the pretest and posttest stages. Data were analyzed using descriptive statistics and analysis of covariance (ANCOVA) via SPSS version 26. The findings indicated that the wisdom-based educational package demonstrated satisfactory content validity. Moreover, the results showed that after controlling for pretest effects, the mean scores of psychological capital in the experimental group were significantly higher than those in the control group. Overall, the results support the validity and effectiveness of the wisdom-based educational package and emphasize its applicability in educational programs and university-based psychological interventions aimed at enhancing students’ psychological capital.

Abstract Response time has always been a concern in ability measurement, sometimes implicitly as in time-limit tests, sometimes explicitly as in speeded tests, and sometimes as the main outcome variable. Therefore, this study seeks to investigate the application of response time model in measuring cognitive ability of the children's quantitative reasoning. To this end, a sample of 502 children from different areas of Tehran was recruited through Cluster sampling and evaluated with a quantitative reasoning test. To analyze the collected data, modeling response time with the hierarchical model was used. Item and person parameters were also estimated and interpreted. The modeling results revealed that in addition to the response correctness parameters, response time parameters including discrimination coefficient, difficulty coefficient and gamma also been estimated. Moreover, the estimated parameters of the response time model compared with the 2-pl IRT model in order to identify their main similarities and differences. Findings revealed that there are some differences in discrimination coefficients and Thetas of individuals, which indicates the power of the response time model. It is worth mentioning that the lowest differences were observed in the difficulty coefficients. Finally, based on the number of parameters, increasing the variance of theta scores, and research background support, the study and application of response time models in measuring children's cognitive abilities were suggested.

Abstract The purpose of this research was to standardize the scale of emotional and social skills of teachers based on the model of positive psychology. The present research was conducted using a mixed research method. In the qualitative phase, a semi-structured interview was conducted with 18 experts and experts in the field of psychological and social competencies of teachers based on the model of positive psychology. The obtained data were analyzed using grounded theory method. 3 dimensions and eighteen components were the result. Based on the findings of the first part of the research, the scale was designed and tested. The quantitative stage consisted of the preparation of the pre-preliminary version and the preliminary version and the standardization stage of the scale. For this purpose, 234 items were written in the construction phase, and at the end of this phase, a preliminary scale with 126 items was prepared. In the standardization stage, the final version was prepared based on the data of a sample group consisting of 357 teachers and with 72 items. In addition, scales of psychological capital, job-related emotional well-being and reflective action of the teacher were used as tools to check the validity of the constructed scale. Checking the validity of the items, subscales and the whole scale of the final model showed that the range of internal homogeneity coefficients of the subscales is between 0.51 and 0.68. The correlation coefficients of the score of the designed components with the total score of the mentioned subscale are between 0.69 and 0.83. Therefore, according to the results, it can be said that the developed scale has sufficient validity and can be used in consulting and research collections.

Abstract The rapid adoption of ChatGPT in academic settings has raised concerns about its impact on learning and research. This study aimed to investigate the factor structure and psychometric properties of the Persian version of the ChatGPT Usage Scale in postgraduate students. In this descriptive survey study, 350 students (179 females and 171 males) from Shahid Beheshti University were selected using convenience sampling method and responded to the ChatGPT Usage Scale (Nemt-allah et al., 2024), the Self-Directed Learning Scale (Lounsbury & Gibson, 2006) and the Brief Regulation of Motivation Scale (Kim et al., 2018). The results of the confirmatory factor analysis statistical method empirically supported the three-factor first-order structure of the ChatGPT Usage Scale, which includes, academ‌ic writing aid, academic task support and reliance and trust. Also, the correlation between the ChatGPT Usage Scale with Self-Directed Learning ability and Regulation of Motivation in postgraduate students supported the criterion validity of the scale. The internal consistency coefficients of the ChatGPT usage subscales were obtained using Cronbach's alpha method and were acceptable. Overall, the results of this study, by replicating the three-factor structure of the ChatGPT Usage Scale in Iranian university students, while defending the validity of its underlying theoretical perspective, provided convincing evidence in support of the acceptability of the technical, validity, and reliability characteristics of the Persian version of the scale.

Abstract Childhood emotional abuse is a covert yet highly impactful form of child maltreatment that can lead to enduring adverse consequences for mental health. The present study aimed to examine the psychometric properties of the Childhood Emotional Abuse Questionnaire (Goodall & Sawrikar, 2023) within an Iranian population. This research employed a descriptive design and was conducted as a psychometric study. The study population consisted of all adults aged 18 years and older residing in Qom city in 2025, from whom 444 participants were selected using convenience sampling. The research instruments included the Childhood Emotional Abuse Questionnaire, the Childhood Trauma Questionnaire, the Depression, Anxiety, and Stress Scale, and the Difficulties in Emotion Regulation Scale. Data were analyzed using R software (version 4.3.1) with the mirt, psychometric, and psych packages, as well as Amos software (version 24). Results based on Classical Test Theory indicated that most items of the questionnaire, except for Item 8, demonstrated satisfactory item–total correlations and adequate discriminative power. Moreover, significant and positive correlations between the questionnaire items and criterion variables provided strong evidence for the convergent validity of the instrument, whereas Item 8 consistently showed a markedly weaker pattern of associations. Confirmatory factor analysis supported the original two-factor structure of the questionnaire following the removal of Item 8. Reliability indices further indicated acceptable internal consistency of the collected data. Additionally, Item Response Theory analyses revealed that, with the exception of Item 8, all items exhibited desirable threshold parameters, discrimination indices, and factor loadings. Examination of the test information function showed that the questionnaire provides the highest level of information and the lowest measurement error within the latent trait range of −2 to +4. Overall, these findings suggest that the Childhood Emotional Abuse Questionnaire is a valid and reliable instrument for assessing childhood emotional abuse in the Iranian population.

Abstract Educational evaluation plays a pivotal role in improving the quality of educational programs. This study aimed to analyze the alignment of master's theses in educational sciences with the standards of Kirkpatrick's four-level model. The statistical population included all theses from four top Iranian universities (Tehran, Allameh Tabataba'i, Shahid Beheshti, and Ferdowsi Mashhad) between 2005 and 2023, from which 26 theses were selected through census sampling based on inclusion criteria.
The research instrument was a researcher-made checklist comprising 21 indicators across four levels (reaction, learning, behavior, and results), whose validity was confirmed by three experts and reliability was calculated with Cohen's kappa coefficient of 0.92. Findings revealed that the reaction level showed the best performance with 95.4% alignment, while this rate decreased to 54.6% for learning, 34.8% for behavior, and 13.2% for results. Major weaknesses included insufficient use of advanced assessment methods (15%), lack of long-term follow-up (8%), and neglect of organizational indicators measurement (77%).
The results demonstrate an urgent need for revising evaluation research methodologies, developing indigenous tools for higher-level assessment, and emphasizing longitudinal evaluations. These findings are significant for enhancing the quality of educational evaluation research and improving the effectiveness of educational programs.

Abstract The present study aimed to examining the three-factor structure of the Persian version of Schultz et al.'s (2010) Suffering Experience and Perception Scale in individuals aged 18 to 50 in Ahvaz city. This psychometric research employed a test development and standardization approach. The statistical population consisted of individuals of Ahvaz aged 18 to 50. To assess face and content validity, a panel of 13 experts and faculty members from Shahid Chamran University, Jundi-Shapur University, and Islamic Azad University was selected. The preliminary study phase included 50 students from Shahid Chamran University, while the final sample comprised 445 individuals aged 18 to 50 from Ahvaz city, selected via convenience sampling. Data collection was conducted in the field and using the Suffering Experience and Perception Scale developed by Schulz et al. (2010). The data was analysis using Exploratory and Confirmatory Factor Analysis. The findings strongly support the validity and reliability of the Persian version of the scale, such that its three-factor structure - encompassing physical suffering, psychological suffering, and spiritual suffering - demonstrating significant consistency with theoretical foundations of the feeling of suffering.

Abstract Given the rapid evolution of artificial intelligence (AI) and the need to assess AI skills, it is vital to validate indigenous instruments to measure AI literacy. This study aimed to psychometrically validate Ng et al.’s (2024) AI literacy questionnaire in a sample of Iranian undergraduates as a non-Western context (Iran). This research employed a descriptive-correlational design with a psychometric approach. The questionnaire was localized through a back-translation process and expert review by specialists in educational technology, computer science, and English language teaching. Initial reliability was evaluated by conducting a pilot study involving 30 students using Cronbach’s alpha and test-retest methods. The final version of the questionnaire was administered to 151 undergraduate English education students at Shahrekord University who were selected via stratified random sampling. To examine construct validity and reliability, confirmatory factor analysis and structural equation modeling based on covariance were conducted using AMOS and SPSS software. The results of the first-order confirmatory factor analysis indicated that the factor loadings of the items were acceptable and significant. In addition, the composite reliability (0.84) and average variance extracted (0.62) indices indicated satisfactory convergent validity of the constructs. The second-order confirmatory factor analysis was run to evaluate the AI literacy scale’s affective, behavioral, cognitive, and ethical dimensions. The model fit indices indicated an acceptable model fit. Overall, the results revealed that the four-dimensional (ABCE model) structure of AI literacy is confirmed in an Iranian sample. Furthermore, the descriptive analysis of the dimensions showed the affective dimension received the highest mean value, highlighting the importance of the motivational and attitudinal factors in forming AI literacy. In sum, the Persian version of the AI literacy questionnaire with 32 items demonstrated acceptable validity and reliability and can be used as an authentic tool for measuring AI literacy among Iranian university students.

Abstract The present study aimed to examine the psychometric properties of the Teacher Emotion Regulation Scale (TERS) in a sample of Iranian teachers. This questionnaire includes five core emotion regulation strategies: avoidance, cognitive reappraisal, suppression, active modification, and tension reduction, each representing different ways in which teachers manage their emotions in the educational environment. Considering the importance of emotion regulation in the quality of educational interactions, professional performance, and teachers’ mental health, it was essential to investigate the validity and reliability of this tool within the Iranian cultural context. The study population consisted of all secondary school teachers in Tehran during the 2023–2024 academic year, from which a sample of 350 teachers was selected using multistage cluster sampling. Various statistical methods were employed for data analysis, including exploratory and confirmatory factor analyses to examine the factor structure, Cronbach’s alpha to estimate reliability, and convergent validity indices. The findings indicated that the Persian version of the TERS, like the original version, demonstrated a five-factor structure, with all strategies identified with appropriate factor loadings. The reliability coefficients of the subscales ranged from 0.85 to 0.90, indicating satisfactory internal consistency. Furthermore, evidence of convergent validity confirmed significant associations between the questionnaire dimensions and related constructs. Based on these results, the Persian version of the TERS can be considered a valid and reliable tool for assessing emotion regulation among Iranian teachers and can be utilized in future research as well as in intervention and educational programs.

Abstract Until now, various tools have been used to measure resilience, but most of them have been designed in accordance with the views of Western societies on this component. The present study aimed to investigate the psychometric properties of the 9-item resilience inventory for non-clinical populations, which is based on the perspective of Eastern societies on resilience. In this study, the statistical population included all teachers working in public schools of Markazi Province during the 2023–2024 academic year, of whom 302 teachers completed the 9-item Resilience Inventory (RI-9; Wongpakaran et al., 2023), the Brief Resilience Scale (BRS; Smith et al., 2008), and the Anxiety subscale of the Depression, Anxiety, and Stress Scale (DASS-21; Lovibond & Lovibond, 1995) through an online survey. Reliability was assessed using Cronbach's alpha and McDonald's Omega, while validity was evaluated through convergent validity, concurrent validity, and confirmatory factor analysis. The results of the factor analysis confirmed the single-factor structure of the original version and the data fit of this inventory in the Iranian sample, and the convergent and concurrent validity were also adequate (p < 0.001). Furthermore, Cronbach's alpha (α = 0.87) and McDonald's omega (Ω = 0.87) coefficients indicated the instrument's reliability. The findings suggest that the Persian version of the 9-item Resilience Inventory demonstrates acceptable validity and reliability, making it a suitable instrument for research and educational purposes.

Abstract Although qualitative content analysis used in major of qualitative methods, yet there is no clear explanation of this method. In this paper, qualitative content analysis is examined in the context of qualitative research methods. This method against quantitative content analysis and instead of account apparent words, deals with latent themes and templates. Overall, the qualitative content analysis search concepts, terms, and relationships between these concepts, try to the infer and reveal hidden patterns in the interviews, observations and written documents. First, present a definition of the content and content analysis and then examine applications, processes, procedures, sampling, and validity of results (credibility, dependability, transferability, conformability). Also answer to this question that content analysis is method or technique. Content analysis can be generally divided into two main modes of inductive and deductive and perform in three steps preparation, organization and made ​​a report.

Abstract this study been done to build, reliability making and validation an measurement tool for accreditation and quality assurance of iran's higher education system. to perform this study, is used mixed method with explorative plan- tool development model.First, in the qualitative study, by using the method of grounded theory and interview with 36 higher education experts, were designed questionnaire with 25 omponents and 157 sub-components. then, in the quantitative section, Designed questionnaire, in a pilot study, was conducted on 84 members of Iran's higher education experts. based on the received feedback were acting to refine the questionnaire. then, the its final version and modified was put in the hands of 293 the country's higher education experts. validity of the questionnaire was confirmed by experts and its reliability was calculated equal to (0/982) by Cronbach's alpha. in the qualitative part of the study, was used non-probability purposive sampling sampling method and in the quantitative part, random classified sampling method used. to test mentioned measurment tool, analysis of structural equation modeling was used. by doing first order confirmatory factor analysis, mentioned measurment tool were modified to 22 components and 150 sub-components. results of second order confirmatory factor analysis, also showed that 22 components were extracted has sufficient factor load to predict of measurment tool relating to Accreditation and quality assurance of iran's higher education system. in addition, goodness of fit indices such as, (CMIN/DF) equal to 1/924, (RMSEA) equal to 0/39, (GFI) equal to 0/976, (AGFI) equal to 0/939, (CFI) equal to 0/928, (NNFI) equal to 0/935, (TLI) equal to 1/000, (IFI) equal to 0/928 and (RFI) equal to 0925, it shows, designed, measurment tools for the accreditation and quality assurance of iran's higher education system is a very favorable fitness.

Abstract This study was conducted with the aim of structural analysis sources of Self-Efficacy Information, Self-efficacy, Goal-Setting and Self-regulation with math performance. The study population included all ninth grade students in secondary school in Sanandaj city; from this population a random sample of 396 students was selected. The research instruments were Sources of Self-Efficacy Information in mathematics questionnaire, Goal-Setting questionnaire, Self-efficacy mathematics questionnaire & Self-regulation questionnaire. The results of Cronbach's alpha and the first stage of the confirmatory factor analysis represented the good reliability and validity of the tool. Data were analyzed using Statistical technique of structural equation modeling (confirmatory path analysis) with LISREL 8/50 software. The results indicate that:
• The Self-efficacy variable has direct, positive and significant effect on the level of 0.01 on math performance (0/589) and no indirect and total effect on math performance variable equal to (0/589)
• The goal setting variable has direct, positive and significant effect on the level of 0.01 on math performance equal to (0/453), indirect positive effect (0/211) and total effect (0/664) on math performance variable.
• The self-regulation variable has direct, positive and significant effect on the level of 0.01 on math performance equal to (0/326), indirect positive (0/190) and total effect (0/516) ) on math performance variable.
• The sources of Self-Efficacy Information variable has direct, positive and significant effect on the level of 0.01 on math performance equal to (0/113), indirect positive effect (0/541) and total effect (0/654) ) on math performance variable.

Abstract The Satisfaction with Life Scale (SWLS; Diener et al., 1985) has been a standard measure for over thirty years. However, the concept of life satisfaction has evolved during this period. This study aimed to evaluate the psychometric properties of the Riverside Life Satisfaction Scale (RLSS) among university students. Utilizing a convenience sampling method within a validation design, 210 students from private institutions in Mashhad were recruited. The participants completed the RLSS (Margolis et al., 2019), SWLS (Diener et al., 1985), a short form of the Psychological Well-Being Scale (Reif, 1989), and the Kessler Psychological Distress Scale (Kessler et al., 2002). The study examined content validity, gender confirmatory invariance, as well as convergent and divergent validity, alongside internal consistency and reliability. The Content Validity Ratio (CVR) for the entire scale was 0.87, and the Content Validity Index (CVI) was 0.97. The Cronbach's alpha coefficient was 0.88, and the Spearman-Brown split-half reliability coefficient also stood at 0.88. Confirmatory factor analysis yielded positive results across the entire sample, inclusive of both genders, indicating factorial invariance by gender. Both convergent and divergent validity were confirmed (P

Abstract Background: Preparing a valid instrument to measure the basic psychological needs in Iranian populations is necessary for research purposes. Objectives: The aim of this study was to examine reliability, validity, and exploratory factor analysis of a Persian version of the Basic Needs Satisfaction in General Scale (BNSG-S) in a sample of Iranian students. Method: Five hundred and eighty four students (273 males, 311 females) were participated in this study, voluntarily. All participants were asked to complete the BNSG-S (Gagne, 2003), the Eysenck Personality Questionnaire-Revised Short Scale (EPQ-RS; Eysenck, Eysenck, & Barrett, 1985), Positive and Negative Affect Schedule (Watson, Clark, & Tellegen, 1988), and the Mental Health Inventory (MHI-28; Besharat, 2009). Results: The results of exploratory factor analysis supported a single general factor of basic needs satisfaction in general and a three factor structure including Autonomy, Competence, and Relatedness. The convergent and discriminant validity of the BNSG-S were supported by an expected pattern of correlations between the scale and the measures of personality and mental health. All correlation coefficients between the mean scores on the BNSG-S and scores of the extraversion, neuroticism, positive affect, negative affect, psychological well-being, and psychological distress were statistically significant. Coefficient alpha estimates of internal reliability were between .83 and .91 for the BNSG-S subscales. Test-retest reliability of the BNSG-S was also calculated at the range of .67-.77. All correlations were statistically significant. Conclusion: It was concluded that the BNSG-S can be considered as a reliable and valid scale to measure the basic needs satisfaction in Iranian samples.

Abstract Objective: The present research aims to study the factor structure, reliability, and validity of the Successful Intelligence Scale. Method: Using the multi-stage cluster sampling method, 500 (including 175 female and 325 male) subjects were selected from among public school students in Karaj. Results: The exploratory factor analysis was performed using the principal component method. The results confirmed three factors of successful intelligence (i.e. analytical, creative, and practical intelligence) as well as the principal factor. Reliability of the scale items was examined using Cronbach’s alpha coefficient, and its validity was investigated using factor analysis. Internal consistency of the questionnaire was acceptable, and the Cronbach’s alpha for the subscales was between 0.74 and 0.81. Also, the confirmatory factor analysis results confirmed that the structure of the scale had an acceptable fit to the data, and that the goodness-of-fit index for the model was observed. Conclusion: The results of confirmatory factor analysis were almost close to that of studies done in the original cultural context. Validity and reliability of the scale were also close to that of previous researches. Considering the desirable psychometric property, therefore, this scale is an appropriate instrument for measuring the students’ successful intelligence.

Abstract Background: ‘Mobile phone addiction’ is considered as a compulsive and addictive disorder in the 21^st century, and excessive usage of mobile phone can lead to addiction. Objectives: The present research aims to study construction and psychometric properties of the Mobile Phone Addiction Questionnaire Method: Using the multi-stage random sampling method, 200 subjects (including100 males and 100 females) were selected from among the 3^rd-grade high school students in District 1 of Ahwaz city. Results: The results of the factor analysis showed that the Mobile Phone Addiction Questionnaire consisted of 13 questions as well as the three subscales of creativity loss, tendency, and loneliness, and that its reliability and validity enjoy a good fitness. Confirmatory factor structure also confirmed the suggested three-factor model of the Questionnaire. Conclusion:The mentioned questionnaire can be used for diagnosis of mobile phone addiction and performing the related studies.