Document Type : Research Paper

Authors

1 Department of Curriculum Development & Instruction Methods, Faculty of Psychology and Education, University of Tehran, Tehran, Iran

2 Department of Curriculum Development & Instruction Methods, Faculty of Psychology and Education, University of Tehran

3 Department of Educational Psychology and Special Education, College of Education, University of Saskatchewan

4 Department of Deliberation and Measuring, Faculty of psychology and educational sciences, University of Allameh Tabataba’i

Abstract

In order to facilitate the interpretation of raw scores, they are usually converted to scale scores. In some cases, these conversions are a series of nonlinear transformations that can affect the conditional standard error of measurement throughout the scale of score. Therefore, the purpose of this study was to introduce methods for calculating the conditional standard error of measurement based on the strong true score theory. Furthermore, comparison of normalized and equipercentile nonlinear transformations on the raw scores of the academic achievements of the graduates of mathematical sciences in 2014 and their effect on conditional standard error of measurement was also conducted. So, in order to achieve these purposes, we used a sample of 3943 high school graduates of Mathematics and Physics in 2014 who had participated in national university entrance examination in 2015 randomly selected by National Organization of Educational Testing. The conditional standard error of measurement under these transformations was estimated based on the binomial procedure of Brennan and Lee (1999) and Chang (2006) method based on the beta-binomial distribution. The results of this study indicated that the conditional standard error of measurement of the Chang was smoother than binomial procedure, but in both methods the estimated errors are larger for middle points and smaller for extreme points. Additionally, the conditional standard errors of measurement of equipercentile were always less than normalized tranformation, so the equipercentile method found to be better than normalized transformation.

Keywords

راهنمای داوطلبان برای انتخاب رشته و ضوابط پذیرش دانشجو در آزمون سراسری سال1393. (1393). هفته‌نامه پیک سنجش 882، شماره 14، سال 19،  1-16.
سرمد، زهره؛ بازرگان، عباس؛ حجازی، الهه. (1384). روش های تحقیق در علوم رفتاری. تهران: نشر آگاه.
جهانی­فر، مجتبی؛ خدایی، ابراهیم؛ یونسی، جلیل؛ موسوی، امین. (1396). نقش هموارسازی در تبدیل غیرخطی نمره­های خام به نمره­های مقیاس نرمال. فصلنامه مطالعات اندازه­گیری و ارزشیابی آموزشی، 7 (20). 132-103.
Brennan, R. (1998 ). Raw- Score Conditional Standard Errors of Measurement in Generalizability Theory.  Applied Psychological Measurement, 22, 307-331.
Brennan, R. L., &  Lee, W. (1999 ). Conditional Scale-Score Standard Errors of Measurement un­d­­­er Binomial and Compopund Binomial Assumption. Educational and Psychological Measurement, 59, 5-24.
Carlin, J. B., & Rubin, D. B. (1991). Summarizing Multiple- Choise Tests Using Three Informative Statistics. Psychological Bulletin,11, 338-349.
Chang, S. W. (2006). Methods in Scaling the Basic Competence Test. Educational and Psychological Measurement, 66, 907-929.
Dorans, N. J. (2004).­­ Equating, Concordance and Expectation. Applied Psychological Measurement, 28 (4), 227–246.
Feldt, L. S., & Brennan, R. L. (1989 ). Reliabaility. In R.L. Linn (Ed.), Educational Measurement (3rd ed., pp. 105-146). New York: American Council on Educational and Macmillan.
Feldt, L. S., & Qualls, A. L. (1996). Estimation of measurement error variance at specific score levels. Journal of Educational Measurement, 33, 141-156.
Feldt, L. S., & Qualls, A. L. (1998). Approximating Scale Score Standard Error of Measurement from the Raw Score Standard Error. Applied Measurement in Education, 11, 159-177.
Feldt, L. S., Steffen, M & ,. Gupta, N. C .(1985) . A of Five Methods for Estimating of Measurement Levels. Applied Pshychological Measurement, 9, 351-361.
Kolen, M. J & ,. Brennan, R. L. (2004). Test Equating, Scaling, and Linking: Methods and Practice (3rd Ed .( New York: Springer.
Kolen, M. J., Hanson, B. A., & Brennan, R. L. (1992). Conditional Standard Errors of Measurement for Scale Scores. Journal of Educational Measurement, 29, 285-307.
Lee, W., Brennan, R. L., & Kolen, M. J. (2000). Etimators of Conditional Scale-Score Standard Errors of Measurement: A Simulation Study. Journal of Educational Measurement, 37, 1-20.
Lord, F. M .((1995) . Estimating Test Reliability. Educational Testing Service, 1955, 1-17.
Mollenkopf, W. G. (1949) . Variation of the Standard Eerror of Measurement . Psychometrika,14, 189-229.
Price, L. R., & RAJU, N. (2006). Conditional Standard Errors of Measurement for Composite Scores  on the WECHSLER Preschool and Primary Scale of Intelligance-Third Edition. Psychological Reports, 98, 237-252.
Thorndike, R. L. (1951). Reliability. In E. F. Lindquist (Ed.), Educational measurement (pp. 560-620). Washington, DC: American Council on Education.