The precision of the UP statistics to detect the aberrant  response patterns in polytomouse data

Dehghan Nayeri, Tayebe; Delavar, Ali; Farrokhi, Noorali; Borjali, Ahmad

doi:10.22054/jem.2020.45213.1945

Document Type : Research Paper

Authors

¹ Ph.D. Candidate in psychology, Allameh Tabataba'i University, Tehran, Iran

² Proffesor, Assessment and Measerment, Allameh Tabataba'i University, Tehran, Iran

³ Associate Professor, Allameh Tabataba'i University, Tehran,

⁴ Associate Professor, Allameh Tabataba'i University, Tehran, Iran

https://doi.org/10.22054/jem.2020.45213.1945

Abstract

The major aim of this research was to investigate the precision of the up parametric statistics to detect common response styles in polytomouse data. In the present study, five-choices data was simulated with 25 replication according to a fully-crossed design based on Partial Cradit Rasch model. The design included foure types of response styles ;Extreme responding positive, negative, acquiescence and midpoint responding, in four -different situations ; Sample size, test length‌, percentages of aberrant-responding examinees and percentages of aberrant items was investigated. precision of the Up statistic was high to detect the response styles in all situations respectively; ;Extreme responding negative, positive, acquiescence and it was possible to distinguish between the compatible and aberrant response patterns with the highest precision in these response styles,except to detect the midpoint responding was less precision, in some situations.
The Up parametric statistics has high sensitivity‌ to detect common response styles in non-cognitive multiple choice data and it is suggested that be used this statistics to detect of the response styles of extreme responding negative, positive, acquiescence .

Keywords

References

امبرتسون، سوزان ای؛ رایس، استیون پی (2000). نظریههای جدید روانسنجی برای روانشناسان، ترجمه حسن پاشا شریفی و همکاران، 1388. تهران: رشد.

Armstrong, R. D., & M. Shi. (2009).A parametric cumulative sum statistic for person fit. Appllied Psychological Measurement, 33: 391-410.

Baumgartner, H., & Steenkamp, J. B. E. M. (2001). Response styles in marketing research: A cross-national investigation. Journal of Marketing Research, 38, 143–156.

Butcher, J. N., Graham, J. R., Ben-Porath, Y. S., Tellegen, A., Dahlstrom, W. G., & Kaemmer, B. (2001). MMPI–2 (Minnesota Multiphasic Personality Inventory–2): Manual for administration and scoring (Revised). Minneapolis, MN: University of Minnesota Press.

Cabooter, E. F. K. (2010). The impact of situational and dispositional variables on response styles with respect to attitude measures. Doctoral dissertation, Ghent University, Ghent, Belgium.

Chen, C. I., Lee, M. N., & Yen, C. L. (2004). Faking intention on the internet: Effects of test types and situational factors. Chinese Journal of Psychology, 46(4), 349- 359.

Conijn, J. M., Emons W. H. M., & Sijtsma, K. (2014). Statistic lz-based person-fit methods for noncognitive multiscale measures. Applied psychological Measurement, 38, 122–136.

Conijn, J.M., Emons, W.H., De Jong, K., & Sijtsma, K. (2015). Using person-fit analysis to detect and explain aberrant responding to the Outcome Questionnaire-45. Assessment, 22, 5312-524.

Curtis, D. D. (2004). Person misfit in attitude surveys: Influences, impacts and implications. International Education Journal, 5, 125-143.

De Ayala, R. J. (2009). The Theory and Practice of Item Response Theory.

De la Torre, J., & Deng, W. (2008). Improving person fit assessment by correcting the ability estimate and its reference distribution. Journal of Educational Measurement, 45, 159±1177.

Dimitrov, D.M., & Smith, R.M. (2006). Adjusted Rasch person-fit statistics. Journal of Applied Measurement, 7(2), 170-183.

Emons, W. H. M. (2008). Nonparametric person-fit analysis of polytomous item scores. Applied Psychological Measurement,32, 224-247.

Emons, W. H. M. (2009). Detection and diagnosis of person misfit from patterns of summed polytomous item. Applied Psychological Measurement, 33, 599-619.

Ferrando, P.J., & Chico, E. (2001). Detecting dissimulation in personality test scores: A comparison between person-fit indices and detection scales. Educational and Psychological Measurement, 61, 997-1012.

Glas, C. A. W& Meijer, R. R. (2003). A Bayesian approach to person fit analysis in item response theory models, Applied Psychological Measurement 27 (3), 217-233.

Han, K. T. (2007). WinGen: Windows software that generates item response theory parameters and item responses. Applied Psychological Measurement, 31(5), 457-459.

Huang, T.-W. (2012). Aberrance Detection Powers of the BW and Person-Fit Indices. Educational Technology & Society, 15 (1),128–37.

karabatsos, G. (2003). Comparing the aberrant response detection performance of thirty-six person-fit statistics. Applied Measurement in Education, 16, 277-298.

Meijer, R. R., & Sijtsma, K. (2001). Methodology review: Evaluating person fit. Applied Psychological Measurement, 25, 107-135.

Meyers, L. S., Gamst, G., & Guarino, A. J. (2016). Applied multivariate research: Design and interpretation. Sage publications.

Paulhus DL. 1991. Measurement and control of response bias. In: Robinson JP, Shaver PR, Wrightsman LS, editors. Measures of personality and social psychological attitudes, vol. 1. San Diego: Academic Press; p. 17 -59.

Razavi, Tiffani. (2001).Self-report measures: an overview of concerns and mitations of questionnaire use in occupational stress research, Southampton, UK University of Southampton 23pp. (Discussion Papers in Accounting and Management Science, 01-175).

Rupp, A. A. (2013). A systematic review of the methodology for person fit research in Item Response Theory: Lessons about generalizability of inferences from the design of simulation studies. Psychological Test and Assessment Modeling, 55.

Schoonees, P. C., Van de Velden, M., Groenen, P. J.F. (2015). Constrained dual scaling for detecting response styles in categorical data, Econometric Institute Rep ort, Psychometric Society, vol, 80, No, 4, 968-994.

St-Onge, C., Valois, P., Abdous, B., & Germain, S. (2009). A Monte Carlo Study of the Effectof Item Characteristic Curve Estimation on the Accuracy of Three Person – Fit Statistics. Applied Psychological Measurement, 33(4), 307-324.

St-Onge, C., Valois, P., Abdous, B., & Germain, S. (2011). Accuracy of person-fit statistics: A Monte Carlo study of the influence of aberrance rates. Applied Psychological Measurement, 35, 419-432.

Syu, J.J. (2013). Applying person – fit in faking detection the simulation and practice of non- parametric item response theory (Unpublished doctoral dissertation). chengchi university.

Tippins, Nancy T. (2011). Technology-Enhanced Assessment of Talent. Hoboken, NJ, USA: Jossey-Bass, ProQuest ebrary. Web. 21 November 2015.

Weijters, B. (2006). Response styles in consumer research Doctoral dissertation, Ghent University, Ghent, Belgium.

Wright, B. D., & Masters, G. N. (1982). Rating scale analysis. Chicago: MESA Press.

Wright, B. D., & Stone, M. H. (1979). Best test design. Rasch measurement. Chicago: Mesa Press.

Quarterly of Educational Measurement

The precision of the UP statistics to detect the aberrant response patterns in polytomouse data

References

References

Volume 10, Issue 39
April 2020
Pages 41-60

The precision of the UP statistics to detect the aberrant response patterns in polytomouse data

References

References

Volume 10, Issue 39April 2020Pages 41-60

Volume 10, Issue 39
April 2020
Pages 41-60