Document Type : Research Paper

Author

Associate Professor of Applied Linguistics, Allameh Tabataba'i University

Abstract

Classroom assessment, as the complementary part of the language learning process, is a powerful decision-making instrument. Nonetheless, more research is required regarding the ways teachers cope with these requirements, and how they affect their pedagogical practices. This study is an attempt to examine EFL teachers’ perceptions of assessment literacy and the criteria they consider to assess their students. Moreover, it examines whether graduate and undergraduate teachers differ in terms of their assessment literacy. To this end, by using a survey and Ex-Post Facto research design and through a two-part questionnaire on assessment literacy (adapted from Plake, 1993; Plake, Impara, & Fager, 1993), a comparison was made between undergraduate (N=22) and graduate teachers (N=10) of English as a Foreign Language (EFL), English Literature, Translation studies, and Linguistics selected through purposive sampling on their perceptions of assessment literacy. The research results revealed a statistically significant difference between undergraduate and graduate teachers’ perceptions of assessment literacy. Results also showed that graduate teachers had higher perceptions of assessment literacy than their undergraduate counterparts, representing the effect of their level of education and educational background. Thus, this study highlights the significance of giving sufficient and proper training to all soon-to-be language teachers on language assessment, argues for the need, suggests ways by which teachers can become more literate in the domain of language assessment, and presents ways teacher educators and language testing experts can assist in this path.

Keywords

مهماندوست، زهره، علوی، سید محمد و کیوان پناه، شیوا. (۲۰۱۸). بررسی سواد سنجش و ارزشیابی مدرسان دانشگاهی زبان انگلیسی در ایران. پژوهش‌های زبان‌شناختی در زبان‌های خارجی، ۸(۲)، ۶۴۵-۶۶۳. https://dx.doi.org/10.22059/jflr.2018.245602.422
References
American Federation of Teachers, National Council on Measurement in Education, and National Education Association (AFT, NCME, and NEA) (1990). Standards for teacher competence in educational assessment of students. Educational Measurement: Issues and Practice, 9(4), 30-32. https://doi.org/10.1111/j.1745-3992.1990.tb00391.x
Ary, D., Jacobs, L. C., & Sorensen, C. (2010). Introduction to research in education (8th ed.). Belmont, CA: Wadsworth.
Berry, V., Sheehan, S., & Munro, S. (2017). Exploring teachers’ language assessment literacy: A social constructivist approach to understanding effective practices. In Proceedings of the ALTE 6th International Conference on Learning and Assessment: Making the Connections (pp. 201-207). Bologna: Italy.
Bracey, G. (2000, August). Thinking about tests and testing: A short primer in assessment literacy. Paper presented at the American Youth Policy Forum, Washington, DC.
Braney, B. T. (2010). An examination of fourth grade teachers’ assessment literacy and its relationship to students’ reading achievement (Master’s thesis). East Carolina University, USA.

Brindley, G. (2001). Outcomes-based assessment in practice: Some examples and emerging insights. Language Testing, 18(4), 393-407. https://doi.org/10.1191/026553201682430102
Brookhart, S. M. (1998, April). Teaching about grading and communicating assessment results. Paper presented at the annual meeting of the National Council on Measurement in Education, San Diego, CA.
Brookhart, S. M. (1999a). The art and science of classroom assessment: The missing part of pedagogy. Washington, D.C.: ERIC Clearinghouse on Higher Education and Office of Educational Research and Improvement.
Brookhart, S. M. (1999b). Teaching about communicating assessment results and grading. Educational Measurement: Issues and Practice, 18(1), 5-13.
https://doi.org/10.1111/j.1745-3992.1999.tb00002.x
Brookhart, S. M. (2001, March). The standards and classroom assessment research. Paper presented at the annual meeting of the American Association of Colleges for Teacher Education, Dallas, TX.
Brown, G. (2004). Teachers’ conceptions of assessment: Implications for policy and professional development. Assessment in Education, 11(3), 301-318.
https://doi.org/10.1080/0969594042000304609
Campbell, C., Murphy, J. A., & Holt, J. K. (2002, October). Psychometric analysis of an assessment literacy instrument: Applicability to preservice teachers. Paper presented at the annual meeting of the Mid-Western Educational Research Association, Columbus, OH.
Center for School Improvement and Policy Studies (2007). What is assessment literacy? Columbus, OH: Boise State University.
Cheng, L., Rogers, T., & Wang, X. (2008). Assessment purposes and procedures in ESL/EFL classroom. Assessment and Evaluation in Higher Education, 33(1), 9-32.
https://doi.org/10.1080/02602930601122555
Cizek, G. J., Fitzgerald, S. M., & Rachor, R. E. (1996). Teachers' assessment practices: Preparation, isolation, and the kitchen sink. Educational Assessment, 3(2), 159-179.
https://doi.org/10.1207/s15326977ea0302_3
Cowan, J. (1998). On becoming an innovative university teacher: Reflection in action. Buckingham, Philadelphia, PA: Society for Research into Higher education & Open University Press.
Hargreaves, E. (2005). Assessment for learning? Thinking outside the (black) box. Cambridge Journal of Education, 35(2), 213-224. https://doi.org/10.1080/03057640500146880
Hearne, J. (2001). Assessment as a tool for learning. New horizons for learning. Retrieved from www.newhorizons.org/strategies/assess/hearne.htm.
Hoyt, K. (2005, April). Assessment: Impact on instruction. New Visions in Action, National Assessment Summit, Meeting conducted in Alexandria, VA.
Impara & Plake, B. S., & Fager, J. J. (1993). Teachers’ assessment background and attitudes towards testing. Theory into Practice, 32(2), 113-117.
https://doi.org/10.1080/00405849309543584
James, R., McInnis, C., & Devlin, M. (2002). Assessing learning at Australian Universities. Melbourne, Australia: Center for the Study of Higher Education.
Kane, M. T. (2006). Validation. In R. L. Brennan (Ed.), Educational Measurement (pp. 17-64). Westport, CT: Praeger.
Koh, K., Burke, L. E. C. A., Luke, A., Gong, W., & Tan, C. (2018). Developing the assessment literacy of teachers in Chinese language classrooms: A focus on assessment task design. Language Teaching Research, 22(3), 264-288.https://doi.org/10.1177/1362168816684366
Kremmel, B., & Harding, L. (2020). Towards a comprehensive, empirical model of language assessment literacy across stakeholder groups: Developing the language assessment literacy survey. Language Assessment Quarterly, 17(1), 100-120. https://doi.org/10.1080/15434303.2019.1674855
Lam, R. (2019). Teacher assessment literacy: Surveying knowledge, conceptions and practices of classroom-based writing assessment in Hong Kong. System, 81, 78-89.
https://doi.org/10.1016/j.system.2019.01.006
Linn, R. L., & Grolund, N. E. (2000). Measurement and assessment in teaching. Upper Saddle River, NJ: Merrill Prentice Hall.
McMillan, J. H. (2001). Secondary teachers' classroom assessment and grading practices. Educational Measurement: Issues and Practice, 20(1), 20-32.
https://doi.org/10.1111/j.1745-3992.2001.tb00055.x
Mertler, C. A. (2005). Secondary teachers' assessment literacy: Does classroom experience make a difference? American Secondary Education, 33(2), 76-92.
No Child Left Behind (2001). Retrieved November 22, 2005 from http://www.ed.gov/nclb/landing.jhtml.
Öz, S., & Atay, D. (2017). Turkish EFL instructors’ in-class language assessment literacy: Perceptions and practices. ELT Research Journal, 6(1), 25-44.
Pallant, J. (2013). SPSS survival manual: A step by step guide to data analysis using IBM SPSS (4th ed). Crows Nest, NSW: Allen & Unwin.
Patton, M. (1990). Qualitative evaluation and research methods (2nd ed.). Thousand Oaks, CA: Sage Publications.
Phye, G. D. (1997). Classroom assessment: A multidimensional perspective, In G. D. Phye (Ed.), Handbook of classroom assessment: Learning, adjustment, and achievement (pp. 33-51). San Diego: Academic Press.
Plake, B. S. (1993). Teacher assessment literacy: Teachers’ competencies in the educational assessment of students. Mid-Western Educational Researcher, 6(1), 21-27.
Plake, B. S., Impara, J. C., & Fager, J. J. (1993). Assessment competencies of teachers: A national survey. Educational Measurement: Issues and Practice, 12(4), 10-12.
https://doi.org/10.1111/j.1745-3992.1993.tb00548.x
Popham, W. J. (2004). All about accountability: Why assessment illiteracy is professional suicide. Educational Leadership, 62(1), 82-83.
Quilter, S. M. (1999). Assessment literacy for teachers: Making a case for the study of test validity. Teacher Educator, 34(4), 235-243.
https://doi.org/10.1080/08878739909555204
Razavipour, K., Riazi, A., & Rashidi, N. (2011). On the interaction of test washback and teacher assessment literacy: The case of Iranian EFL secondary school teachers. Journal of English Language Teaching, 4(1), 156-161. https://doi.org/10.5539/elt.v4n1p156
Rogers, W. T. (1991). Educational assessment in Canada: Evolution or extinction? The Alberta Journal of Educational Research, 37(2), 179-192.
Salimi and Farsi, M. (2020). Probing into EFL teachers’ assessment literacy and teaching experience: The case of native ESL and non-native EFL teachers. Journal of English language
Teaching and Learning, 12(25), 269-288.
Schafer, W. D. (1993). Assessment literacy for teachers. Theory into Practice, 32(2), 118-126.
Shepard, L.A. (2001). The role of classroom assessment in teaching and learning, In V. Richardson (Ed.), Handbook of research on teaching (pp.1066-1101). Washington DC: AERA.
Stiggins, R. J. (1995). Assessment literacy for the 21st century. Phi Delta Kappan, 77(3), 238-245.
Stiggins, R. J. (1999). Are you assessment literate? The High School Journal, 6(5), 20-23.
Stiggins, R. J. (2001). The unfulfilled promise of classroom assessment. Educational Measurement: Issues and Practice, 20(3), 5-15.
https://doi.org/10.1111/j.1745-3992.2001.tb00065.x
Stiggins, R. J. (2002). Assessment crisis: The absence of assessment for learning. Phi Delta Kappan, 83(10), 758-765. https://doi.org/10.1177/003172170208301010
Taylor, L. (2013). Communicating the theory, practice and principles of language testing to test stakeholders: Some reflections. Language Testing, 30(3), 403-412.
https://doi.org/10.1177/0265532213480338
Wang, T., Wang, K., & Huang, S. (2008). Designing a web-based assessment environment for improving pre-service teacher assessment literacy. Computers & Education, 51(1), 448 462. https://doi.org/10.1016/j.compedu.2007.06.010
Xu, Y., & Brown, G. T. (2017). University English teacher assessment literacy: A survey-test report from China. Papers in Language Testing and Assessment, 6(1), 133-158.