Document Type : Research Paper
Authors
Allameh Tabataba'i University
Abstract
High-stakes tests exert impacts on teachers’ perceptions, methodology, practices, and materials used in the classroom. However, previous research studies have overlooked the role of teachers’ past experiences in the tests and their instructional planning prior to, during, and after the preparation courses. This study inspected the washback effect of IELTS examination on Iranian EFL teachers’ instructional planning considering their IELTS related experiences. Through a mixed-methods research design, two sets of questionnaires were distributed among 120 Iranian IELTS instructors to examine the IELTS washback effect on their perceptions of instructional planning. Afterward, a semi-structured interview was held with 15 instructors, selected from among 120 initial participants, to supplement the previously collected data. The results of one sample t-test and Wilcoxon signed-ranks test indicated that the current level of Instructional planning at item and total score level was beyond average. Likewise, the results of Spearman rho indicated a positive and significant relationship between instructors’ instructional planning and their past IELTS related experiences. It was also found that the IELTS examination made the instructors develop exam-oriented plans by focusing on the students’ test performance. The results are invaluable for IELTS instructors in that they can raise their knowledge and awareness about the nature and scope of IELTS washback effect and ways to develop exam-oriented plans.
Keywords
- High-stakes tests
- IELTS related experiences
- IELTS instructors
- instructional planning
- washback effect
Main Subjects
Abdullah, N., Idris, N., Hamzah, M. S. G., & Sembak, S. (2015). Planning and implementation of school-based assessment (SBA) among teachers. Procedia-Social and Behavioral Sciences, 211, 247-254.https://doi.org/10.1016/j.sbspro.2015.11.031
Afflerbach, P. P., & Cho, B. Y. (2011). The classroom assessment of reading. In M. L. Kamil, P. D. Pearson, E. B. Moje, & P. P. Afflerbach (Eds.), Handbook of reading research (pp. 487-518). New York, NY: Routledge.
Alderson, C., & Wall, D. (1993). Does washback exist? Applied Linguistics, 14(2), 115-129.
Amengual-Pizarro, M. (2009). Does the English Test in the Spanish university entrance examination influence the teaching of English? English Studies, 90(5), 582-598.
Ansyari, M. F. (2018). Developing a rubric for assessing pre-service English teacher struggles with instructional planning. Cogent Education, 5(1), 1-17. https://doi.org/10.1080/2331186x.2018.1507175
Bachman, L. F., & Palmer, A. S. (2010). Language assessment in practice: Developing language assessments and justifying their use in the real world. Oxford: Oxford University Press.
Bailey, K. M. (1996). Working for washback: A review of the washback concept in language testing. Language Testing, 13(3), 257-279. https://doi.org/10.1177/026553229601300303
Bailey, K. M. (1999). Washback in language testing. Princeton: Educational Testing Service.
Baker, D. (1989). Language testing: A critical survey and practical guide. London: Edward Arnold.
Borko, H., & Livingston, C. (1989). Cognition and improvisation: Differences in mathematics instruction by expert and novice teachers. American Educational Research Journal, 26(4), 473-498.
Bracey, G. W. (1989). The 150$ million redundancy. Phi Delta Kappa, 70(9), 698-702.
Cannell, J. J. (1987). Nationally-normed elementary achievement testing in America’s public schools: How all 50 states are above the national average. Educational Measurement: Issues and Practice, 7(4), 12–15.
Hoadjli, A. C. (2015). The washback effect of an alternative testing model on teaching and learning: An exploratory study on EFL secondary classes in Biskra (Unpublished PhD dissertation). Université Mohamed Khider-Biskra.
Chen, L. M. D. (2002). Taiwanese junior high school English teachers’ perceptions of the washback effect of the basic competence test in English (Unpublished PhD dissertation). The Ohio State University.
Cheng, L. (2004). The washback effect of a public examination change on teachers’ perceptions toward their classroom teaching. In L. Cheng, Y. Watanabe, & A. Curtis169 (Eds.), Washback in language testing: Research contents and methods (pp. 147- 170). Mahwah, NJ: Lawrence Erlbaum.
Cheng, L. (2005). Changing language teaching through language testing: A washback study. Cambridge: Cambridge University Press.
Cheng, L. (2008). Washback, impact and consequences. In E. Shohamy and N.H. Hornberger (Eds.), Encyclopedia of language and education (pp. 349-364). Language Testing and Assessment. New York: Springer.
Cheng, L., Andrews, S., & Yu, Y. (2011). Impact and consequences of school-based assessment (SBA): Students’ and parents’ views of SBA in Hong Kong. Language Testing, 28(2), 221-249. https://doi.org/10.1177/0265532210384253
Cheng, L., Watanabe, Y., & Curtis, A. (Eds.). (2004). Washback in language testing: Research contexts and methods. Mahwah, NJ: Lawrence Erlbaum.
Clark, C. M., & Dunn, S. (1991). Second-generation research on teachers’ planning, intentions, and routines. In H. C. Warren & H. J. Walberg (Eds.). Effective teaching: Current research (pp. 183-200). Berkeley, CA: McCatchum.
Covino, E. A., & Iwanicki, E. F. (1996). Experienced teachers: Their constructs of effective teaching. Journal of Personnel Evaluation in Education, 10(4), 325-363. https://doi.org/10.1007/bf00125499
Dorr-Bremme, D. W., & Herman, J. L. (1986). Assessing student achievement: A profile of Classroom Practices. Los Angles: University of California. Author (2010). Author & Author. (2019).
Fish, J. (1988). Responses to mandated standardized testing. (Unpublished PhD dissertation). University of California: Los Angeles.
Gebril, A., & Eid, M. (2017). Test preparation beliefs and practices in a high-stakes context: A teacher’s perspective. Language Assessment Quarterly, 14(4), 360-379. https://doi.org/10.1080/15434303.2017.1353607
Ghorbani, M. R. (2008). The washback effect of the university entrance examination on Iranian English teachers’ curricular planning and instruction. The Iranian EFL Journal, 2(1), 60-87.
Hayes, A. M. (2015). From assessment to instruction: The impact of online formative assessment in reading on teachers’ planning and instruction in the Middle School English Language Arts classroom (Unpublished PhD dissertation). North Carolina State University.
Haynie, G. (2006, April). Effective biology teaching: A value-added instructional improvement analysis model. Retrieved February 7, 2009, from http://www.wcpss.net/results/reports/2006/0528biology.pdf
Herman, J. L. (1989). Priorities of educational testing and evaluation: The testimony of the CRESST National Faculty. Los Angeles: University of California, Center for theStudy of Evaluation. https://doi.org/10.1037/e671972011-001
Herman, J. L., & Dorr-Bremme, D. W. (1983). Uses of testing in the schools: A national profile. New Directions for Testing & Measurement, 19, 7-17.
Herman, J. L. & Golan, S. (1991). Effects of standardized testing on teachers and learning-Another look. (CSE Technical Report 334). Los Angeles: University of California. Center for Research on Evaluation, Standards and Student Testing.
Hosp, J. L., & Ardoin, P. S. (2008). Assessment for instructional planning. Assessment for effective intervention, 33(2) 69-77. https://doi.org/10.1177/1534508407311428
Hughes, A. (1993). Backwash and TOEFL 2000. (Unpublished manuscript). UK: University of Reading.
Linn, R., Grave, & Sanders (1989). Quality of Standard Tests: Final Report. Center for the Study of Evaluation. Los Angeles: University of California press.
Mackey, A., & Gass, S. M. (2005). Second language research methodology and design. New Jersey: Lawrence Erlbaum Associates.
Madaus, G. (1988). The influence of testing on the curriculum. In L. Tanner (Ed.), Critical issues in curriculum: 87th yearbook of the NSSE, Part 1(pp. 100-120). Chicago: University of Chicago Press.
Mehrens, W. A. (1984). National tests and local curriculum: Match or mismatch. Educational measurement: Issues and Practice, 3(3), 9-15. https://doi.org/10.1111/j.1745-3992.1984.tb00757.x
Paris, S. G. (2001). Linking reading assessment and instruction in elementary grades. In C. M. Roller (Ed.), Comprehensive reading instruction across the grade levels (pp. 55-69). Newark, DE: International Reading Association.
Ramezaney, M. (2014). The washack effects of University Entrance Exam on Iranian EFL teachers’ curricular planning and instruction techniques. Procedia-Social and Behavioral Sciences, 98, 1508-1517.
Read, J., & Hayes, B. (2003). The impact of IELTS on preparation for academic study in New Zealand. IELTS Research Reports, 4(5), 153-205.
Reiser, R. A., & Mory, E. H. (1991). An examination of the planning practices of two experienced teachers. Educational Technology Research & Development, 39(3), 71- 82.
Romberg, T. A., Zarinnia, E. A., & Williams, S. R. (1989). The influence of mandated testing on mathematics instruction: Grade 8 teachers’ perceptions. University of Wisconsin-Madison National Center for Research in Mathematical Sciences Education.
Russell, J. M. (1979). Characteristics, Attitudes, and Practices of Teachers in Planning and Implementing Instructional Strategies. Electronic Theses and Dissertations. Paper 2781. http://dc.etsu.edu/etd/2781
Salehi, H., Yunus, M. M., & Salehi, Z. (2012). Teachers’ perceptions of high-stakes tests: A washback study. International Journal of Social Science and Humanity, 2(1), 70-74. https://doi.org/10.7763/ijssh.2012.v2.71
Salmon-Cox, L. (1981). Teachers and standardized achievement tests: What's really happening? The Phi Delta Kappan, 62(9), 631-634
Sardo‐Brown, D. (1990). Experienced teachers’ planning practices: A US survey. Journal of education for teaching, 16(1), 57-71. https://doi.org/10.1080/0260747900160104
Shavelson, R. J. (1987). Planning. In M. J. Dunkin (Ed.). The international encyclopedia of teaching and teacher education (pp. 483-486). New York, NY: Pergamon.
Shepard, L. A. (1990). Inflated test score gains: Is the problem old norms or teaching the test? Educational Measurement: Issues and Practice, 9(3), 15-22. https://doi.org/10.1111/j.1745-3992.1990.tb00374.x
Shohamy, E., Donitsa-Schmidt, A., & Ferman, I (1996). Test impact revisited: Washback effect over time. Language Testing, 13(3), 298-317. https://doi.org/10.1177/026553229601300305
Simsek, H., & Yildirim, A. (2001). The reform of pre-service teacher education in Turkey. In R. G. Sultana (Ed.), Challenge and change in the Euro-Mediterranean region: case studies in educational innovation (pp. 411-430). New York: Peter Lang Publishing Inc.
Smith, M. L., Edelsky, C., Draper, K., Rottenberg, C., & Cherland, M. (1989). The role of testing in elementary schools. Los Angeles, CA: Center for Research on Evaluation, Standards, and Student Testing, University of California.
Spratt, M. (2005). Washback and the classroom: the implications for teaching and learning of studies of washback from exams. Language Teaching Research, 9(1), 5-29.
Stake, R.E. (1988, September). The effect of reforms in assessment in the USA. Paper presented at the annual meeting of the British Educational Association at the University of East Anglia. United Kingdom.
Sultana, N. (2018). A brief review of washback studies in the south Asian countries. The Educational Review, USA, 2(9), 468-474.
Taylor, P. H. (1970). How teachers plan their courses: Studies in curriculum planning. London, England: National Foundation for Educational Research in England and Wales.
Valazza, G. (2008). Impact of TKT on language teachers and schools in Uruguay. Research Notes, 34(4), 21-26.
Watanabe, Y. (1996). Does grammar translation come from the entrance examination? Preliminary findings from classroom-based research. Language Testing, 13(3), 318- 333.
Yildirim, A. (2003). Instructional planning in a centralized school system: Lessons of a study among primary school teachers in Turkey. International Review of Education, 49(5), 525-543.
)