What Test-takers Do When Taking a Rational Cloze Test: A Cognitive Processing Model of Reading
Article Sidebar
Main Article Content
Abstract
One main concern of a test is whether it tests what it is supposed to test. The primary aim of this study was to explore the construct being measured in a rational cloze test. Stimulated recall data produced by 16 proficient participants taking four parallel test forms were analyzed to determine the cognitive processes used to complete a rational cloze test. Based on Khalifa and Weir’s (2009) model of cognitive processing in reading, the findings across the four test forms showed that slow and careful reading at global and local level were the most frequently-used strategies, and the two sources of knowledge used to complete the items were lexical and grammatical, suggesting that rational cloze tasks tap into the constructs of vocabulary and grammar knowledge and careful reading at both global and local level.
Article Details
This work is licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License.
ข้อความรู้ใดๆ ตลอดจนข้อคิดเห็นใดๆ เป็นของผู้เขียนแต่ละท่านโดยเฉพาะ คณะมนุษยศาสตร์ มหาวิทยาลัยนเรศวร และกองบรรณาธิการวารสารมนุษยศาสตร์ฯ ไม่จำเป็นต้องเห็นพ้องด้วย
References
Alderson, J.C. (1979). The cloze procedure and proficiency in English as a foreign language. TESOL Quarterly, 13(2), 219-223.
Alderson, J.C. (2000). Assessing reading. Cambridge: Cambridge University Press.
Anderson, N. J., Bachman, L., Perkins, K. & Cohen, A. (1991). An exploratory study into the construct validity of a reading comprehension test: triangulation of data sources, Language Testing, 8(1), 41-66.
Bachman, L.F. (1985). Performance on the cloze test with fixed-ratio and rational deletions. TESOL Quarterly, 19(3), 535-556.
Bax, S. (2013). The cognitive processing of candidates during reading tests: Evidence from eye-tracking. Language Testing, 30(4), 441-465.
Brunfaut, T. & McCray, G. (2015). Looking into test-takers’ cognitive processing while completing reading tasks: A mixed-method eye-tracking and stimulated recall study. British Council English Language Assessment Research Group.
Gass, S. M. & Mackey, A. (2017). Stimulated recall methodology in applied linguistic and L2 research. New York: Routledge.
Green, A. (1998). Verbal protocol analysis in language testing research: A handbook. In M. Milanovic (Ed.), Studies in Language Testing 5 (pp. 1-175). Cambridge: Cambridge University Press.
Khalifa, H. & Weir, C. J. (2009). Examining reading: Research and practice in assessing second language reading. In M. Milanovic & C.J. Weir (Eds.), Studies in Language Testing 29: Examining reading (pp.1-342). Cambridge: Cambridge University Press.
McCray, G., & Brunfaut, T. (2018). Investigating the construct measured by banked gap-fill items: Evidence from eye-tracking. Language Testing, 35(1), 51–73.
Read, J. (2000). Assessing vocabulary. Cambridge: Cambridge University Press.
Rupp, A. A., Ferne, T., & Choi, H. (2006). How assessing reading comprehension with multiple-choice questions shapes the construct: A cognitive processing perspective. Language Testing, 23(4), 441-474.
Storey, P. (1997). Examining the test-taking process: A cognitive perspective on the discourse cloze test. Language Testing, 14(2), 214-231.
Weir, C. J. (2005). Language testing and validation: An evidence-based approach. Basingstoke: Palgrave Macmillan.
Weir, C. J. (2013). The measurement of reading ability 1913-2012. In M. Milanovic & C.J. Weir (Eds.), Studies in Language Testing 37: Measured constructs (pp.103-256), Cambridge: Cambridge University Press.
Weir, C., Hawkey, R., Green, A., & Devi, S. (2012). The cognitive processes underlying the academic reading as measured by IELTS the academic reading construct as measured by IELTS and the reading experiences of students in their first year of study at a British university. In L. Taylor & C.J. Weir (Eds.), Studies in Language Testing 34: IELTS collected papers (pp.212-269). Cambridge: Cambridge University Press.
Yamashita, J. (2003). Processes of taking a gap-filling test: Comparison of skilled and less skilled EFL readers. Language Testing, 20(3), 267-293.
