Reading in a Foreign Language October 2021 - Volume 33 - Issue 2 - Exploring Task-completion Processes in L2 Reading Assessments

Aug 29, 2026

This study compares how second-language learners complete L2 reading tasks in two test-response formats: multiple-choice questions (MCQ) and short-answer questions (SAQ). Sixteen nonnative English-speaking university students completed both formats and provided retrospective verbal reports through interviews. Results show that, during source-text processing, learners built text and situation models for general comprehension and deeper textual understanding. When answering, question-answering processes reflected the test format, and interactive processing style differed by MCQ versus SAQ. Findings support using varied assessment formats in instruction and test design.

LanguageEnglish

CategoryResearch & Report

FormatPDF

Pages23

Reading Time58 min

AccessFree to download

Abstract

Exploring Task-completion Processes in L2 Reading Assessments: Multiple-choice vs. Short-answer Questions

Review of Relevant Research

Completion processes in MCQ and SAQ reading tasks

Reading in a Foreign Language October 2021, Volume 33, No. 2 ISSN 1539-0578 pp. 168–190 Exploring Task-completion Processes in L2 Reading Assessments: Multiple-choice vs. Short-answer Questions Ray J. T. Liao University of Iowa United States Abstract This study was to compare the processes that second language learners implemented when completing reading tasks in a multiple-choice question format (MCQ) with those in a short-answer question format (SAQ) . Sixteen nonnative English-speaking students from a large Midwestern college in the United States were invited to complete MCQ and SAQ English reading tasks and then to engage in retrospective verbal reporting and semi-structured interviews. Results showed that when processing information in the source texts, students constructed text and situation models to (a) obtain a general understanding of the texts and (b) deepen their textual understanding. As students answered the comprehension questions, their question-answering processes were informed by the test format itself. Moreover, students employed different styles of interactive processing depending on whether they were completing MCQ or SAQ tasks. The implications of the study encourage test developers and teachers to implement a variety of test formats when possible. Keywords: test format, multiple-choice questions, short-answer questions, L2 reading assessment, reading processes, interactive processes, writing about reading The two most common test formats used to assess second language (L2) reading proficiency are multiple-choice questions (MCQs) and short-answer questions (SAQs) . In the MCQ format, test takers are given comprehension questions that provide prescribed options, from which the best answer should be chosen. Rather than offering prescribed options, the SAQ format requires test takers to answer comprehension questions by constructing two to three sentences based on their understanding of the reading passage. MCQs are usually preferred over SAQs because they require less rating time, have no issue regarding interrater reliability, and offer extensive content coverage (Plakans & Gebril, 2015; Qian & Pan, 2013) . Because of the popularity of MCQs, researchers have paid more attention to investigating the effects of MCQs than of SAQs. The present study was thus designed with the purpose of comparing the completion processes elicited by MCQ and SAQ test-response formats. Identifying how MCQs and SAQs differ in terms of the completion process has valuable implications, not only for L2 teaching but also for large-scale and classroom assessments. Review of Relevant Research Completion processes in MCQ andSAQ reading tasks A number of researchers have studied the completion process typical of MCQ reading tasks alone. In a study of 28 English learners in Denmark, Dollerup et al. (1982) interviewed learners about their question-answering processes and found that MCQ reading tasks generally involve two types of reading processes: macro- (obtaining the main idea of a text via a quick reading) and micro- (decoding specific information) levels. To gain a deeper insight into how test takers complete MCQ tasks, Anderson et al. (1991) used verbal reporting to explore strategies implemented by 28 English as a second language (ESL) students when completing MCQ reading tasks. The researchers classified the participants’strategies into five categories: supervising strategies (e.g., recognizing a loss of concentration), support strategies (e.g., skipping unknown words), paraphrase strategies (e.g., translating into first language), test-taking strategies (e.g., random guessing), and strategies for establishing coherence in the text (e.g., using contextual clues to interpret a word or phrase). Among these categories, the test-taking strategy was the most expansive in that it incorporated a wide range of strategies used more frequently than those of other categories. This was especially the case when students

FAQs

What is the main purpose of the study?

To compare the processes second language learners use when completing reading tasks in MCQ versus SAQ formats.

How were participants and tasks organized?

Sixteen nonnative English-speaking students completed both MCQ and SAQ English reading tasks, then produced retrospective verbal reports through semi-structured interviews.

What did the results show about students’ processing during comprehension?

Students constructed text and situation models to achieve general understanding and to deepen textual understanding, and their question-answering processes were shaped by the task format.

How did MCQ and SAQ differ in learners’ interactive processing styles?

Learners employed different interactive processing styles depending on whether they were completing MCQ or SAQ tasks.

Aug 29, 2026

Uploaded by Ava Thompson