Corpus-Based Identification and Profiling of Vocabulary in Linguaskill Speaking Tests - A Methodological Framework for Adaptive Test Validation

Sep 30, 2026

Computer-adaptive tests such as Cambridge Linguaskill adjust item difficulty dynamically to match test-taker proficiency, and their speaking components are now used for high-stakes admission and exit decisions, including in Malaysian higher education. Yet little research has examined the vocabulary load and lexical demands of adaptive speaking assessment, leaving open whether the vocabulary elicited at each reported level aligns with the Common European Framework of Reference (CEFR). This article develops a corpus-based framework for vocabulary identification, classification, and CEFR-aligned profiling. It specifies corpus compilation across CEFR strata, multi-lens analysis via LexTutor, New General Service List coverage, and Text Inspector against the English Vocabulary Profile, and decision rules to judge alignment, over- or under-demanding levels using spoken-English threshold benchmarks. The protocol is grounded in argument-based validation and addresses washback, fairness, and pedagogical stakes.

LanguageEnglish

CategoryResearch & Report

FormatPDF

Pages18

Reading Time45 min

AccessFree to download

Introduction

Adaptive language testing and CEFR-linked scoring

Argument-based validation and the vocabulary link

Lexical demand profiling under adaptivity

Corpus-Based Identification and Profiling of Vocabulary in Linguaskill Speaking Tests: A Methodological Framework for Adaptive Test Validation Rosatiqah Yahya1, Ng Yu Jin1*, Mallika Vasugi A/P V. Govindarajoo2, Kew Si Na3 and Pipit Rahayu4 1UNITAR University College Kuala Lumpur, Malaysia 2UNITAR International University, Malaysia 3Universitiy Teknologi Malaysia, Malaysia 4Universitas Pasir Pengaraian, Indonesia *Corresponding Author DOI: [https://doi.org/10.47772/IJRISS.2026.100701181](https://doi.org/10.47772/IJRISS.2026.100701181) Received: 26 July 2026; Accepted: 31 July 2026; Published: 24 August 2026 ABSTRACT Computer-adaptive tests such as Cambridge Linguaskill adjust item difficulty dynamically to match test-taker proficiency, and their speaking components are now used for high-stakes admission and exit decisions, including in Malaysian higher education. Yet little research has examined the vocabulary load and lexical demands of adaptive speaking assessment, leaving open whether the vocabulary elicited at each reported level is congruent with the Common European Framework of Reference (CEFR) levels the scores claim to represent. This article develops a complete corpus-based methodological framework for identifying, classifying, and profiling the vocabulary of the Linguaskill Speaking Test. The framework specifies the compilation of a specialised corpus of transcribed candidate responses stratified across CEFR levels, supplemented by official test preparation materials, and a three-lens profiling procedure using LexTutor for BNC-COCA word-family analysis, the New General Service List for high-frequency lemma coverage, and Text Inspector for CEFR-aligned profiling against the English Vocabulary Profile. Operational criteria are defined for distinguishing core from peripheral vocabulary at each adaptive level, and decision rules are specified for classifying each level as aligned, overdemanding, or under-demanding relative to CEFR expectations, benchmarked against published lexical coverage thresholds for spoken English. The central hypothesis, motivated by prior coverage research, is that the lexical demands elicited by adaptive speaking tasks will not rise in step with claimed CEFR levels. The framework is grounded in an argument-based approach to validation and articulates the washback, fairness, and pedagogical stakes of the alignment question. The article contributes a replicable protocol for lexical validation of adaptive speaking tests and a benchmark synthesis for interpreting its future results. Keywords: Linguaskill speaking vocabulary; LexTutor; Text Inspector; corpus-based approach; vocabulary threshold; CEFR alignment; adaptive assessment INTRODUCTION Language testing has moved decisively online, and with it has come the rise of computer-adaptive assessment. Tests such as Cambridge Linguaskill adjust the difficulty of what candidates encounter in real time, tailoring the measurement to the individual rather than administering a fixed form to all (Chapelle & Voss, 2016) . The efficiency gains are considerable: shorter tests, faster results, and score reports mapped directly onto the levels of the Common European Framework of Reference for Languages (CEFR) . These properties have carried adaptive tests into high-stakes use. In Malaysia, Linguaskill has been recognised by the Ministry of Higher Education for university admission purposes since 2020 and is used by institutions for admission benchmarking Page 17207 [www.rsisinternational.org](www.rsisinternational.org) and exit requirements alongside the Malaysian University English Test, a context in which the meaning of a reported CEFR level carries direct consequences for students' progression. A reported CEFR level is a claim, and claims require validation. The argument-based approach to test validation holds that every link in the chain from performance to score to interpretation to use must be supported by evidence (Kane,

FAQs

What issue does the article address in Linguaskill speaking assessments?

It examines whether the vocabulary elicited by adaptive speaking tasks is congruent with the CEFR levels claimed in score reports, despite limited prior scrutiny of lexical demands in adaptive speaking.

How does the proposed framework identify and profile vocabulary?

It compiles a specialized corpus of transcribed candidate responses stratified across CEFR levels, then applies a three-lens procedure using LexTutor for word-family analysis, the New General Service List for high-frequency lemma coverage, and Text Inspector for CEFR-aligned profiling against the English Vocabulary Profile.

What decision criteria are defined for CEFR alignment?

Operational criteria distinguish core versus peripheral vocabulary at each adaptive level, and decision rules classify each level as aligned, overdemanding, or under-demanding relative to CEFR expectations using benchmark lexical coverage thresholds for spoken English.

Sep 30, 2026

Upload by Olivia Brown