Monster, P.I. - Validation Evidence for an Assessment of Adolescent Language

Oct 15, 2026

Uploaded by Aran

Validation evidence supports Monster, P.I., a gamified, standardized computer-adaptive language assessment for fifth to eighth grade students. The study examines morphology and vocabulary dimensionality and syntax structure using multiple-group item response theory with 3,214 students. Bifactor models best represent morphology and vocabulary, while syntax shows unidimensionality. Results show moderate score correlations among components and links to reading vocabulary and comprehension, with hierarchical regression explaining 56%–75% of variance.

LanguageEnglish

CategoryResearch & Report

FormatPDF

Pages12

Reading Time30 min

AccessFree to download

Abstract

Keywords

Background: Language and Reading Comprehension

Need for Scalable Language Assessments

Model of Language

Link to Instruction and Assessment Efficiency

Monster, P.I.: Validation Evidence for an Assessment of Adolescent Language That Assesses Vocabulary Knowledge, Morphological Knowledge, and Syntactical Awareness Assessment for Effective Intervention 2022, Vol. 47(2) 89–100 © Hammill Institute on Disabilities 2020 Article reuse guidelines: [sagepub.com/journals-permissions](sagepub.com/journals-permissions)[ ](sagepub.com/journals-permissions)[DOI: 10.1177/1534508420966383](DOI: 10.1177/1534508420966383)[ ](DOI: 10.1177/1534508420966383)[aei.sagepub.com](aei.sagepub.com) Amanda P. Goodwin, PhD 1, Yaacov Petscher, PhD2, Jamie Tock, PhD2, Sara McFadden, BA 1, Dan Reynolds, PhD3, Tess Lantos, PhD 1, and Sara Jones, MEd 1 Abstract Assessment of language skills for upper elementary and middle schoolers is important due to the strong link between language and reading comprehension. Yet, currently few practical, reliable, valid, and instructionally informative assessments of language exist. This study provides validation evidence for Monster, P.I., which is a gamified, standardized, computeradaptive assessment (CAT) of language for fifth to eighth grade students. Creating Monster, P.I. involved an assessment of the dimensionality of morphology and vocabulary and an assessment of syntax. Results using multiple-group item response theory (IRT) with 3,214 fifth through eighth graders indicated morphology and vocabulary were best assessed via bifactor models and syntax unidimensionally. Therefore, Monster, P.I. provides scores on three component areas of language (multidimensional morphology and vocabulary and unidimensional syntax) with the goal of informing instruction. Validity results also suggest that Monster, P.I. scores show moderate correlations with each other and with standardized reading vocabulary and reading comprehension assessments. Furthermore, hierarchical regression results suggest an important link between Monster, P.I. and standardized reading comprehension, explaining between 56% and 75% of the variance. Such results indicate that Monster, P.I. can provide meaningful understandings of language performance which can guide instruction that can impact reading comprehension performance. Keywords language, achievement assessment Language knowledge has an intricate relationship with reading comprehension. Theories like the Simple View of Reading (Gough & Tumner, 1986) separate reading comprehension into decoding and linguistic comprehension. As students get older, the contribution of decoding decreases and the role of language increases (García & Cain, 2014) . This stems from challenging language demands present in middle school academic texts. Simply put, it is easier to learn to sound out the 200,000 words in academic texts (Nagy & Anderson, 1984) than it is to learn their multiple, nuanced meanings and apply those meanings to parsing ideas conveyed via complex syntactical structures (Nagy & Townsend, 2012) . There are many ways to assess language, but few assessments are used at scale (Adlof & Hogan, 2019; Hart et al., 2015) .1 This is because “the presumed multidimensionality of language ability has practical import” (Language and Reading Research Consortium [LARRC], 2015, p. 1948) such that tests with multiple subtests in different language areas are used for the diagnosis of language disorders rather than to inform general instruction. As an alternative, we provide validation information for a language assessment that uses technology to tackle this complexity to provide scores that inform instruction for a broad swath of students. 1 Vanderbilt University’s Peabody College, Nashville, TN, USA 2Florida State University, Tallahassee, USA 3John Carroll University, University Heights, OH, USA Corresponding Author: Amanda P. Goodwin, Vanderbilt University’s Peabody College, 230 Appleton Pl., Nashville, TN 37203, USA. Email: [amanda.goodwin@vanderbilt.edu](amanda.goodwin@vanderbilt.edu) The assessment is more efficient as it is computer-ad

FAQs

What is Monster, P.I.?

Monster, P.I. is a gamified, standardized computer-adaptive language assessment for fifth to eighth grade students.

How did the study evaluate the structure of language skills?

It used multiple-group item response theory to assess morphology and vocabulary dimensionality and to test syntax dimensionality.

What relationships did the study find between Monster, P.I. scores and reading outcomes?

Monster, P.I. scores showed moderate correlations with standardized reading vocabulary and reading comprehension, and hierarchical regression linked Monster, P.I. with reading comprehension, explaining 56%–75% of the variance.

Oct 15, 2026

Uploaded by Aran