[{"data":1,"prerenderedAt":-1},["ShallowReactive",2],{"doc-seo-158020-105":3,"detail-sidebar-cat-0-en-105":81,"doc-detail-158020-en":131},{"code":4,"msg":5,"data":6},0,"ok",{"site_id":7,"language":8,"slug":9,"title":10,"keywords":11,"description":12,"schema_data":13,"social_meta":74,"head_meta":76,"extra_data":78,"updated_unix":80},105,"en","assessing-listening-on-the-duolingo-english-test-research-report","Assessing Listening on the Duolingo English Test - Research Report","","Operationalizing and measuring listening skill on the Duolingo English Test (DET) is the focus of this Duolingo Research Report (DRR-23-02). The work is grounded in the DET theoretical assessment ecosystem, using an evidence-based Language Assessment Design Framework to define the listening construct domain. It applies a multi-layer framework to specify subskills, cognitive processes, and learner/test attributes, then illustrates how these elements are mapped to DET task types, with an overview of item categories and listening approaches.",{"@graph":14,"@context":73},[15,34,56],{"@type":16,"itemListElement":17},"BreadcrumbList",[18,23,27,31],{"item":19,"name":20,"@type":21,"position":22},"https://docshare.wps.com","Home","ListItem",1,{"item":24,"name":25,"@type":21,"position":26},"https://docshare.wps.com/document/","Document",2,{"item":28,"name":29,"@type":21,"position":30},"https://docshare.wps.com/document/research-report/","Research & Report",3,{"item":32,"name":10,"@type":21,"position":33},"https://docshare.wps.com/document/assessing-listening-on-the-duolingo-english-test-research-report/158020/",4,{"url":32,"name":10,"@type":35,"image":36,"author":41,"headline":10,"publisher":44,"fileFormat":47,"inLanguage":8,"description":12,"dateModified":48,"datePublished":49,"encodingFormat":47,"isAccessibleForFree":50,"interactionStatistic":51},"DigitalDocument",{"url":37,"@type":38,"width":39,"height":40},"https://docshare.wps.com/thumbnails/assessing-listening-on-the-duolingo-english-test-research-report/158020.png","ImageObject",300,407,{"name":42,"@type":43},"Arica Lee","Person",{"url":19,"name":45,"@type":46},"DocShare","Organization","application/pdf","2026-10-18","2026-08-29",true,{"@type":52,"interactionType":53,"userInteractionCount":55},"InteractionCounter",{"@type":54},"ViewAction",14,{"@type":57,"mainEntity":58},"FAQPage",[59,65,69],{"name":60,"@type":61,"acceptedAnswer":62},"How does the report define and operationalize listening on the DET?","Question",{"text":63,"@type":64},"It explains listening within the DET theoretical assessment ecosystem and uses a multi-layered framework to specify the construct domain and how listening elements are operationalized through test tasks.","Answer",{"name":66,"@type":61,"acceptedAnswer":67},"What subskills, processes, and attributes are considered for the listening construct?",{"text":68,"@type":64},"The report considers listening subskills, cognitive processes, and attributes reflecting both task factors and test-taker traits as contributors to the overall listening construct.",{"name":70,"@type":61,"acceptedAnswer":71},"Which DET task types are used to measure listening-related components?",{"text":72,"@type":64},"The report describes listening task types and explains how different listening elements are mapped to DET task types, including dictation and interactive listening item types.","https://schema.org",{"og:url":32,"og:type":75,"og:title":10,"og:site_name":45,"og:description":12},"article",{"robots":77,"canonical":32},"index,follow",{"doc_id":79,"site_id":7},158020,1787993690,{"code":4,"msg":82,"data":83},"success",[84,88,92,96,101,106,111,115,120,123,127],{"id":22,"doc_module":4,"doc_module_name":25,"category_name":85,"show_sort_weight":86,"slug":87},"Story & Novel",90,"story-novel",{"id":26,"doc_module":4,"doc_module_name":25,"category_name":89,"show_sort_weight":90,"slug":91},"Literature",80,"literature",{"id":33,"doc_module":4,"doc_module_name":25,"category_name":93,"show_sort_weight":94,"slug":95},"Exam",70,"exam",{"id":97,"doc_module":4,"doc_module_name":25,"category_name":98,"show_sort_weight":99,"slug":100},5,"Comic",60,"comic",{"id":102,"doc_module":4,"doc_module_name":25,"category_name":103,"show_sort_weight":104,"slug":105},6,"Technology",50,"technology",{"id":107,"doc_module":4,"doc_module_name":25,"category_name":108,"show_sort_weight":109,"slug":110},7,"Healthcare",40,"healthcare",{"id":112,"doc_module":4,"doc_module_name":25,"category_name":29,"show_sort_weight":113,"slug":114},8,30,"research-report",{"id":116,"doc_module":4,"doc_module_name":25,"category_name":117,"show_sort_weight":118,"slug":119},9,"Religion & Spirituality",20,"religion-spirituality",{"id":118,"doc_module":4,"doc_module_name":25,"category_name":121,"show_sort_weight":118,"slug":122},"World Cup","world-cup",{"id":124,"doc_module":4,"doc_module_name":25,"category_name":125,"show_sort_weight":124,"slug":126},10,"Lifestyle","lifestyle",{"id":128,"doc_module":4,"doc_module_name":25,"category_name":129,"show_sort_weight":97,"slug":130},19,"General","general",{"code":4,"msg":82,"data":132},{"doc_id":79,"user_id":133,"nickname":42,"user_avatar":134,"doc_module":4,"category_id":112,"category_name":29,"doc_title":10,"doc_description":12,"doc_content":135,"file_id":136,"file_url":137,"file_type":138,"file_size":139,"view_count":55,"is_deleted":4,"is_public":22,"is_downloadable":22,"audit_status":22,"page_count":124,"language":140,"language_code":8,"site_id":7,"html_lang":8,"table_of_contents":141,"faqs":142,"seo_title":143,"seo_description":12,"update_tm":80,"read_time":144,"preview_page_count":4},8796096645457,"https://ap-avatar.wpscdn.com/avatar/800003749518d68ffe3?x-image-process=image/resize,m_fixed,w_180,h_180&k=1779345340919836971","Assessing Listening on the Duolingo English Test   \nDuolingo Research Report DRR-23-02 Original Version: June 13, 2023 (16 pages)  \nCurrent Version: June 25, 2025 (10 pages)  \n[https://englishtest.duolingo.com/research](https://englishtest.duolingo.com/research)  \nSarah Goodwin∗ and Ben Naismith∗  \nAbstract  \nIn this paper we describe how the language skill of listening is operationalized and measured on the Duolingo English Test (DET) . This work is situated in the DET’s theoretical assessment ecosystem (Burstein et al., 2022), a set of evidence-based frameworks that reflect the iterative processes for assessment design, computational psychometrics, and test security. In this ecosystem, the Language Assessment Design Framework stipulates that the domain for tested constructs be described. To achieve this goal, the present paper is one in an ongoing series of skills construct whitepapers that describes the underpinnings for each language skill construct, in this case for listening (see also Park et al., 2022 for reading; Goodwin et al., 2025 for writing; LaFlair et al., 2025 for interactional competence; Park et al., 2025 for speaking) . The paper first gives background information on the DET. We then describe the DET’s conceptualization of the second language listening construct using the multi-layered framework of Aryadoustand Luo (2022) . Within this framework, we consider how subskills, cognitive processes, attributes (i.e., task and test-taker traits) contribute to the overall listening construct. We also exemplify how these different elements of listening are measured through the DET task types.  \nLast Update: June 2025  \nKeywords  \nDuolingo English Test, testing listening, interactive listening, integrated listening, listening assessment  \nContents  \n1 Introduction ................................................................ 2  \n2 The Duolingo English Test ......................................................... 2  \n2.1 Dictation item type .......................................................... 2  \n2.2 Interactive listening item type .................................................... 3  \n3 Theoretical background .......................................................... 4  \n3.1 General theoretical background ................................................... 4  \n3.2 Listening theoretical background ................................................... 4  \n4 Listening approaches and the DET ..................................................... 5  \n4.1 DET subskills ............................................................. 5  \n4.2 DET processes ............................................................ 6  \n4.3 DET attributes ............................................................ 6  \n5 Summary and future directions ...................................................... 7  \n6 References ................................................................. 9  \n∗ Duolingo, Inc.  \nEmail: [englishtest-research@duolingo.com](englishtest-research@duolingo.com)  \n1 Introduction  \nIn this paper we describe how the language skill of listening is operationalized and measured on the Duolingo English Test (DET) . This work is situated in the DET’s theoretical assessment ecosystem (Burstein et al., 2022), a set of evidence-based frameworks that reflect the iterative processes for assessment design, computational psychometrics, and test security. In this ecosystem, the Language Assessment Design Framework stipulates that the domain for tested constructs be described. To achieve this goal, the present paper is one in an ongoing series of skills construct whitepapers that describes the underpinnings for each language skill construct, in this case for listening (see also Park et al., 2022 for reading; Goodwin et al., 2025 for writing; LaFlair et al., 2025 for interactional competence; Park et al., 2025 for speaking) . The paper first gives background information on the DET. We then describe the DET’s conceptualization of th","cbCaiqzDlfK73MAT","https://ap.wps.com/l/cbCaiqzDlfK73MAT","pdf",946210,"English","# 1 Introduction\n# 2 The Duolingo English Test\n## 2.1 Dictation item type\n## 2.2 Interactive listening item type\n# 3 Theoretical background\n## 3.1 General theoretical background\n## 3.2 Listening theoretical background\n# 4 Listening approaches and the DET\n## 4.1 DET subskills\n## 4.2 DET processes\n## 4.3 DET attributes\n# 5 Summary and future directions\n# 6 References","[{\"question\":\"How does the report define and operationalize listening on the DET?\",\"answer\":\"It explains listening within the DET theoretical assessment ecosystem and uses a multi-layered framework to specify the construct domain and how listening elements are operationalized through test tasks.\"},{\"question\":\"What subskills, processes, and attributes are considered for the listening construct?\",\"answer\":\"The report considers listening subskills, cognitive processes, and attributes reflecting both task factors and test-taker traits as contributors to the overall listening construct.\"},{\"question\":\"Which DET task types are used to measure listening-related components?\",\"answer\":\"The report describes listening task types and explains how different listening elements are mapped to DET task types, including dictation and interactive listening item types.\"}]","Assessing Listening on the Duolingo English Test - Research Report | PDF",25]