[{"data":1,"prerenderedAt":-1},["ShallowReactive",2],{"doc-seo-580177-105":3,"detail-sidebar-cat-0-en-105":81,"doc-detail-580177-en":130},{"code":4,"msg":5,"data":6},0,"ok",{"site_id":7,"language":8,"slug":9,"title":10,"keywords":11,"description":12,"schema_data":13,"social_meta":74,"head_meta":76,"extra_data":78,"updated_unix":80},105,"en","evaluating-21st-century-competencies-in-postsecondary-curricula-with-large-language-models-performance-benchmarking-and-reasoning-based-prompting-strategies","Evaluating 21st-Century Competencies in Postsecondary Curricula with Large Language Models - Performance Benchmarking and Reasoning-Based Prompting Strategies","","The document addresses the need to evaluate how 21st-century competencies are embedded in postsecondary curricula under the accelerating influence of generative AI on society and labor markets. It uses curricular analytics supported by large language models to map courses and curriculum documents to competency frameworks, benchmarks general-purpose LLM performance, and studies systematic error patterns. It proposes a reasoning-based curricular chain-of-thought prompting approach to improve pedagogical reasoning, showing that detailed instructional activity descriptions are most informative, while fine-grained reasoning still falls short of human-level precision.",{"@graph":14,"@context":73},[15,34,56],{"@type":16,"itemListElement":17},"BreadcrumbList",[18,23,27,31],{"item":19,"name":20,"@type":21,"position":22},"https://docshare.wps.com","Home","ListItem",1,{"item":24,"name":25,"@type":21,"position":26},"https://docshare.wps.com/document/","Document",2,{"item":28,"name":29,"@type":21,"position":30},"https://docshare.wps.com/document/research-report/","Research & Report",3,{"item":32,"name":10,"@type":21,"position":33},"https://docshare.wps.com/document/evaluating-21st-century-competencies-in-postsecondary-curricula-with-large-language-models-performance-benchmarking-and-reasoning-based-prompting-strategies/580177/",4,{"url":32,"name":10,"@type":35,"image":36,"author":41,"headline":10,"publisher":44,"fileFormat":47,"inLanguage":8,"description":12,"dateModified":48,"datePublished":49,"encodingFormat":47,"isAccessibleForFree":50,"interactionStatistic":51},"DigitalDocument",{"url":37,"@type":38,"width":39,"height":40},"https://docshare.wps.com/thumbnails/evaluating-21st-century-competencies-in-postsecondary-curricula-with-large-language-models-performance-benchmarking-and-reasoning-based-prompting-strategies/580177.png","ImageObject",300,407,{"name":42,"@type":43},"Theodore","Person",{"url":19,"name":45,"@type":46},"DocShare","Organization","application/pdf","2026-11-15","2026-10-15",true,{"@type":52,"interactionType":53,"userInteractionCount":55},"InteractionCounter",{"@type":54},"ViewAction",9,{"@type":57,"mainEntity":58},"FAQPage",[59,65,69],{"name":60,"@type":61,"acceptedAnswer":62},"Why does the document focus on evaluating 21st-century competencies in postsecondary curricula?","Question",{"text":63,"@type":64},"It explains that 21st-century competencies are increasingly emphasized in higher education, and generative AI has heightened the urgency to verify how well curricula and academic programs align with evolving workforce and societal demands.","Answer",{"name":66,"@type":61,"acceptedAnswer":67},"What dataset and evaluation approach are used for competency analytics?",{"text":68,"@type":64},"It uses 7,600 manually annotated curriculum-competency alignment scores covering 38 competencies and 200 courses across five curriculum document types, then evaluates the informativeness of document sources and benchmarks LLM mapping performance.",{"name":70,"@type":61,"acceptedAnswer":71},"What is the proposed prompting strategy, and what improvements does it bring?",{"text":72,"@type":64},"It introduces a reasoning-based curricular chain-of-thought (CoT) prompting strategy, yielding modest gains by reducing bias from instructional keyword inference and improving detection of nuanced pedagogical evidence in long text.","https://schema.org",{"og:url":32,"og:type":75,"og:title":10,"og:site_name":45,"og:description":12},"article",{"robots":77,"canonical":32},"index,follow",{"doc_id":79,"site_id":7},580177,1792171205,{"code":4,"msg":82,"data":83},"success",[84,88,92,96,101,106,111,115,119,122,126],{"id":22,"doc_module":4,"doc_module_name":25,"category_name":85,"show_sort_weight":86,"slug":87},"Story & Novel",90,"story-novel",{"id":26,"doc_module":4,"doc_module_name":25,"category_name":89,"show_sort_weight":90,"slug":91},"Literature",80,"literature",{"id":33,"doc_module":4,"doc_module_name":25,"category_name":93,"show_sort_weight":94,"slug":95},"Exam",70,"exam",{"id":97,"doc_module":4,"doc_module_name":25,"category_name":98,"show_sort_weight":99,"slug":100},5,"Comic",60,"comic",{"id":102,"doc_module":4,"doc_module_name":25,"category_name":103,"show_sort_weight":104,"slug":105},6,"Technology",50,"technology",{"id":107,"doc_module":4,"doc_module_name":25,"category_name":108,"show_sort_weight":109,"slug":110},7,"Healthcare",40,"healthcare",{"id":112,"doc_module":4,"doc_module_name":25,"category_name":29,"show_sort_weight":113,"slug":114},8,30,"research-report",{"id":55,"doc_module":4,"doc_module_name":25,"category_name":116,"show_sort_weight":117,"slug":118},"Religion & Spirituality",20,"religion-spirituality",{"id":117,"doc_module":4,"doc_module_name":25,"category_name":120,"show_sort_weight":117,"slug":121},"World Cup","world-cup",{"id":123,"doc_module":4,"doc_module_name":25,"category_name":124,"show_sort_weight":123,"slug":125},10,"Lifestyle","lifestyle",{"id":127,"doc_module":4,"doc_module_name":25,"category_name":128,"show_sort_weight":97,"slug":129},19,"General","general",{"code":4,"msg":82,"data":131},{"doc_id":79,"user_id":132,"nickname":42,"user_avatar":133,"doc_module":4,"category_id":112,"category_name":29,"doc_title":10,"doc_description":12,"doc_content":134,"file_id":135,"file_url":136,"file_type":137,"file_size":138,"view_count":55,"is_deleted":4,"is_public":22,"is_downloadable":22,"audit_status":22,"page_count":113,"language":139,"language_code":8,"site_id":7,"html_lang":8,"table_of_contents":140,"faqs":141,"seo_title":142,"seo_description":12,"update_tm":143,"read_time":144,"preview_page_count":4},7971461740886,"https://ap-avatar.wpscdn.com/davatar_3d24733baf745e90a7e4bdd5f77d97b2","Volume 13(1), 7–30. [https://doi.org//10.18608/jla.2026.9127](https://doi.org//10.18608/jla.2026.9127)  \nEvaluating 21st-Century Competencies in Postsecondary Curricula with Large Language Models: Performance Benchmarking and Reasoning-Based Prompting Strategies  \nZhen Xu 1 , Xin Guan2†, Chenxi Shi3†, Qinhao Chen4 , Renzhe Yu5*  \nAbstract  \nThe growing emphasis on 21st-century competencies in postsecondary education, intensified by the transformative impact of generative artificial intelligence (GenAI) on the economy and society, underscores the urgent need to evaluate how they are embedded in curricula and how effectively academic programs align with evolving workforce and societal demands. Curricular analytics, particularly recent advancements powered by GenAI, offer a promising data-driven approach to this challenge. However, the analysis of 21st-century competencies requires pedagogical reasoning beyond surface-level information retrieval, and the capabilities of large language models (LLMs) in this context remain underexplored. In this study, we extend prior research on curricular analytics of 21st-century competencies across a broader range of curriculum documents, competency frameworks, and models. Using 7,600 manually annotated curriculum-competency alignment scores (38 competencies and 200 courses across five curriculum document types), we evaluate the informativeness of different curriculum document sources, benchmark the performance of general-purpose LLMs on mapping curricula to competencies, and analyze error patterns. We further introduce a reasoning-based prompting strategy, curricular chain-of-thought (CoT), to strengthen LLMs’pedagogical reasoning. Our results show that detailed instructional activity descriptions are the most informative typeof curriculum document for competency analytics. Open-weight LLMs achieve accuracy comparable to proprietary models on coarse-grained tasks, demonstrating their scalability and cost-effectiveness for institutional use. However, no model reaches human-level precision in fine-grained pedagogical reasoning. Our proposed curricular CoT yields modest improvements by reducing bias in instructional keyword inference and improving the detection of nuanced pedagogical evidence in long text. Together, these findings highlight the untapped potential of institutional curriculum documents and provide an empirical foundation for advancing AI-driven curricular analytics.  \n\n| \u003Cbr>Notes for Practice\u003Cbr>• Existing curriculum documents in digital formats are a promising yet underutilized resource for postsecondary institutions to assess the integration of 21st-century competencies in course design. Institutions may benefit the most from combining multiple data sources to ensure adequate coverage of key pedagogical elements.\u003Cbr>• Large language models (LLMs) perform reasonably well in coarse-grained competency analytics, with openweight models achieving performance comparable to proprietary ones. However, none of the models reach human-level precision, with two common error patterns: biased inference from instructional keywords in short texts and difficulty identifying nuanced pedagogical evidence in long, unstructured documents.\u003Cbr>• The proposed curricular chain-of-thought (CoT) prompting yields modest performance gains and reduces hallucination by guiding LLMs to extract key instructional elements prior to reasoning, improving the reliability of pedagogical inference, particularly for more advanced models. |\n| --- |\n| Keywords\u003Cbr>Curricular analytics, 21st-century competency, large language models (LLMs), prompt engineering, chain of thought (CoT) .\u003Cbr>Submitted: 09/02/2025 —Accepted: 22/12/2025 —Published: 25/02/2026 |\n\n1 Email: [zx2393@tc.columbia.edu](zx2393@tc.columbia.edu) Address: Teachers College, Columbia University, New York, New York, United States. ORCID iD: [https:// orcid.org/ 0009-0004-3131-910X](https:// orcid.org/ 0009-0004-3131-910X)  \n2 Email: [xg2413@tc.columbia.edu](x","cbCaiiq616fQMroq","https://ap.wps.com/l/cbCaiiq616fQMroq","pdf",2152688,"English","# Abstract\n# Introduction\n# Notes for Practice\n# Keywords and Publication Information","[{\"question\":\"Why does the document focus on evaluating 21st-century competencies in postsecondary curricula?\",\"answer\":\"It explains that 21st-century competencies are increasingly emphasized in higher education, and generative AI has heightened the urgency to verify how well curricula and academic programs align with evolving workforce and societal demands.\"},{\"question\":\"What dataset and evaluation approach are used for competency analytics?\",\"answer\":\"It uses 7,600 manually annotated curriculum-competency alignment scores covering 38 competencies and 200 courses across five curriculum document types, then evaluates the informativeness of document sources and benchmarks LLM mapping performance.\"},{\"question\":\"What is the proposed prompting strategy, and what improvements does it bring?\",\"answer\":\"It introduces a reasoning-based curricular chain-of-thought (CoT) prompting strategy, yielding modest gains by reducing bias from instructional keyword inference and improving detection of nuanced pedagogical evidence in long text.\"}]","Evaluating 21st-Century Competencies in Postsecondary Curricula with Large Language Models - Performance Benchmarking and Reasoning-Based Prompting Strategies | PDF",1792037097,76]