[{"data":1,"prerenderedAt":-1},["ShallowReactive",2],{"doc-detail-86000-en":3,"doc-seo-86000-105":30,"detail-sidebar-cat-0-en-105":91},{"code":4,"msg":5,"data":6},0,"success",{"doc_id":7,"user_id":8,"nickname":9,"user_avatar":10,"doc_module":4,"category_id":11,"category_name":12,"doc_title":13,"doc_description":14,"doc_content":15,"file_id":16,"file_url":17,"file_type":18,"file_size":19,"view_count":20,"is_deleted":4,"is_public":21,"is_downloadable":21,"audit_status":21,"page_count":22,"language":23,"language_code":24,"site_id":25,"html_lang":24,"table_of_contents":26,"faqs":27,"seo_title":13,"seo_description":14,"update_tm":28,"read_time":29},86000,1374391975076,"Riley","https://ap-avatar.wpscdn.com/avatar/14000253ca4ec9f6853?x-image-process=image/resize,m_fixed,w_180,h_180&k=1783305029341752051",8,"Research & Report","Commenting with Copilot: A Taxonomy and Multi-Year Analysis of Student Code-Generation Specifications","AI code-generation tools embedded in programming environments shift students from writing code to specifying intended behavior in natural language. However, the specifications students provide via comments remain understudied. This study analyzes a four-year dataset of undergraduate submissions and reflections from tasks where students used comments to guide GitHub Copilot, iteratively refining solutions with test-case feedback. A taxonomy spans comment type, code expression level, and targeted code construct, enabling automated analysis of changes across attempts.","Commenting with Copilot: A Taxonomy and Multi-Year Analysis of Student Code-Generation Specifications  \nNasser Giacaman  \nUniversity of Auckland Auckland, New Zealand [n.giacaman@auckland.ac.nz](n.giacaman@auckland.ac.nz)  \nValerio Terragni  \nUniversity of Auckland Auckland, New Zealand [v.terragni@auckland.ac.nz](v.terragni@auckland.ac.nz)  \nPaul Denny University of Auckland Auckland, New Zealand [paul@cs.auckland.ac.nz](paul@cs.auckland.ac.nz)  \nViraj Kumar  \nUniversity of New South Wales Bengaluru, India [viraj.kumar1@unsw.edu.au](viraj.kumar1@unsw.edu.au)  \narXiv :2607 . 10674v 1 [ cs . SE] 12 Jul 2026  \nAbstract  \nAs AI code tools become integrated into programming environments, students increasingly describe intended behavior in natural language and rely on these tools to generate code, shifting emphasis from code writing to specification. Yet little is known about the comments students write as specifications in AI-assisted programming tasks. We analyze a four-year dataset of undergraduate programming submissions and reflections from tasks in which students wrote comments to guide code generation and refined solutions using test-case feedback. We introduce a taxonomy spanning three dimensions: comment type, code expression level, and code construct. Using automated classification, we examine how these dimensions vary across attempts and how students describe the process in their reflections. Our findings show that students mostly wrote naturallanguage What comments, shifted toward How comments for more procedural constructs, and focused more on verifying generated code than on repeatedly rewriting comments.  \nCCS Concepts  \n• Social and professional topics → Computing education.  \nKeywords  \nAI-assisted programming, Code comprehension, Code generation, GitHub Copilot, Student comments  \nACM Reference Format:  \nNasser Giacaman, Valerio Terragni, Paul Denny, and Viraj Kumar. 2026. Commenting with Copilot: A Taxonomy and Multi-Year Analysis of Student Code-Generation Specifications. In Proceedings of the 2nd ACM Virtual Global Computing Education Conference V.1 (SIGCSE Virtual 2026), November 12–15, 2026, Virtual Event, USA. ACM, New York, NY, USA, 7 pages. [https:](https:)//[doi.org/10.1145/3795867.3830978](doi.org/10.1145/3795867.3830978)  \n1 Introduction  \nAI code-generation tools are increasingly integrated into programming environments [33], changing the skills students need when  \nThis work is licensed under a Creative Commons Attribution 4 .0 International License. SIGCSE Virtual 2026, Virtual Event, USA  \n© 2026 Copyright held by the owner/author(s) .  \nACM ISBN 979-8-4007-2506-7/2026/11  \n[https://doi.org/10.1145/3795867.3830978](https://doi.org/10.1145/3795867.3830978)  \nlearning to program [25] . Rather than writing every line, students can describe intended behavior in natural language and rely on AI tools to generate candidate implementations [7]. This has motivated new tasks in computing education. Prompt Problems ask students to solve tasks by writing prompts that elicit correct solutions from a code-generating model [8], while dialogue-based prompt programming environments support iterative natural-language interaction with AI models [27] . Other work asks students to clarify ambiguous specifications before prompting AI to generate solutions [24] .  \nHowever, this skill is not straightforward for novices. Students can struggle to describe their intent, evaluate generated code, and revise prompts when the output is incorrect [13, 20] . Different patterns ofAI use may have different implications for learning, with hybrid approaches involving human judgment and verification appearing more promising than simply asking an AI tool for complete solutions [16] . There are also concerns that over-reliance on AI might harm core skills such as code reading and comprehension.  \nIn this paper, we analyze student-written comments from four years of an AI-assisted programming activity in an undergraduate object-oriented p","cbCaiob6khFpNwOH","https://ap.wps.com/l/cbCaiob6khFpNwOH","pdf",597699,4,1,7,"English","en",105,"# Introduction\n# Related Work\n## AI Prompting and Code Generation\n## Study Overview and Research Questions","[{\"question\":\"What is the main focus of the study on Copilot-assisted programming tasks?\",\"answer\":\"The study focuses on the comments students write as natural-language specifications to guide AI code generation, and how those comments change across attempts and code constructs.\"},{\"question\":\"What data source does the paper analyze?\",\"answer\":\"It analyzes a four-year dataset consisting of undergraduate programming submissions and student reflections from an AI-assisted object-oriented programming activity using GitHub Copilot.\"},{\"question\":\"What taxonomy dimensions does the paper introduce for categorizing student comments?\",\"answer\":\"The taxonomy characterizes each comment by its purpose, the level of code-like expression, and the targeted code construct.\"}]",1784207688,18,{"code":4,"msg":31,"data":32},"ok",{"site_id":25,"language":24,"slug":33,"title":13,"keywords":34,"description":14,"schema_data":35,"social_meta":86,"head_meta":88,"extra_data":90,"updated_unix":28},"commenting-with-copilot-a-taxonomy-and-multi-year-analysis-of-student-code-generation-specifications","",{"@graph":36,"@context":85},[37,53,68],{"@type":38,"itemListElement":39},"BreadcrumbList",[40,44,48,51],{"item":41,"name":42,"@type":43,"position":21},"https://docshare.wps.com","Home","ListItem",{"item":45,"name":46,"@type":43,"position":47},"https://docshare.wps.com/document/","Document",2,{"item":49,"name":12,"@type":43,"position":50},"https://docshare.wps.com/document/research-report/",3,{"item":52,"name":13,"@type":43,"position":20},"https://docshare.wps.com/document/commenting-with-copilot-a-taxonomy-and-multi-year-analysis-of-student-code-generation-specifications/86000/",{"url":52,"name":13,"@type":54,"author":55,"headline":13,"publisher":57,"fileFormat":60,"inLanguage":24,"description":14,"dateModified":61,"datePublished":62,"encodingFormat":60,"isAccessibleForFree":63,"interactionStatistic":64},"DigitalDocument",{"name":9,"@type":56},"Person",{"url":41,"name":58,"@type":59},"DocShare","Organization","application/pdf","2026-07-26","2026-07-16",true,{"@type":65,"interactionType":66,"userInteractionCount":20},"InteractionCounter",{"@type":67},"ViewAction",{"@type":69,"mainEntity":70},"FAQPage",[71,77,81],{"name":72,"@type":73,"acceptedAnswer":74},"What is the main focus of the study on Copilot-assisted programming tasks?","Question",{"text":75,"@type":76},"The study focuses on the comments students write as natural-language specifications to guide AI code generation, and how those comments change across attempts and code constructs.","Answer",{"name":78,"@type":73,"acceptedAnswer":79},"What data source does the paper analyze?",{"text":80,"@type":76},"It analyzes a four-year dataset consisting of undergraduate programming submissions and student reflections from an AI-assisted object-oriented programming activity using GitHub Copilot.",{"name":82,"@type":73,"acceptedAnswer":83},"What taxonomy dimensions does the paper introduce for categorizing student comments?",{"text":84,"@type":76},"The taxonomy characterizes each comment by its purpose, the level of code-like expression, and the targeted code construct.","https://schema.org",{"og:url":52,"og:type":87,"og:title":13,"og:site_name":58,"og:description":14},"article",{"robots":89,"canonical":52},"index,follow",{"doc_id":7,"site_id":25},{"code":4,"msg":5,"data":92},[93,97,101,105,110,115,119,122,127,130,134],{"id":21,"doc_module":4,"doc_module_name":46,"category_name":94,"show_sort_weight":95,"slug":96},"Story & Novel",90,"story-novel",{"id":47,"doc_module":4,"doc_module_name":46,"category_name":98,"show_sort_weight":99,"slug":100},"Literature",80,"literature",{"id":20,"doc_module":4,"doc_module_name":46,"category_name":102,"show_sort_weight":103,"slug":104},"Exam",70,"exam",{"id":106,"doc_module":4,"doc_module_name":46,"category_name":107,"show_sort_weight":108,"slug":109},5,"Comic",60,"comic",{"id":111,"doc_module":4,"doc_module_name":46,"category_name":112,"show_sort_weight":113,"slug":114},6,"Technology",50,"technology",{"id":22,"doc_module":4,"doc_module_name":46,"category_name":116,"show_sort_weight":117,"slug":118},"Healthcare",40,"healthcare",{"id":11,"doc_module":4,"doc_module_name":46,"category_name":12,"show_sort_weight":120,"slug":121},30,"research-report",{"id":123,"doc_module":4,"doc_module_name":46,"category_name":124,"show_sort_weight":125,"slug":126},9,"Religion & Spirituality",20,"religion-spirituality",{"id":125,"doc_module":4,"doc_module_name":46,"category_name":128,"show_sort_weight":125,"slug":129},"World Cup","world-cup",{"id":131,"doc_module":4,"doc_module_name":46,"category_name":132,"show_sort_weight":131,"slug":133},10,"Lifestyle","lifestyle",{"id":135,"doc_module":4,"doc_module_name":46,"category_name":136,"show_sort_weight":106,"slug":137},19,"General","general"]