[{"data":1,"prerenderedAt":-1},["ShallowReactive",2],{"doc-detail-240336-en":3,"doc-seo-240336-105":30,"detail-sidebar-cat-1-en-105":96},{"code":4,"msg":5,"data":6},0,"success",{"doc_id":7,"user_id":8,"nickname":9,"user_avatar":10,"doc_module":11,"category_id":12,"category_name":13,"doc_title":14,"doc_description":15,"doc_content":16,"file_id":17,"file_url":18,"file_type":19,"file_size":20,"view_count":21,"is_deleted":4,"is_public":11,"is_downloadable":11,"audit_status":11,"page_count":22,"language":23,"language_code":24,"site_id":25,"html_lang":24,"table_of_contents":26,"faqs":27,"seo_title":28,"seo_description":15,"update_tm":29,"read_time":21},240336,962075114765,"Quinn","https://ap-avatar.wpscdn.com/davatar_a8503ba1806abce46bf441b54a3ca4cd",1,158,"General","CS224R Spring 2026 Deep Reinforcement Learning Custom Project Guidelines","CS224R Spring 2026 Deep Reinforcement Learning Custom Project Guidelines defines how students design and execute a novel reinforcement-learning research study. The project must deliver genuine novelty by addressing open-ended literature gaps, introducing justified non-trivial algorithm or component modifications, or applying methods to underexplored domains with non-trivial adaptation. Expectations include analyzing success and failure modes, submitting proposal and milestone reports on fixed deadlines, preparing a poster presentation, and finalizing a comprehensive report with specified formatting and honor-code compliance.","CS224R Spring 2026 Deep Reinforcement Learning Custom Project Guidelines  \nContents  \n1 Requirements and Expected Outcome 2  \n2 Important Information 2  \n2.1 Timeline and Grading ............................... 2  \n2.2 Project Mentors ................................... 3  \n2.3 Project Groups .................................... 5  \n2.4 Past Projects ..................................... 5  \n2.5 Contributions . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 5  \n2.6 Honor Code and AI Tools Policy . . . . . . . . . . . . . . . . . . . . . . . . . 5  \n2.7 Submission Format . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 6  \n2.8 Using Late Days ................................... 6  \n2.9 Computing Resources ............................... 6  \n3 Project Survey (Due 4/22/26) 7  \n4 Project Proposal (Worth 4% – Due 5/1/26) 8  \n5 Milestone Report (Worth 5% – Due 5/22/26) 9  \n6 Poster Presentation (Worth 8% – Due 6/3/26-9:30am-1.45 pm) 10  \n7 Final Report (Worth 18% – Due 6/8/26) 11  \n1 Requirements and Expected Outcome  \nThe final project requires implementing, evaluating, and documenting a novel research study related to one of the main topics of the course.  \nThe novelty should entail at least ONE property below:  \n• Answering an open-ended question that is unanswered or partially answered in the existing literature. For example, exploring a new method of your own or one left for future works by a prior paper.  \n• Designing a method that proposes non-trivial modifications at the component or algorithm level with proper justifications. The modifications may not lead to improvements in all dimensions. For example, a method may lead to higher efficiency but degraded performance. However, we expect analysis of the failure modes to be provided.  \n• Applying a (new or existing) method to an underexplored application domain where the adaptation is non-trivial. For example, adapting an RL algorithm to new environments, where different constraints require certain modification.  \nFor all projects, regardless of the performance, we expect the project to offer new insights that shed light on the success or failure modes of an idea.  \nThe novelty does NOT require:  \n• Building a new method that meets the standard of machine learning conferences (though some projects may become research papers in the future!) .  \n• Achieving state-of-the-art performance.  \nIn light of the above goals, students are expected to prepare a proposal, prepare a milestone report, present their work in the final poster session, and submit the final report, with specific details as outlined in this document1 .  \n2 Important Information  \n2.1 Timeline and Grading  \nThe project will count for 35% of the course grade in total. Each component of the final project will be due to Gradescope2 by 9 p.m on the dates in Figure 1.  \n1This document should serve as your go-to resource for any and all information regarding the final project. If and when updates are made to this document, the course staff will notify the entire class immediately and detail the changes.  \n2With the exceptions of the project survey through Google Forms and the in-person poster session.  \nFigure 1: Project Timeline and Grade Distribution.  \n\n|  |  |  Table 1: Poster Session Schedule and Deadlines  |  |  |  |\n| --- | --- | --- | --- | --- | --- |\n| Date | Time |  | Event/Deadline | Participants |  |\n| June 3 | 9:00 AM |  | Gradescope deadline to submit videos | All-CGOE project groups |  |\n|  | 9:00 AM |  | Gradescope deadline to submit posters | All project groups |  |\n|  | 9. 15 AM-9.30 AM |  | Session A check-in | Session A groups |  |\n|  | 9.30 AM-11.30 AM |  | Session A presentations | Session A groups |  |\n|  | 11.30 AM-11.45 AM |  | Session B check-in | Session B groups |  |\n|  | 11.45 AM-1.45 PM |  | Session B presentations | Session B groups |  |\n\n2.2 Project Mentors  \nAll final projects will be assigned a single mentor CA to serve as a point of contact. Your","cbCaiuaPhULjRfYy","https://ap.wps.com/l/cbCaiuaPhULjRfYy","pdf",226973,4,11,"English","en",105,"# Requirements and Expected Outcome\n## Requirements for novelty\n# Important Information\n## Timeline and Grading\n## Project Mentors\n## Project Groups\n## Past Projects\n## Contributions\n## Honor Code and AI Tools Policy\n## Submission Format\n## Using Late Days\n## Computing Resources\n# Project Survey\n# Project Proposal\n# Milestone Report\n# Poster Presentation\n# Final Report","[{\"question\":\"What counts as a “novelty” requirement for the final project?\",\"answer\":\"Novelty requires answering an open-ended question left unanswered or partially answered in existing literature, proposing non-trivial component/algorithm modifications with justification, or applying a method to an underexplored application domain with non-trivial adaptation. Projects should also provide new insights about success or failure modes.\"},{\"question\":\"Is achieving state-of-the-art performance required?\",\"answer\":\"No. The guidelines explicitly state that the project does not require building a new method at the standard of top ML conferences or achieving state-of-the-art performance.\"},{\"question\":\"What are the main deliverables and when do they occur?\",\"answer\":\"Students prepare a project proposal, a milestone report, a poster presentation, and a final report. Each component is due on specified dates via Gradescope, with additional requirements for the project survey and the in-person poster session.\"}]","CS224R Spring 2026 Deep Reinforcement Learning Custom Project Guidelines | PDF",1789160147,{"code":4,"msg":31,"data":32},"ok",{"site_id":25,"language":24,"slug":33,"title":14,"keywords":34,"description":15,"schema_data":35,"social_meta":91,"head_meta":93,"extra_data":95,"updated_unix":29},"cs224r-spring-2026-deep-reinforcement-learning-custom-project-guidelines","",{"@graph":36,"@context":90},[37,53,73],{"@type":38,"itemListElement":39},"BreadcrumbList",[40,44,48,51],{"item":41,"name":42,"@type":43,"position":11},"https://docshare.wps.com","Home","ListItem",{"item":45,"name":46,"@type":43,"position":47},"https://docshare.wps.com/template/","Template",2,{"item":49,"name":13,"@type":43,"position":50},"https://docshare.wps.com/template/general/",3,{"item":52,"name":14,"@type":43,"position":21},"https://docshare.wps.com/template/cs224r-spring-2026-deep-reinforcement-learning-custom-project-guidelines/240336/",{"url":52,"name":14,"@type":54,"image":55,"author":60,"headline":14,"publisher":62,"fileFormat":65,"inLanguage":24,"description":15,"dateModified":66,"datePublished":67,"encodingFormat":65,"isAccessibleForFree":68,"interactionStatistic":69},"DigitalDocument",{"url":56,"@type":57,"width":58,"height":59},"https://docshare.wps.com/thumbnails/cs224r-spring-2026-deep-reinforcement-learning-custom-project-guidelines/240336.png","ImageObject",442,249,{"name":9,"@type":61},"Person",{"url":41,"name":63,"@type":64},"DocShare","Organization","application/pdf","2026-09-26","2026-09-11",true,{"@type":70,"interactionType":71,"userInteractionCount":21},"InteractionCounter",{"@type":72},"ViewAction",{"@type":74,"mainEntity":75},"FAQPage",[76,82,86],{"name":77,"@type":78,"acceptedAnswer":79},"What counts as a “novelty” requirement for the final project?","Question",{"text":80,"@type":81},"Novelty requires answering an open-ended question left unanswered or partially answered in existing literature, proposing non-trivial component/algorithm modifications with justification, or applying a method to an underexplored application domain with non-trivial adaptation. Projects should also provide new insights about success or failure modes.","Answer",{"name":83,"@type":78,"acceptedAnswer":84},"Is achieving state-of-the-art performance required?",{"text":85,"@type":81},"No. The guidelines explicitly state that the project does not require building a new method at the standard of top ML conferences or achieving state-of-the-art performance.",{"name":87,"@type":78,"acceptedAnswer":88},"What are the main deliverables and when do they occur?",{"text":89,"@type":81},"Students prepare a project proposal, a milestone report, a poster presentation, and a final report. Each component is due on specified dates via Gradescope, with additional requirements for the project survey and the in-person poster session.","https://schema.org",{"og:url":52,"og:type":92,"og:title":14,"og:site_name":63,"og:description":15},"article",{"robots":94,"canonical":52},"index,follow",{"doc_id":7,"site_id":25},{"code":4,"msg":5,"data":97},[98,102,107,112,117,122,127,132,137],{"id":22,"doc_module":11,"doc_module_name":46,"category_name":99,"show_sort_weight":100,"slug":101},"Presentations",90,"presentations",{"id":103,"doc_module":11,"doc_module_name":46,"category_name":104,"show_sort_weight":105,"slug":106},12,"Resumes",80,"resumes",{"id":108,"doc_module":11,"doc_module_name":46,"category_name":109,"show_sort_weight":110,"slug":111},14,"Invoices",70,"invoices",{"id":113,"doc_module":11,"doc_module_name":46,"category_name":114,"show_sort_weight":115,"slug":116},15,"Posters",60,"posters",{"id":118,"doc_module":11,"doc_module_name":46,"category_name":119,"show_sort_weight":120,"slug":121},16,"Social Media",50,"social-media",{"id":123,"doc_module":11,"doc_module_name":46,"category_name":124,"show_sort_weight":125,"slug":126},17,"Forms",40,"forms",{"id":128,"doc_module":11,"doc_module_name":46,"category_name":129,"show_sort_weight":130,"slug":131},18,"Letters",30,"letters",{"id":133,"doc_module":11,"doc_module_name":46,"category_name":134,"show_sort_weight":135,"slug":136},21,"Paper Templates",5,"papers-templates",{"id":12,"doc_module":11,"doc_module_name":46,"category_name":13,"show_sort_weight":4,"slug":138},"general-158"]