[{"data":1,"prerenderedAt":-1},["ShallowReactive",2],{"doc-detail-117416-en":3,"doc-seo-117416-105":30,"detail-sidebar-cat-0-en-105":91},{"code":4,"msg":5,"data":6},0,"success",{"doc_id":7,"user_id":8,"nickname":9,"user_avatar":10,"doc_module":4,"category_id":11,"category_name":12,"doc_title":13,"doc_description":14,"doc_content":15,"file_id":16,"file_url":17,"file_type":18,"file_size":19,"view_count":4,"is_deleted":4,"is_public":20,"is_downloadable":20,"audit_status":20,"page_count":21,"language":22,"language_code":23,"site_id":24,"html_lang":23,"table_of_contents":25,"faqs":26,"seo_title":27,"seo_description":14,"update_tm":28,"read_time":29},117416,7971461740909,"Levi","https://ap-avatar.wpscdn.com/davatar_155a257f0dc6eb9ab79c44ca47cae57d",6,"Technology","3D Game - Enhancing Game AI with Machine Learning - Master of Science Applied Computer Science Capstone","Machine learning (ML) and artificial intelligence (AI) differ in scope, with ML forming a subset of AI focused on enabling computers to learn patterns. This project examines how video games commonly label NPC behavior as “AI” without using true ML, and proposes a reinforcement-learning approach instead. A 3D capture-and-hold game was built where bots use Q-learning to learn winning strategies, observe players’ tactics, and adapt counter-strategies. The system aims to increase player challenge through data-driven bot decision-making.","Grand Valley State University  \nScholarWorks@GVSU  \n\n| Culminating Experience Projects | Graduate Research and Creative Practice |\n| --- | --- |\n| 12-15-2024\u003Cbr>3D Game: Enhancing Game AI with Machine Learning Nicholas William English\u003Cbr>Follow this and additional works at: [https://scholarworks.gvsu.edu/gradprojects](https://scholarworks.gvsu.edu/gradprojects)\u003Cbr> Part of the Computer Sciences Commons |  |\n\nScholarWorks Citation  \nEnglish, Nicholas William, \"3D Game: Enhancing Game AI with Machine Learning\" (2024) . Culminating Experience Projects. 540.  \n[https://scholarworks.gvsu.edu/gradprojects/540](https://scholarworks.gvsu.edu/gradprojects/540)  \nThis Project is brought to you for free and open access by the Graduate Research and Creative Practice at ScholarWorks@GVSU. It has been accepted for inclusion in Culminating Experience Projects by an authorized administrator of ScholarWorks@GVSU. For more information, please contact [scholarworks@gvsu.edu](scholarworks@gvsu.edu).  \n3D Game: Enhancing Game AI with Machine Learning  \nNicholas William English  \nA Project Submitted to  \nGRAND VALLEY STATE UNIVERSITY  \nIn  \nPartial Fulfillment of the Requirements  \nFor the Degree of  \nMaster of Science in Applied Computer Science School of Computing  \nDecember 2024  \nThe signatures ofthe individuals below indicate that they have read and approved the project of Nicholas William English in partial fulfillment of the requirements for the degree of Master of Science in Applied Computer Science.  \n\n| Dr. Byron DeVries, Project Advisor Date |\n| --- |\n| Dr. Robert Adams, Graduate Program Director Date |\n\nDr. Robert Adams, Unit head Date  \nAbstract  \nMachine learning (ML) and artificial intelligence (AI) are terms that are often used synonymously, but they are ever-so slightly different. Machine learning is really a subset of artificial intelligence and involves creating an algorithm so that a computer can learn patterns. Artificial intelligence extends machine learning with the goal to go beyond pattern recognition by having a computer that is capable of mimicking human intelligence. Video games often use the term AI in reference to the bots or non-playable characters (NPCs) that players may interact with. Generally, these bots do not actually implement AI, nor do they use ML, but there has been some movement by indie game developers to develop games that implement large language models (LLMs). LLMs utilize machine learning to generate text based on a given context. In video games, these LLMs are used to generate dynamic conversations that players have with NPCs. While this advancement may allow for players to feel more immersed in the game, thereis not as much ofa push to use machine learning to challenge the players. Current games may utilize a difficulty setting for their bots, but this is generally used to control settings related to a bot’s health, damage, and aggressiveness. This just ensures that the bots are either pushovers or brutes, but they do not utilize any form of tactics or strategies to challenge the players. One of the goals of this project was to prove that bots in video games could implement machine learning to learn how to play the game and strategize the best way to win the game. The bots will learn what strategies players employ and will develop their own tactics to counteract players.  \nIntroduction  \nThe primary goal of this project was to create a 3D game that implements machine learning. In previously completed courses, 2D games were often utilized for the course projects as it was an interesting and creative way to implement ideas taught in the classroom. To expand on the knowledge that had to be acquired to understand how to program in a 2D environment, this capstone project went further by creating a game in a 3D environment. The game itself places a player on a team with friendly bots, who are competing against another team. The objective of the two teams is to capture and hold up to five posts in the game.","cbCaisXd0aYGK60A","https://ap.wps.com/l/cbCaisXd0aYGK60A","pdf",503453,1,24,"English","en",105,"# Abstract\n## Introduction\n## Project Goal and Game Concept\n## Reinforcement Learning Approach\n## Bot Orchestration and Ensemble Modeling\n## Knowledge and Development Process","[{\"question\":\"What problem does the project target in existing video game “AI” behavior?\",\"answer\":\"It targets that many games use difficulty settings or scripted NPC behavior instead of real machine learning, so bots lack tactics that challenge players strategically.\"},{\"question\":\"How do the bots learn and improve during gameplay?\",\"answer\":\"Bots use reinforcement learning with the Q-learning algorithm, learning from past mistakes and victories and developing tactics that counter players.\"},{\"question\":\"How does the project decide where bots should go in the game?\",\"answer\":\"A team-specific orchestrator determines bot decisions, using a boosting ensemble modeling technique to encourage better outcomes for the current state.\"}]","3D Game - Enhancing Game AI with Machine Learning - Master of Science Applied Computer Science Capstone | PDF",1785675761,60,{"code":4,"msg":31,"data":32},"ok",{"site_id":24,"language":23,"slug":33,"title":13,"keywords":34,"description":14,"schema_data":35,"social_meta":86,"head_meta":88,"extra_data":90,"updated_unix":28},"3d-game-enhancing-game-ai-with-machine-learning-master-of-science-applied-computer-science-capstone","",{"@graph":36,"@context":85},[37,54,68],{"@type":38,"itemListElement":39},"BreadcrumbList",[40,44,48,51],{"item":41,"name":42,"@type":43,"position":20},"https://docshare.wps.com","Home","ListItem",{"item":45,"name":46,"@type":43,"position":47},"https://docshare.wps.com/document/","Document",2,{"item":49,"name":12,"@type":43,"position":50},"https://docshare.wps.com/document/technology/",3,{"item":52,"name":13,"@type":43,"position":53},"https://docshare.wps.com/document/3d-game-enhancing-game-ai-with-machine-learning-master-of-science-applied-computer-science-capstone/117416/",4,{"url":52,"name":13,"@type":55,"author":56,"headline":13,"publisher":58,"fileFormat":61,"inLanguage":23,"description":14,"dateModified":62,"datePublished":62,"encodingFormat":61,"isAccessibleForFree":63,"interactionStatistic":64},"DigitalDocument",{"name":9,"@type":57},"Person",{"url":41,"name":59,"@type":60},"DocShare","Organization","application/pdf","2026-08-02",true,{"@type":65,"interactionType":66,"userInteractionCount":4},"InteractionCounter",{"@type":67},"ViewAction",{"@type":69,"mainEntity":70},"FAQPage",[71,77,81],{"name":72,"@type":73,"acceptedAnswer":74},"What problem does the project target in existing video game “AI” behavior?","Question",{"text":75,"@type":76},"It targets that many games use difficulty settings or scripted NPC behavior instead of real machine learning, so bots lack tactics that challenge players strategically.","Answer",{"name":78,"@type":73,"acceptedAnswer":79},"How do the bots learn and improve during gameplay?",{"text":80,"@type":76},"Bots use reinforcement learning with the Q-learning algorithm, learning from past mistakes and victories and developing tactics that counter players.",{"name":82,"@type":73,"acceptedAnswer":83},"How does the project decide where bots should go in the game?",{"text":84,"@type":76},"A team-specific orchestrator determines bot decisions, using a boosting ensemble modeling technique to encourage better outcomes for the current state.","https://schema.org",{"og:url":52,"og:type":87,"og:title":13,"og:site_name":59,"og:description":14},"article",{"robots":89,"canonical":52},"index,follow",{"doc_id":7,"site_id":24},{"code":4,"msg":5,"data":92},[93,97,101,105,109,112,117,122,127,130,134],{"id":20,"doc_module":4,"doc_module_name":46,"category_name":94,"show_sort_weight":95,"slug":96},"Story & Novel",90,"story-novel",{"id":47,"doc_module":4,"doc_module_name":46,"category_name":98,"show_sort_weight":99,"slug":100},"Literature",80,"literature",{"id":53,"doc_module":4,"doc_module_name":46,"category_name":102,"show_sort_weight":103,"slug":104},"Exam",70,"exam",{"id":106,"doc_module":4,"doc_module_name":46,"category_name":107,"show_sort_weight":29,"slug":108},5,"Comic","comic",{"id":11,"doc_module":4,"doc_module_name":46,"category_name":12,"show_sort_weight":110,"slug":111},50,"technology",{"id":113,"doc_module":4,"doc_module_name":46,"category_name":114,"show_sort_weight":115,"slug":116},7,"Healthcare",40,"healthcare",{"id":118,"doc_module":4,"doc_module_name":46,"category_name":119,"show_sort_weight":120,"slug":121},8,"Research & Report",30,"research-report",{"id":123,"doc_module":4,"doc_module_name":46,"category_name":124,"show_sort_weight":125,"slug":126},9,"Religion & Spirituality",20,"religion-spirituality",{"id":125,"doc_module":4,"doc_module_name":46,"category_name":128,"show_sort_weight":125,"slug":129},"World Cup","world-cup",{"id":131,"doc_module":4,"doc_module_name":46,"category_name":132,"show_sort_weight":131,"slug":133},10,"Lifestyle","lifestyle",{"id":135,"doc_module":4,"doc_module_name":46,"category_name":136,"show_sort_weight":106,"slug":137},19,"General","general"]