[{"data":1,"prerenderedAt":-1},["ShallowReactive",2],{"doc-detail-122323-en":3,"doc-seo-122323-105":30,"detail-sidebar-cat-0-en-105":91},{"code":4,"msg":5,"data":6},0,"success",{"doc_id":7,"user_id":8,"nickname":9,"user_avatar":10,"doc_module":4,"category_id":11,"category_name":12,"doc_title":13,"doc_description":14,"doc_content":15,"file_id":16,"file_url":17,"file_type":18,"file_size":19,"view_count":4,"is_deleted":4,"is_public":20,"is_downloadable":20,"audit_status":20,"page_count":21,"language":22,"language_code":23,"site_id":24,"html_lang":23,"table_of_contents":25,"faqs":26,"seo_title":27,"seo_description":14,"update_tm":28,"read_time":29},122323,687197207057,"Sage","https://ap-avatar.wpscdn.com/davatar_29158cc5080c5b710cf443261637dec0",8,"Research & Report","Overcoming Catastrophic Forgetting - Geometric Techniques in Incremental Machine Learning","Neural network models achieve strong performance on discrete tasks but struggle to match humans’ lifelong, multifaceted learning. Continual learning addresses this gap by enabling models to learn from data streams while retaining prior knowledge. A central difficulty is catastrophic forgetting, where learning new information degrades performance on earlier tasks. This dissertation proposes novel solutions for continual and incremental learning, focusing on balancing old knowledge retention with integration of new data.","University of Memphis  \nUniversity of Memphis Digital Commons  \nElectronic Theses and Dissertations  \n5-9-2025  \nOvercoming Catastrophic Forgetting: Geometric Techniques in Incremental Machine Learning  \nSahil Nokhwal  \nFollow this and additional works at: [https://digitalcommons.memphis.edu/etd](https://digitalcommons.memphis.edu/etd)  \nRecommended Citation  \nNokhwal, Sahil, \"Overcoming Catastrophic Forgetting: Geometric Techniques in Incremental Machine Learning\" (2025) . Electronic Theses and Dissertations. 3802.  \n[https://digitalcommons.memphis.edu/etd/3802](https://digitalcommons.memphis.edu/etd/3802)  \nThis Dissertation is brought to you for free and open access by University of Memphis Digital Commons. It has been accepted for inclusion in Electronic Theses and Dissertations by an authorized administrator of University of Memphis Digital Commons. For more information, please contact [khggerty@memphis.edu](khggerty@memphis.edu).  \nOVERCOMING CATASTROPHIC FORGETTING: GEOMETRIC TECHNIQUES IN INCREMENTAL MACHINE LEARNING  \nby  \nSahil Nokhwal  \nA Dissertation  \nSubmitted in Partial Fulfillment of the  \nRequirements for the Degree of  \nDoctor of Philosophy  \nMajor: Computer Science  \nCommittee Members:  \nSajjan G. Shiva, Ph.D. (Committee Chair)  \nNirman Kumar, Ph. D.  \nDeepak Venugopal, Ph.D.  \nChing-Chi Yang, Ph.D.  \nThe University of Memphis  \nMay 2025  \n© Copyright 2025 Sahil Nokhwal Partial rights reserved  \nii  \nACKNOWLEDGMENTS  \nThis dissertation is the culmination of years of hard work, and it would not have been possible without the unwavering support of numerous individuals andinstitutions.  \nI have been privileged to work under the guidance of Dr. Sajjan G. Shiva and Dr. Nirman Kumar, whose expertise, mentorship, and constant encouragement have been essential to the completion of this research. I am deeply grateful for their insightful feedback and the direction they provided throughout my journey.  \nI would also like to extend my gratitude to the faculty and staff at the University of Memphis, especially my dissertation committee members, whose valuable insights have enriched my work. The stimulating discussions and collaborative atmosphere provided by my colleagues, both at the university and beyond, have played a crucial role in shaping this dissertation.  \nI am also very thankful for the spiritual and religious institutions which have had a profound impact and provided strength throughout this PhD journey.  \nFinally, to my friends and family—thank you for your unconditional love, support, and belief in me. Your encouragement has been my pillar, and I could not have made it this far without you.  \nTo everyone who has supported me in any way throughout this journey, my heartfelt thanks.  \nABSTRACT  \nNeural network (NN) models have made remarkable strides in outperforming humans in a wide array of discrete tasks. These models excel in specific, well-defined domains where they can leverage vast amounts of data to make highly accurate predictions. However, despite impressive achievements, the scope of NN remains limited when compared to the vast, multifaceted cognitive abilities of humans. While machine learning models excel at specialized tasks, humans possess an extraordinary capacity to acquire knowledge and perform anearly infinite variety of tasks across diverse domains.  \nThe ability to learn over time is a core attribute of human cognition. This lifelong process allows humans to integrate new information while retaining prior knowledge. In contrast, machine learning models struggle, especially in dynamic environments. Continual learning (CL) addresses this challenge, enabling models to learn from a stream of data, whether online or offline, without forgetting past knowledge.  \nA critical challenge in CL is the phenomenon known as ”catastrophic forgetting”(CF) . CF occurs when an NN, after learning new information, forgets previously acquired knowledge, often leading to a degradation in performance on earlier ","cbCaihSAsYiis99g","https://ap.wps.com/l/cbCaihSAsYiis99g","pdf",2810139,1,187,"English","en",105,"# Acknowledgments\n# Abstract\n# List of Publications","[{\"question\":\"What challenge does continual learning address?\",\"answer\":\"Continual learning enables models to learn from a stream of data without forgetting previously learned knowledge, especially in dynamic environments.\"},{\"question\":\"What is catastrophic forgetting in incremental/continual learning?\",\"answer\":\"Catastrophic forgetting occurs when, after learning new information, a neural network forgets previously acquired knowledge, degrading performance on earlier tasks.\"},{\"question\":\"How does this dissertation aim to mitigate catastrophic forgetting?\",\"answer\":\"It presents novel solutions for continual and incremental learning by exploring strategies and techniques that balance retaining old knowledge while incorporating new data.\"}]","Overcoming Catastrophic Forgetting - Geometric Techniques in Incremental Machine Learning | PDF",1785810003,471,{"code":4,"msg":31,"data":32},"ok",{"site_id":24,"language":23,"slug":33,"title":13,"keywords":34,"description":14,"schema_data":35,"social_meta":86,"head_meta":88,"extra_data":90,"updated_unix":28},"overcoming-catastrophic-forgetting-geometric-techniques-in-incremental-machine-learning","",{"@graph":36,"@context":85},[37,54,68],{"@type":38,"itemListElement":39},"BreadcrumbList",[40,44,48,51],{"item":41,"name":42,"@type":43,"position":20},"https://docshare.wps.com","Home","ListItem",{"item":45,"name":46,"@type":43,"position":47},"https://docshare.wps.com/document/","Document",2,{"item":49,"name":12,"@type":43,"position":50},"https://docshare.wps.com/document/research-report/",3,{"item":52,"name":13,"@type":43,"position":53},"https://docshare.wps.com/document/overcoming-catastrophic-forgetting-geometric-techniques-in-incremental-machine-learning/122323/",4,{"url":52,"name":13,"@type":55,"author":56,"headline":13,"publisher":58,"fileFormat":61,"inLanguage":23,"description":14,"dateModified":62,"datePublished":62,"encodingFormat":61,"isAccessibleForFree":63,"interactionStatistic":64},"DigitalDocument",{"name":9,"@type":57},"Person",{"url":41,"name":59,"@type":60},"DocShare","Organization","application/pdf","2026-08-04",true,{"@type":65,"interactionType":66,"userInteractionCount":4},"InteractionCounter",{"@type":67},"ViewAction",{"@type":69,"mainEntity":70},"FAQPage",[71,77,81],{"name":72,"@type":73,"acceptedAnswer":74},"What challenge does continual learning address?","Question",{"text":75,"@type":76},"Continual learning enables models to learn from a stream of data without forgetting previously learned knowledge, especially in dynamic environments.","Answer",{"name":78,"@type":73,"acceptedAnswer":79},"What is catastrophic forgetting in incremental/continual learning?",{"text":80,"@type":76},"Catastrophic forgetting occurs when, after learning new information, a neural network forgets previously acquired knowledge, degrading performance on earlier tasks.",{"name":82,"@type":73,"acceptedAnswer":83},"How does this dissertation aim to mitigate catastrophic forgetting?",{"text":84,"@type":76},"It presents novel solutions for continual and incremental learning by exploring strategies and techniques that balance retaining old knowledge while incorporating new data.","https://schema.org",{"og:url":52,"og:type":87,"og:title":13,"og:site_name":59,"og:description":14},"article",{"robots":89,"canonical":52},"index,follow",{"doc_id":7,"site_id":24},{"code":4,"msg":5,"data":92},[93,97,101,105,110,115,120,123,128,131,135],{"id":20,"doc_module":4,"doc_module_name":46,"category_name":94,"show_sort_weight":95,"slug":96},"Story & Novel",90,"story-novel",{"id":47,"doc_module":4,"doc_module_name":46,"category_name":98,"show_sort_weight":99,"slug":100},"Literature",80,"literature",{"id":53,"doc_module":4,"doc_module_name":46,"category_name":102,"show_sort_weight":103,"slug":104},"Exam",70,"exam",{"id":106,"doc_module":4,"doc_module_name":46,"category_name":107,"show_sort_weight":108,"slug":109},5,"Comic",60,"comic",{"id":111,"doc_module":4,"doc_module_name":46,"category_name":112,"show_sort_weight":113,"slug":114},6,"Technology",50,"technology",{"id":116,"doc_module":4,"doc_module_name":46,"category_name":117,"show_sort_weight":118,"slug":119},7,"Healthcare",40,"healthcare",{"id":11,"doc_module":4,"doc_module_name":46,"category_name":12,"show_sort_weight":121,"slug":122},30,"research-report",{"id":124,"doc_module":4,"doc_module_name":46,"category_name":125,"show_sort_weight":126,"slug":127},9,"Religion & Spirituality",20,"religion-spirituality",{"id":126,"doc_module":4,"doc_module_name":46,"category_name":129,"show_sort_weight":126,"slug":130},"World Cup","world-cup",{"id":132,"doc_module":4,"doc_module_name":46,"category_name":133,"show_sort_weight":132,"slug":134},10,"Lifestyle","lifestyle",{"id":136,"doc_module":4,"doc_module_name":46,"category_name":137,"show_sort_weight":106,"slug":138},19,"General","general"]