[{"data":1,"prerenderedAt":-1},["ShallowReactive",2],{"doc-detail-120069-en":3,"doc-seo-120069-105":30,"detail-sidebar-cat-0-en-105":91},{"code":4,"msg":5,"data":6},0,"success",{"doc_id":7,"user_id":8,"nickname":9,"user_avatar":10,"doc_module":4,"category_id":11,"category_name":12,"doc_title":13,"doc_description":14,"doc_content":15,"file_id":16,"file_url":17,"file_type":18,"file_size":19,"view_count":4,"is_deleted":4,"is_public":20,"is_downloadable":20,"audit_status":20,"page_count":21,"language":22,"language_code":23,"site_id":24,"html_lang":23,"table_of_contents":25,"faqs":26,"seo_title":27,"seo_description":14,"update_tm":28,"read_time":29},120069,2336464648322,"Aria","https://ap-avatar.wpscdn.com/avatar/2200025388227c56fec?_k=1778556882303663488",8,"Research & Report","Anderson Acceleration and Dynamic Optimal Transport in Optimization - Theoretical Analysis, Algorithms, and Applications in Machine Learning - Thesis","This dissertation explores two core optimization topics: Anderson Acceleration and Dynamic Optimal Transport, covering theoretical analysis, algorithm design, and machine learning applications. It studies variants of Anderson Acceleration for nonlinear fixed-point problems and establishes equivalence with multisecant methods to clarify algorithm structure and support convergence analysis. It further develops the Alternating Anderson-Picard method, links it to multisecant-GMRES and Newton-GMRES, and applies a federated variant (FedOSAA) for decentralized learning. Finally, it integrates dynamic optimal transport into autoencoders to improve generative capability under limited data.","UC Davis  \nUC Davis Electronic Theses and Dissertations  \nTitle  \nAnderson Acceleration and Dynamic Optimal Transport in Optimization: Theoretical Analysis, Algorithms, and Applications in Machine Learning  \nPermalink  \n[https://escholarship.org/uc/item/6kz7q0gh](https://escholarship.org/uc/item/6kz7q0gh)  \nAuthor  \nFeng, Xue  \nPublication Date  \n2024  \nPeer reviewed|Thesis/dissertation  \n[eScholarship.org](eScholarship.org) Powered by the California Digital Library  \nUniversity of California  \nAnderson Acceleration and Dynamic Optimal Transport in Optimization: Theoretical Analysis,  \nAlgorithms, and Applications in Machine Learning  \nBy  \nXUE FENG  \nDISSERTATION  \nSubmitted in partial satisfaction of the requirements for the degree of DOCTOR OF PHILOSOPHY  \nin  \nAPPLIED MATHEMATICS  \nin the  \nOFFICE OF GRADUATE STUDIES  \nof the  \nUNIVERSITY OF CALIFORNIA  \nDAVIS  \nApproved:  \n\n| Thomas Strohmer, Chair |\n| --- |\n| Albert Fannjiang |\n\nXin Liu Committee in Charge  \n2024  \n© First M. LastName, 2024 . All rights reserved.  \nContents  \nAbstract iv  \nAcknowledgments v  \nChapter 1 . Introduction 1  \nChapter 2 . Anderson Acceleration 3  \n2.1. Algorithm, Notations and Preliminary Results 4  \n2.2. Equivalence between Anderson Acceleration and Multisecant Methods 15  \n2.3. Convergence Analysis 24  \n2.4. Conclusion 36  \nChapter 3 . Alternating Anderson-Picard method 37  \n3.1. Algorithm, Notations and Preliminary Results 39  \n3.2. Equivalence between AAP(m) and Multisecant-GMRES Methods 41  \n3.3. Bound of Et 46  \n3.4. Optimization Gain Bound 54  \n3.5. Convergence Analysis 59  \n3.6. Numerical Results 63  \n3.7. Conclusion 65  \nChapter 4 . Anderson Acceleration in Federated Learning 66  \n4.1. FedOSAA: Related Work and Algorithm 68  \n4.2. Convergence Analysis 71  \n4.3. Numerical Experiments 79  \n4.4. Conclusion 84  \nChapter 5 . Autoencoder and Dynamic Optimal Transport 86  \n5.1. Background 89  \n5.2. Path Energy and Proposed Algorithm 91  \n5.3. Numerical Experiments 96  \n5.4. Conclusion 103  \nAppendix A. Anderson Acceleration in Federated Learning 105  \nA.1 . State-of-arts FL Algorithms 105  \nA.2 . GIANT Method 108  \nAppendix B. Autoencoder 109  \nB.1 . Additional Experiments 109  \nBibliography 112  \nAbstract  \nThis dissertation explores two important areas in optimization: Anderson Acceleration (AA) and Dynamic Optimal Transport (OT), in terms of theoretical analysis, algorithmic design, and applications in machine learning. Part I discusses different variants of AA, such as AA with window mand restarted AA, to solve nonlinear fixed-point problems. The core is to discuss their equivalence with multisecant methods which not only help to understand the nature of the algorithms but also indicate the later convergence analysis. Part II introduces the Alternating Anderson-Picard (AAP) method, which combines the efficiency of AA in speeding up convergence and the simplicity of Picard iteration. The theoretical results demonstrate its equivalence to multisecant-GMRES methods and shows its deep connection to Newton-GMRES methods. Part III applies AA to federated learning and proposes the Federated One-Step Anderson Acceleration (FedOSAA) for effective decentralized machine learning. Part IV focuses on OT. The proposed algorithm integrates dynamic OT into the autoencoder to enhance its generative ability when data is limited. Overall, this thesis connects theoretical insights with practical applications and advances computational techniques in both scientific computing and machine learning.  \nAcknowledgments  \nI wrote this thesis acknowledgment after I caught a rat in my kitchen. My initial thought was to start it with a sad tone as my Ph.D. journey was long and lost. But it could be more interesting than that.  \nDue to suspicious noises, I doubted the presence of a rat [in my kitchen. With my Ph.D. training](in my kitchen. With my Ph.D. training), I need to gather evidence to confirm my suspicions first. I set up a motion-detecting camera and, sure en","cbCaiv7gry0fClao","https://ap.wps.com/l/cbCaiv7gry0fClao","pdf",6681040,1,125,"English","en",105,"# Contents\n## Chapter 1. Introduction\n## Chapter 2. Anderson Acceleration\n## Chapter 3. Alternating Anderson-Picard method\n## Chapter 4. Anderson Acceleration in Federated Learning\n## Chapter 5. Autoencoder and Dynamic Optimal Transport\n## Appendix A. Anderson Acceleration in Federated Learning\n## Appendix B. Autoencoder","[{\"question\":\"What are the main research areas in this dissertation?\",\"answer\":\"The dissertation focuses on Anderson Acceleration and Dynamic Optimal Transport, examining both theoretical aspects and practical algorithms in machine learning.\"},{\"question\":\"How does the Alternating Anderson-Picard (AAP) method relate to other methods?\",\"answer\":\"AAP combines Anderson Acceleration and Picard iteration, and the theoretical results show equivalence to multisecant-GMRES while highlighting connections to Newton-GMRES methods.\"},{\"question\":\"What application does FedOSAA target?\",\"answer\":\"FedOSAA is proposed for federated learning, enabling effective decentralized machine learning using a one-step Anderson acceleration idea.\"}]","Anderson Acceleration and Dynamic Optimal Transport in Optimization - Theoretical Analysis, Algorithms, and Applications in Machine Learning - Thesis | PDF",1785727980,315,{"code":4,"msg":31,"data":32},"ok",{"site_id":24,"language":23,"slug":33,"title":13,"keywords":34,"description":14,"schema_data":35,"social_meta":86,"head_meta":88,"extra_data":90,"updated_unix":28},"anderson-acceleration-and-dynamic-optimal-transport-in-optimization-theoretical-analysis-algorithms-and-applications-in-machine-learning-thesis","",{"@graph":36,"@context":85},[37,54,68],{"@type":38,"itemListElement":39},"BreadcrumbList",[40,44,48,51],{"item":41,"name":42,"@type":43,"position":20},"https://docshare.wps.com","Home","ListItem",{"item":45,"name":46,"@type":43,"position":47},"https://docshare.wps.com/document/","Document",2,{"item":49,"name":12,"@type":43,"position":50},"https://docshare.wps.com/document/research-report/",3,{"item":52,"name":13,"@type":43,"position":53},"https://docshare.wps.com/document/anderson-acceleration-and-dynamic-optimal-transport-in-optimization-theoretical-analysis-algorithms-and-applications-in-machine-learning-thesis/120069/",4,{"url":52,"name":13,"@type":55,"author":56,"headline":13,"publisher":58,"fileFormat":61,"inLanguage":23,"description":14,"dateModified":62,"datePublished":62,"encodingFormat":61,"isAccessibleForFree":63,"interactionStatistic":64},"DigitalDocument",{"name":9,"@type":57},"Person",{"url":41,"name":59,"@type":60},"DocShare","Organization","application/pdf","2026-08-03",true,{"@type":65,"interactionType":66,"userInteractionCount":4},"InteractionCounter",{"@type":67},"ViewAction",{"@type":69,"mainEntity":70},"FAQPage",[71,77,81],{"name":72,"@type":73,"acceptedAnswer":74},"What are the main research areas in this dissertation?","Question",{"text":75,"@type":76},"The dissertation focuses on Anderson Acceleration and Dynamic Optimal Transport, examining both theoretical aspects and practical algorithms in machine learning.","Answer",{"name":78,"@type":73,"acceptedAnswer":79},"How does the Alternating Anderson-Picard (AAP) method relate to other methods?",{"text":80,"@type":76},"AAP combines Anderson Acceleration and Picard iteration, and the theoretical results show equivalence to multisecant-GMRES while highlighting connections to Newton-GMRES methods.",{"name":82,"@type":73,"acceptedAnswer":83},"What application does FedOSAA target?",{"text":84,"@type":76},"FedOSAA is proposed for federated learning, enabling effective decentralized machine learning using a one-step Anderson acceleration idea.","https://schema.org",{"og:url":52,"og:type":87,"og:title":13,"og:site_name":59,"og:description":14},"article",{"robots":89,"canonical":52},"index,follow",{"doc_id":7,"site_id":24},{"code":4,"msg":5,"data":92},[93,97,101,105,110,115,120,123,128,131,135],{"id":20,"doc_module":4,"doc_module_name":46,"category_name":94,"show_sort_weight":95,"slug":96},"Story & Novel",90,"story-novel",{"id":47,"doc_module":4,"doc_module_name":46,"category_name":98,"show_sort_weight":99,"slug":100},"Literature",80,"literature",{"id":53,"doc_module":4,"doc_module_name":46,"category_name":102,"show_sort_weight":103,"slug":104},"Exam",70,"exam",{"id":106,"doc_module":4,"doc_module_name":46,"category_name":107,"show_sort_weight":108,"slug":109},5,"Comic",60,"comic",{"id":111,"doc_module":4,"doc_module_name":46,"category_name":112,"show_sort_weight":113,"slug":114},6,"Technology",50,"technology",{"id":116,"doc_module":4,"doc_module_name":46,"category_name":117,"show_sort_weight":118,"slug":119},7,"Healthcare",40,"healthcare",{"id":11,"doc_module":4,"doc_module_name":46,"category_name":12,"show_sort_weight":121,"slug":122},30,"research-report",{"id":124,"doc_module":4,"doc_module_name":46,"category_name":125,"show_sort_weight":126,"slug":127},9,"Religion & Spirituality",20,"religion-spirituality",{"id":126,"doc_module":4,"doc_module_name":46,"category_name":129,"show_sort_weight":126,"slug":130},"World Cup","world-cup",{"id":132,"doc_module":4,"doc_module_name":46,"category_name":133,"show_sort_weight":132,"slug":134},10,"Lifestyle","lifestyle",{"id":136,"doc_module":4,"doc_module_name":46,"category_name":137,"show_sort_weight":106,"slug":138},19,"General","general"]