[{"data":1,"prerenderedAt":-1},["ShallowReactive",2],{"doc-detail-122549-en":3,"doc-seo-122549-105":30,"detail-sidebar-cat-0-en-105":91},{"code":4,"msg":5,"data":6},0,"success",{"doc_id":7,"user_id":8,"nickname":9,"user_avatar":10,"doc_module":4,"category_id":11,"category_name":12,"doc_title":13,"doc_description":14,"doc_content":15,"file_id":16,"file_url":17,"file_type":18,"file_size":19,"view_count":20,"is_deleted":4,"is_public":20,"is_downloadable":20,"audit_status":20,"page_count":21,"language":22,"language_code":23,"site_id":24,"html_lang":23,"table_of_contents":25,"faqs":26,"seo_title":27,"seo_description":14,"update_tm":28,"read_time":29},122549,13056703020460,"Valentina","https://ap-avatar.wpscdn.com/avatar/be000253dac470eee5d?_k=1778207105932848923",8,"Research & Report","The Interplay of Optimization and Machine Learning to Solve Large-scale Black-box Noisy Functions - dissertation","High-dimensional black-box optimization poses a persistent barrier in modern science and engineering. This dissertation develops an adaptive interplay between optimization and machine learning, using surrogate models to balance exploration, exploitation, and estimation. A multi-level Partitioning and Branch-and-Bound algorithm for level-set approximation is improved with importance sampling, Gaussian-process guidance, and adaptive sampling probabilities supported by confidence intervals. To address high dimensionality, it introduces BASSO with finite-time analysis and surrogate-driven sampling, and extends a noisy optimization scheme via quadratic regression and optimistic sampling with convergence and numerical validation.","©Copyright 2025 Pariyakorn Maneekul  \nThe Interplay of Optimization and Machine Learning to Solve Large-scale Black-box Noisy Functions  \nPariyakorn Maneekul  \nA dissertation  \nsubmitted in partial fulfillment of the  \nrequirements for the degree of  \nDoctor of Philosophy  \nUniversity of Washington  \n2025  \nReading Committee:  \nZelda B. Zabinsky, Chair  \nChiwoo Park  \nGiulia Pedrielli  \nProgram Authorized to Offer Degree:  \nIndustrial and Systems Engineering  \nUniversity of Washington  \nAbstract  \nThe Interplay of Optimization and Machine Learning to Solve Large-scale Black-box Noisy  \nFunctions  \nPariyakorn Maneekul  \nChair of the Supervisory Committee:  \nZelda B. Zabinsky  \nIndustrial and Systems Engineering  \nHigh-dimensional black-box optimization presents an increasingly prevalent challenge in modern science and engineering. This dissertation addresses this challenge through a novel interplay between optimization and machine learning methods, developing adaptive search algorithms that strike a balance between exploration, exploitation, and estimation. The proposed algorithms leverage machine learning techniques to construct surrogate models, thereby enhancing the efficiency of the optimization process.  \nThe dissertation proposes a multi-level Partitioning and Branch-and-Bound (PBnB) algorithm designed for level-set approximation, enhancing the original PBnB algorithm significantly. This multi-level PBnB algorithm employs importance sampling to strategically identify promising subregions of the partitioned search space. Its performance is further enhanced by integrating Gaussian processes as a surrogate model to guide local sampling exploration. During the process, the target level set is approximated by classifying subregions as either pruned (no intersection with target level set), maintained (contained within target level set), or undecided. This enhanced version of the PBnB algorithm introduces an adaptive sampling probability that strategically directs samples to the most promising regions. Since this importance sampling results in dependency amongst samples, we have applied a statistical method to construct a confidence interval on the probability of correctly classifying a subregion as pruned or maintained. The contribution to the interplay of  \noptimization and machine learning is the local sampling within each subregion. We incorporate Gaussian processes and regularized quadratic regression, common and successful methods for prediction in machine learning for level-set approximation. The analysis of this multi-level PBnB algorithm quantifies the quality of the level set approximation by deriving probability bounds on the volume of incorrectly pruned or maintained regions, which accounts for the effects of importance sampling.  \nTo address the challenges of high dimensionality, this dissertation introduces the Branching Adaptive Surrogate Search Optimization (BASSO) framework that conceptualizes the use of branching and surrogate modeling for black-box optimization. BASSO generalizes multi-level PBnB and adapts it to optimization as opposed to level-set approximation. A finite-time analysis of BASSO proves that the expected number of BASSO function evaluations needed to first sample a point in the global optimum vicinity is linear in dimension given that two strong assumptions are satisfied. The desired linearity result suggests an algorithm that is scalable to high dimensions in theory. This research explores several variations to implement BASSO and partially satisfy the two assumptions. In this part of the research, methods used in machine learning are introduced to improve the chance of sampling in the improving region. One BASSO implementation incorporates Gaussian processes as a surrogate model and a second uses regularized quadratic regression as a surrogate model to predict where to sample next within a subregion. The synergy between the surrogate model and the optimization algorithm work together to balance explo","cbCaibGEsbDwR7ZB","https://ap.wps.com/l/cbCaibGEsbDwR7ZB","pdf",17939441,1,160,"English","en",105,"# Abstract\n## Multi-level PBnB for level-set approximation\n## BASSO framework and scalability\n## Noisy optimization via extended SOSA","[{\"question\":\"What problem does the dissertation address?\",\"answer\":\"It addresses high-dimensional black-box optimization, where function evaluations are expensive and only limited information is available.\"},{\"question\":\"How does the work combine optimization with machine learning?\",\"answer\":\"It uses machine learning techniques to build surrogate models that guide search decisions, improving efficiency while balancing exploration and exploitation.\"},{\"question\":\"What key algorithms and extensions are proposed?\",\"answer\":\"It proposes a multi-level PBnB algorithm for level-set approximation and a BASSO framework for generalized branching-and-surrogate search, and it extends SOSA for noisy function estimation using quadratic regression and optimistic sampling.\"}]","The Interplay of Optimization and Machine Learning to Solve Large-scale Black-box Noisy Functions - dissertation | PDF",1785811231,403,{"code":4,"msg":31,"data":32},"ok",{"site_id":24,"language":23,"slug":33,"title":13,"keywords":34,"description":14,"schema_data":35,"social_meta":86,"head_meta":88,"extra_data":90,"updated_unix":28},"the-interplay-of-optimization-and-machine-learning-to-solve-large-scale-black-box-noisy-functions-dissertation","",{"@graph":36,"@context":85},[37,54,68],{"@type":38,"itemListElement":39},"BreadcrumbList",[40,44,48,51],{"item":41,"name":42,"@type":43,"position":20},"https://docshare.wps.com","Home","ListItem",{"item":45,"name":46,"@type":43,"position":47},"https://docshare.wps.com/document/","Document",2,{"item":49,"name":12,"@type":43,"position":50},"https://docshare.wps.com/document/research-report/",3,{"item":52,"name":13,"@type":43,"position":53},"https://docshare.wps.com/document/the-interplay-of-optimization-and-machine-learning-to-solve-large-scale-black-box-noisy-functions-dissertation/122549/",4,{"url":52,"name":13,"@type":55,"author":56,"headline":13,"publisher":58,"fileFormat":61,"inLanguage":23,"description":14,"dateModified":62,"datePublished":62,"encodingFormat":61,"isAccessibleForFree":63,"interactionStatistic":64},"DigitalDocument",{"name":9,"@type":57},"Person",{"url":41,"name":59,"@type":60},"DocShare","Organization","application/pdf","2026-08-04",true,{"@type":65,"interactionType":66,"userInteractionCount":20},"InteractionCounter",{"@type":67},"ViewAction",{"@type":69,"mainEntity":70},"FAQPage",[71,77,81],{"name":72,"@type":73,"acceptedAnswer":74},"What problem does the dissertation address?","Question",{"text":75,"@type":76},"It addresses high-dimensional black-box optimization, where function evaluations are expensive and only limited information is available.","Answer",{"name":78,"@type":73,"acceptedAnswer":79},"How does the work combine optimization with machine learning?",{"text":80,"@type":76},"It uses machine learning techniques to build surrogate models that guide search decisions, improving efficiency while balancing exploration and exploitation.",{"name":82,"@type":73,"acceptedAnswer":83},"What key algorithms and extensions are proposed?",{"text":84,"@type":76},"It proposes a multi-level PBnB algorithm for level-set approximation and a BASSO framework for generalized branching-and-surrogate search, and it extends SOSA for noisy function estimation using quadratic regression and optimistic sampling.","https://schema.org",{"og:url":52,"og:type":87,"og:title":13,"og:site_name":59,"og:description":14},"article",{"robots":89,"canonical":52},"index,follow",{"doc_id":7,"site_id":24},{"code":4,"msg":5,"data":92},[93,97,101,105,110,115,120,123,128,131,135],{"id":20,"doc_module":4,"doc_module_name":46,"category_name":94,"show_sort_weight":95,"slug":96},"Story & Novel",90,"story-novel",{"id":47,"doc_module":4,"doc_module_name":46,"category_name":98,"show_sort_weight":99,"slug":100},"Literature",80,"literature",{"id":53,"doc_module":4,"doc_module_name":46,"category_name":102,"show_sort_weight":103,"slug":104},"Exam",70,"exam",{"id":106,"doc_module":4,"doc_module_name":46,"category_name":107,"show_sort_weight":108,"slug":109},5,"Comic",60,"comic",{"id":111,"doc_module":4,"doc_module_name":46,"category_name":112,"show_sort_weight":113,"slug":114},6,"Technology",50,"technology",{"id":116,"doc_module":4,"doc_module_name":46,"category_name":117,"show_sort_weight":118,"slug":119},7,"Healthcare",40,"healthcare",{"id":11,"doc_module":4,"doc_module_name":46,"category_name":12,"show_sort_weight":121,"slug":122},30,"research-report",{"id":124,"doc_module":4,"doc_module_name":46,"category_name":125,"show_sort_weight":126,"slug":127},9,"Religion & Spirituality",20,"religion-spirituality",{"id":126,"doc_module":4,"doc_module_name":46,"category_name":129,"show_sort_weight":126,"slug":130},"World Cup","world-cup",{"id":132,"doc_module":4,"doc_module_name":46,"category_name":133,"show_sort_weight":132,"slug":134},10,"Lifestyle","lifestyle",{"id":136,"doc_module":4,"doc_module_name":46,"category_name":137,"show_sort_weight":106,"slug":138},19,"General","general"]