[{"data":1,"prerenderedAt":-1},["ShallowReactive",2],{"doc-detail-118447-en":3,"doc-seo-118447-105":30,"detail-sidebar-cat-0-en-105":83},{"code":4,"msg":5,"data":6},0,"success",{"doc_id":7,"user_id":8,"nickname":9,"user_avatar":10,"doc_module":4,"category_id":11,"category_name":12,"doc_title":13,"doc_description":14,"doc_content":15,"file_id":16,"file_url":17,"file_type":18,"file_size":19,"view_count":4,"is_deleted":4,"is_public":20,"is_downloadable":20,"audit_status":20,"page_count":21,"language":22,"language_code":23,"site_id":24,"html_lang":23,"table_of_contents":25,"faqs":26,"seo_title":27,"seo_description":14,"update_tm":28,"read_time":29},118447,2336464648746,"Skyler","https://ap-avatar.wpscdn.com/davatar_276721f389ce27ea32af1340a28f341c",8,"Research & Report","Posterior Inference on Shallow Infinitely Wide Bayesian Neural Networks under Weights with Unbounded Variance - read online free","From Neal’s (1996) result, the infinite-width limit of a Bayesian neural network with one hidden layer becomes a Gaussian process when weights have bounded prior variance. Extensions cover multiple hidden layers and convolutional architectures, enabling tractable posterior inference and uncertainty quantification via Gaussian process machinery. Unbounded weight variance breaks the classical central limit theorem, yielding an α-stable scaling limit. The work addresses posterior inference in this non-Gaussian regime using a conditionally Gaussian representation for interpretable, computationally feasible inference.","This is an electronic reprint of the original article.  \nThis reprint may differ from the original in pagination and typographic detail.  \nLoría, Jorge; Bhadra, Anindya  \nPosterior Inference on Shallow Infinitely Wide Bayesian Neural Networks under Weights with Unbounded Variance  \nPublished in:  \nProceedings of Machine Learning Research  \nPublished: 01/01/2024  \nDocument Version  \nPublisher's PDF, also known as Version of record  \nPublished under the following license:  \nCC BY  \nPlease cite the original version:  \nLoría, J. , & Bhadra, A. (2024) . Posterior Inference on Shallow Infinitely Wide Bayesian Neural Networks under Weights with Unbounded Variance. Proceedings of Machine Learning Research, 244 , 2331-2349. [https://proceedings.mlr.press/v244/loria24a.html](https://proceedings.mlr.press/v244/loria24a.html)  \nThis material is protected by copyright and other intellectual property rights, and duplication or sale of all or part of any of the repository collections is not permitted, except that material may be duplicated by you foryour research use or educational purposes in electronic or print form. You must obtain permission for anyother use. Electronic or print copies may not be offered, whether for sale or otherwise to anyone who is not an authorised user.  \nPosterior Inference on Shallow Infinitely Wide Bayesian Neural Networks under  \nWeights with Unbounded Variance  \nJorge Loría 1,2 Anindya Bhadra 1  \n1Department of Statistics, Purdue University, West Lafayette, Indiana, USA  \n2Department of Computer Science, Aalto University, Finland  \nAbstract  \nFrom the classical and influential works of Neal (1996), it is known that the infinite width scaling limit of a Bayesian neural network with one hidden layer is a Gaussian process, when the network weights have bounded prior variance. Neal’s result has been extended to networks with multiple hidden layers and to convolutional neural networks, also with Gaussian process scaling limits. The tractable properties of Gaussian processes then allow straightforward posterior inference and uncertainty quantification, considerably simplifying the study of the limit process compared to a network of finite width. Neural network weights with unbounded variance, however, pose unique challenges. In this case, the classical central limit theorem breaks down and it is well known that the scaling limit is an α-stable process under suitable conditions. However, current literature is primarily limited to forward simulations under these processes and the problem of posterior inference under such a scaling limit remains largely unaddressed, unlike in the Gaussian process case. To this end, our contribution is an interpretable and computationally feasible procedure for posterior inference, using a conditionally Gaussian representation, that then allows full use of the Gaussian process machinery for tractable posterior inference and uncertainty quantification in the non-Gaussian regime.  \n1 INTRODUCTION  \nGaussian processes (GPs) have been studied as the infinite width limit of Bayesian neural networks with priorson network weights that have finite variance (Neal, 1996 ; Williams, 1996) . This presents some key advantages over  \nBayesian neural networks with finite widths that usually require computation intensive Markov chain Monte Carlo (MCMC) posterior calculations (Neal, 1996) or variational approximations (Goodfellow et al., 2016, Chapter 19); in contrast to straightforward posterior inference and probabilistic uncertainty quantification afforded by the GP machinery (Williams and Rasmussen, 2006) . In this sense, the work of Neal (1996) is foundational. The technical reason for this convergence to a GP is due to an application of the central limit theorem under the bounded second moment condition. More specifically, given an I dimensional input x and a one-dimensional output y(x), a K layer feedforward deep neural network (DNN) with K − 1 hidden layers is defined by the recursion:  \nzj(l+1)(","cbCaivI3pz1XAqy8","https://ap.wps.com/l/cbCaivI3pz1XAqy8","pdf",9795183,1,20,"English","en",105,"# Abstract\n# Introduction\n## Related Works","[{\"question\":\"How does the paper enable posterior inference under an α-stable scaling limit?\",\"answer\":\"It proposes an interpretable and computationally feasible procedure for posterior inference using a conditionally Gaussian representation. This representation allows leveraging Gaussian process tools for tractable posterior inference and uncertainty quantification in the non-Gaussian regime.\"}]","Posterior Inference on Shallow Infinitely Wide Bayesian Neural Networks under Weights with Unbounded Variance - read online free | PDF",1785683652,50,{"code":4,"msg":31,"data":32},"ok",{"site_id":24,"language":23,"slug":33,"title":13,"keywords":34,"description":14,"schema_data":35,"social_meta":78,"head_meta":80,"extra_data":82,"updated_unix":28},"posterior-inference-on-shallow-infinitely-wide-bayesian-neural-networks-under-weights-with-unbounded-variance-read-online-free","",{"@graph":36,"@context":77},[37,54,68],{"@type":38,"itemListElement":39},"BreadcrumbList",[40,44,48,51],{"item":41,"name":42,"@type":43,"position":20},"https://docshare.wps.com","Home","ListItem",{"item":45,"name":46,"@type":43,"position":47},"https://docshare.wps.com/document/","Document",2,{"item":49,"name":12,"@type":43,"position":50},"https://docshare.wps.com/document/research-report/",3,{"item":52,"name":13,"@type":43,"position":53},"https://docshare.wps.com/document/posterior-inference-on-shallow-infinitely-wide-bayesian-neural-networks-under-weights-with-unbounded-variance-read-online-free/118447/",4,{"url":52,"name":13,"@type":55,"author":56,"headline":13,"publisher":58,"fileFormat":61,"inLanguage":23,"description":14,"dateModified":62,"datePublished":62,"encodingFormat":61,"isAccessibleForFree":63,"interactionStatistic":64},"DigitalDocument",{"name":9,"@type":57},"Person",{"url":41,"name":59,"@type":60},"DocShare","Organization","application/pdf","2026-08-02",true,{"@type":65,"interactionType":66,"userInteractionCount":4},"InteractionCounter",{"@type":67},"ViewAction",{"@type":69,"mainEntity":70},"FAQPage",[71],{"name":72,"@type":73,"acceptedAnswer":74},"How does the paper enable posterior inference under an α-stable scaling limit?","Question",{"text":75,"@type":76},"It proposes an interpretable and computationally feasible procedure for posterior inference using a conditionally Gaussian representation. This representation allows leveraging Gaussian process tools for tractable posterior inference and uncertainty quantification in the non-Gaussian regime.","Answer","https://schema.org",{"og:url":52,"og:type":79,"og:title":13,"og:site_name":59,"og:description":14},"article",{"robots":81,"canonical":52},"index,follow",{"doc_id":7,"site_id":24},{"code":4,"msg":5,"data":84},[85,89,93,97,102,106,111,114,118,121,125],{"id":20,"doc_module":4,"doc_module_name":46,"category_name":86,"show_sort_weight":87,"slug":88},"Story & Novel",90,"story-novel",{"id":47,"doc_module":4,"doc_module_name":46,"category_name":90,"show_sort_weight":91,"slug":92},"Literature",80,"literature",{"id":53,"doc_module":4,"doc_module_name":46,"category_name":94,"show_sort_weight":95,"slug":96},"Exam",70,"exam",{"id":98,"doc_module":4,"doc_module_name":46,"category_name":99,"show_sort_weight":100,"slug":101},5,"Comic",60,"comic",{"id":103,"doc_module":4,"doc_module_name":46,"category_name":104,"show_sort_weight":29,"slug":105},6,"Technology","technology",{"id":107,"doc_module":4,"doc_module_name":46,"category_name":108,"show_sort_weight":109,"slug":110},7,"Healthcare",40,"healthcare",{"id":11,"doc_module":4,"doc_module_name":46,"category_name":12,"show_sort_weight":112,"slug":113},30,"research-report",{"id":115,"doc_module":4,"doc_module_name":46,"category_name":116,"show_sort_weight":21,"slug":117},9,"Religion & Spirituality","religion-spirituality",{"id":21,"doc_module":4,"doc_module_name":46,"category_name":119,"show_sort_weight":21,"slug":120},"World Cup","world-cup",{"id":122,"doc_module":4,"doc_module_name":46,"category_name":123,"show_sort_weight":122,"slug":124},10,"Lifestyle","lifestyle",{"id":126,"doc_module":4,"doc_module_name":46,"category_name":127,"show_sort_weight":98,"slug":128},19,"General","general"]