[{"data":1,"prerenderedAt":-1},["ShallowReactive",2],{"doc-detail-118748-en":3,"doc-seo-118748-105":30,"detail-sidebar-cat-0-en-105":91},{"code":4,"msg":5,"data":6},0,"success",{"doc_id":7,"user_id":8,"nickname":9,"user_avatar":10,"doc_module":4,"category_id":11,"category_name":12,"doc_title":13,"doc_description":14,"doc_content":15,"file_id":16,"file_url":17,"file_type":18,"file_size":19,"view_count":4,"is_deleted":4,"is_public":20,"is_downloadable":20,"audit_status":20,"page_count":21,"language":22,"language_code":23,"site_id":24,"html_lang":23,"table_of_contents":25,"faqs":26,"seo_title":27,"seo_description":14,"update_tm":28,"read_time":29},118748,1099513958762,"Logic","https://ap-avatar.wpscdn.com/avatar/1000023916a998db790?x-image-process=image/resize,m_fixed,w_180,h_180&k=1784791008015729253",8,"Research & Report","A Review of the Gumbel-max Trick and its Extensions for Discrete Stochasticity in Machine Learning","The Gumbel-max trick enables sampling from a categorical distribution using unnormalized (log-) probabilities. Recent machine learning work extends this idea to support tasks such as drawing multiple samples, sampling from structured domains, and gradient estimation for backpropagation in neural network optimization. This survey provides background on the original trick, a structured overview to help with algorithm selection, and a comprehensive mapping of related literature using Gumbel-based methods. It also highlights common design choices and outlines future perspectives.","A Review of the Gumbel-max Trick and its Extensions for Discrete Stochasticity in Machine Learning  \nCitation for published version (APA):  \nHuijben, I. A. M. , Kool, W. , Paulus, M. B. , & van Sloun, R. J. G. (2023) . A Review of the Gumbel-max Trick and its Extensions for Discrete Stochasticity in Machine Learning. IEEE Transactions on Pattern Analysis and Machine Intelligence, 45(2), 1353-1371 . Article 9729603. [https://doi.org/10.1109/TPAMI.2022.3157042](https://doi.org/10.1109/TPAMI.2022.3157042)  \nDocument license:  \nTAVERNE  \nDOI:  \n10.1109/TPAMI.2022.3157042  \nDocument status and date:  \nPublished: 01/02/2023  \nDocument Version:  \nPublisher’s PDF, also known as Version of Record (includes final page, issue and volume numbers)  \nPlease check the document version of this publication:  \n• A submitted manuscript is the version of the article upon submission and before peer-review. There can be important differences between the submitted version and the official published version of record. People interested in the research are advised to contact the author for the final version of the publication, or visit the DOI to the publisher's website.  \n• The final author version and the galley proof are versions of the publication after peer review.  \n• The final published version features the final layout of the paper including the volume, issue and page numbers.  \nLink to publication  \nGeneral rights  \nCopyright and moral rights for the publications made accessible in the public portal are retained by the authors and/or other copyright owners and it is a condition of accessing publications that users recognise and abide by the legal requirements associated with these rights.  \n• Users may download and print one copy of any publication from the public portal for the purpose of private study or research.  \n• You may not further distribute the material or use it for any profit-making activity or commercial gain  \n• You may freely distribute the URL identifying the publication in the public portal.  \nIf the publication is distributed under the terms of Article 25fa of the Dutch Copyright Act, indicated by the “Taverne” license above, please follow below link for the End User Agreement:  \n[www.tue.nl/taverne](www.tue.nl/taverne)  \nTake down policy  \nIf you believe that this document breaches copyright please contact us at:  \n[openaccess@tue.nl](openaccess@tue.nl)  \nproviding details and we will investigate your claim.  \nDownload date: 02. Aug. 2026  \nIEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, VOL. 45, NO. 2, FEBRUARY 2023 1353  \nA Review of the Gumbel-max Trick and its Extensions for Discrete Stochasticity in  \nMachine Learning  \nIris A. M. Huijben  , Student Member, IEEE, Wouter Kool ,  \nMax B. Paulus, and Ruud J. G. van Sloun  , Member, IEEE  \nAbstract—The Gumbel-max trick is a method to draw a sample from a categorical distribution, given by its unnormalized (log-)  \nprobabilities. Over the past years, the machine learning community has proposed several extensions of this trick to facilitate, e.g. ,  \ndrawing multiple samples, sampling from structured domains, or gradient estimation for error backpropagation in neural network optimization. The goal of this survey article is to present background about the Gumbel-max trick, and to provide a structured overview of its extensions to ease algorithm selection. Moreover, it presents a comprehensive outline of (machine learning) literature in which  \nGumbel-based algorithms have been leveraged, reviews commonly-made design choices, and sketches a future perspective.  \nIndex Terms—Gumbel-max trick, sampling, gradient estimation, gumbel-softmax, categorical distribution, structured models  \n~~ ~~ Ç ~~ ~~  \n1 INTRODUCTION  \nTHE world around us is discrete in many aspects. Think  \nabout decision making, e.g., in traffic (Should I decelerate, accelerate or maintain a constant speed?), for product selection (Given that I liked the trousers from shop X last time, which new t","cbCaiv9W0k19hgnY","https://ap.wps.com/l/cbCaiv9W0k19hgnY","pdf",1832712,1,20,"English","en",105,"# Introduction\n## Motivation for discrete stochastic modeling\n# Overview of the Gumbel-max trick\n## Sampling from categorical distributions\n# Extensions and applications\n## Multiple samples, structured domains, and gradient estimation\n# Survey scope and literature mapping\n## Design choices and future perspective","[{\"question\":\"What problem does the Gumbel-max trick solve in machine learning?\",\"answer\":\"It provides a way to draw a sample from a categorical distribution using unnormalized (log-) probabilities, enabling discrete stochastic sampling within learning pipelines.\"},{\"question\":\"What kinds of extensions to the Gumbel-max trick are covered in the survey?\",\"answer\":\"The survey discusses extensions for drawing multiple samples, sampling from structured domains, and gradient estimation to support error backpropagation in neural network optimization.\"},{\"question\":\"How does the survey help readers choose among Gumbel-based algorithms?\",\"answer\":\"It offers background on the original trick and a structured overview of its extensions, along with a review of commonly made design choices and a mapping of relevant literature that uses Gumbel-based methods.\"}]","A Review of the Gumbel-max Trick and its Extensions for Discrete Stochasticity in Machine Learning | PDF",1785720038,50,{"code":4,"msg":31,"data":32},"ok",{"site_id":24,"language":23,"slug":33,"title":13,"keywords":34,"description":14,"schema_data":35,"social_meta":86,"head_meta":88,"extra_data":90,"updated_unix":28},"a-review-of-the-gumbel-max-trick-and-its-extensions-for-discrete-stochasticity-in-machine-learning","",{"@graph":36,"@context":85},[37,54,68],{"@type":38,"itemListElement":39},"BreadcrumbList",[40,44,48,51],{"item":41,"name":42,"@type":43,"position":20},"https://docshare.wps.com","Home","ListItem",{"item":45,"name":46,"@type":43,"position":47},"https://docshare.wps.com/document/","Document",2,{"item":49,"name":12,"@type":43,"position":50},"https://docshare.wps.com/document/research-report/",3,{"item":52,"name":13,"@type":43,"position":53},"https://docshare.wps.com/document/a-review-of-the-gumbel-max-trick-and-its-extensions-for-discrete-stochasticity-in-machine-learning/118748/",4,{"url":52,"name":13,"@type":55,"author":56,"headline":13,"publisher":58,"fileFormat":61,"inLanguage":23,"description":14,"dateModified":62,"datePublished":62,"encodingFormat":61,"isAccessibleForFree":63,"interactionStatistic":64},"DigitalDocument",{"name":9,"@type":57},"Person",{"url":41,"name":59,"@type":60},"DocShare","Organization","application/pdf","2026-08-03",true,{"@type":65,"interactionType":66,"userInteractionCount":4},"InteractionCounter",{"@type":67},"ViewAction",{"@type":69,"mainEntity":70},"FAQPage",[71,77,81],{"name":72,"@type":73,"acceptedAnswer":74},"What problem does the Gumbel-max trick solve in machine learning?","Question",{"text":75,"@type":76},"It provides a way to draw a sample from a categorical distribution using unnormalized (log-) probabilities, enabling discrete stochastic sampling within learning pipelines.","Answer",{"name":78,"@type":73,"acceptedAnswer":79},"What kinds of extensions to the Gumbel-max trick are covered in the survey?",{"text":80,"@type":76},"The survey discusses extensions for drawing multiple samples, sampling from structured domains, and gradient estimation to support error backpropagation in neural network optimization.",{"name":82,"@type":73,"acceptedAnswer":83},"How does the survey help readers choose among Gumbel-based algorithms?",{"text":84,"@type":76},"It offers background on the original trick and a structured overview of its extensions, along with a review of commonly made design choices and a mapping of relevant literature that uses Gumbel-based methods.","https://schema.org",{"og:url":52,"og:type":87,"og:title":13,"og:site_name":59,"og:description":14},"article",{"robots":89,"canonical":52},"index,follow",{"doc_id":7,"site_id":24},{"code":4,"msg":5,"data":92},[93,97,101,105,110,114,119,122,126,129,133],{"id":20,"doc_module":4,"doc_module_name":46,"category_name":94,"show_sort_weight":95,"slug":96},"Story & Novel",90,"story-novel",{"id":47,"doc_module":4,"doc_module_name":46,"category_name":98,"show_sort_weight":99,"slug":100},"Literature",80,"literature",{"id":53,"doc_module":4,"doc_module_name":46,"category_name":102,"show_sort_weight":103,"slug":104},"Exam",70,"exam",{"id":106,"doc_module":4,"doc_module_name":46,"category_name":107,"show_sort_weight":108,"slug":109},5,"Comic",60,"comic",{"id":111,"doc_module":4,"doc_module_name":46,"category_name":112,"show_sort_weight":29,"slug":113},6,"Technology","technology",{"id":115,"doc_module":4,"doc_module_name":46,"category_name":116,"show_sort_weight":117,"slug":118},7,"Healthcare",40,"healthcare",{"id":11,"doc_module":4,"doc_module_name":46,"category_name":12,"show_sort_weight":120,"slug":121},30,"research-report",{"id":123,"doc_module":4,"doc_module_name":46,"category_name":124,"show_sort_weight":21,"slug":125},9,"Religion & Spirituality","religion-spirituality",{"id":21,"doc_module":4,"doc_module_name":46,"category_name":127,"show_sort_weight":21,"slug":128},"World Cup","world-cup",{"id":130,"doc_module":4,"doc_module_name":46,"category_name":131,"show_sort_weight":130,"slug":132},10,"Lifestyle","lifestyle",{"id":134,"doc_module":4,"doc_module_name":46,"category_name":135,"show_sort_weight":106,"slug":136},19,"General","general"]