[{"data":1,"prerenderedAt":-1},["ShallowReactive",2],{"doc-detail-160443-en":3,"doc-seo-160443-105":31,"detail-sidebar-cat-0-en-105":93},{"code":4,"msg":5,"data":6},0,"success",{"doc_id":7,"user_id":8,"nickname":9,"user_avatar":10,"doc_module":4,"category_id":11,"category_name":12,"doc_title":13,"doc_description":14,"doc_content":15,"file_id":16,"file_url":17,"file_type":18,"file_size":19,"view_count":20,"is_deleted":4,"is_public":21,"is_downloadable":21,"audit_status":21,"page_count":22,"language":23,"language_code":24,"site_id":25,"html_lang":24,"table_of_contents":26,"faqs":27,"seo_title":28,"seo_description":14,"update_tm":29,"read_time":30},160443,549768702563,"Fahsai","https://ap-avatar.wpscdn.com/avatar/8000c4aa63b76e948b?x-image-process=image/resize,m_fixed,w_180,h_180&k=1786536092046926083",8,"Research & Report","Mitigating Data Scarcity for Neural Language Models","Mitigating Data Scarcity for Neural Language Models focuses on addressing limited training data in neural language modeling. The dissertation is presented as a Doctor of Philosophy thesis from the University of Arizona’s Department of Computer Science, supported by committee review and author statements. The materials include an acknowledgments section, land acknowledgment, and dedication, reflecting academic context and collaborative research background. Overall, the work targets practical improvements in how language models learn when available datasets are insufficient.","MITIGATING DATA SCARCITY FOR NEURAL LANGUAGE MODELS  \nby  \narXiv :2302 .0 1806v 1 [ cs .CL] 3 Feb 2023  \nHoang Nguyen Hung Van  \nCopyright © Hoang Nguyen Hung Van 2022  \nA Dissertation Submitted to the Faculty of the  \nDEPARTMENT OF COMPUTER SCIENCE  \nIn Partial Fulfillment of the Requirements  \nFor the Degree of  \nDOCTOR OF PHILOSOPHY  \nIn the Graduate College  \nTHE UNIVERSITY OF ARIZONA  \n2  \nTHE UNIVERSITY OF ARIZONA  \nGRADUATE COLLEGE  \nAs members of the Dissertation Committee, we certify that we have read the dissertation prepared by: Hoang Van, titled: Mitigating Data Scarcity for Neural Language Models  \nand recommend that it be accepted as fulfilling the dissertation requirement for the Degree of Doctor of Philosophy.  \n\n| Dr. Mihai Surdeanu |\n| --- |\n| Dr. Joshua Levine |\n| Dr. Steven Bethard\u003Cbr>\u003Cbr>\u003Cbr>|\n\nDr. Gus Hahn-Powell  \nDec 31, 2022 Date:    \nDec 31, 2022 Date:    \nDec 31, 2022 Date:    \nDec 15, 2022 Date:    \nFinal approval and acceptance of this dissertation is contingent upon the candidate’s submission of the final copies of the dissertation to the Graduate College.  \nI hereby certify that I have read this dissertation prepared under my direction and recommend that it be accepted as fulfilling the dissertation requirement.  \n_________________________________________________________________  \nDr. Mihai Surdeanu Dissertation Committee Chair Computer Science Department  \nDate:  \nDec 31, 2022  \n____________  \n3  \nSTATEMENT BY THE AUTHOR  \nThis dissertation has been submitted in partial fulfillment of requirements for an advanced  \ndegree at the University of Arizona and is deposited in the University Library to be made available to borrowers under rules of the Library.  \nBrief quotations from this dissertation are allowable without special permission, provided that accurate acknowledgment of the source is made. This work is licensed under the Creative Commons Attribution-No Derivative Works 3 .0 United States License. To view a copy of this license, visit [http://creativecommons.org/licenses/by-nd/3.0/us/ or](http://creativecommons.org/licenses/by-nd/3.0/us/ or) send a letter to Creative Commons, 171 Second Street, Suite 300, San Francisco, California, 94105, USA.  \n4  \nACKNOWLEDGMENTS  \nFirst and foremost, my deepest thanks go to my mom to whom I will always bear a debt that I will never be able to repay in full. I want to thank her for tolerating all of my immature stupidities and for being there for me unconditionally.  \nI would also like to express my greatest gratitude to my advisor Mihai, who is also a mentor and a role model to me. Since my first interaction with him, I have always been impressed by his utmost care for his students both in terms of their academic success and personal challenges. His research directions and endless lessons have shaped me into the young and enthusiastic researcher as I am now. In the past four and a half years, he has given a treasure of knowledge that I cannot express in writing.  \nNext, I would like to express my sincere gratitude to the other members of my PhD committee, Steve, Josh, and Gus, for their encouragement, support, and guidance. I learned a lot about how to best visualize data and results so that they will convey impactfuland precise meanings. In particular, I would like to thank Steve for always being willing to provide a second perspective on all of my research work. To Gus, thank you for training me to become a real linguist. Thanks to all professors who have dedicated their time to equipping me with the priceless knowledge that made this dissertation possible and shaped the strong foundation for my research career.  \nI will always be grateful to Dr. Begoli and his team at Oak Ridge National Laboratories for their valuable guidance and research collaboration opportunities. Their research has given me the motivation of applying NLP advances in the medical field. I will remember all the research discussions and life lessons learned during my time at the lab.  \nI","cbCail9Y84LoCAI7","https://ap.wps.com/l/cbCail9Y84LoCAI7","pdf",3966092,5,1,155,"English","en",105,"# Table of Contents\n## List of Figures","[{\"question\":\"What problem does the dissertation focus on?\",\"answer\":\"It focuses on mitigating data scarcity in neural language models, i.e., improving model learning when training data is limited.\"},{\"question\":\"Who are the dissertation committee members?\",\"answer\":\"The text lists Dr. Mihai Surdeanu (committee chair), Dr. Joshua Levine, Dr. Steven Bethard, and Dr. Gus Hahn-Powell.\"},{\"question\":\"What formal statements are included in the dissertation front matter?\",\"answer\":\"It includes a Statement by the Author describing submission requirements and licensing, along with acknowledgments, land acknowledgment, and a dedication.\"}]","Mitigating Data Scarcity for Neural Language Models | PDF",1788063453,391,{"code":4,"msg":32,"data":33},"ok",{"site_id":25,"language":24,"slug":34,"title":13,"keywords":35,"description":14,"schema_data":36,"social_meta":88,"head_meta":90,"extra_data":92,"updated_unix":29},"mitigating-data-scarcity-for-neural-language-models","",{"@graph":37,"@context":87},[38,55,70],{"@type":39,"itemListElement":40},"BreadcrumbList",[41,45,49,52],{"item":42,"name":43,"@type":44,"position":21},"https://docshare.wps.com","Home","ListItem",{"item":46,"name":47,"@type":44,"position":48},"https://docshare.wps.com/document/","Document",2,{"item":50,"name":12,"@type":44,"position":51},"https://docshare.wps.com/document/research-report/",3,{"item":53,"name":13,"@type":44,"position":54},"https://docshare.wps.com/document/mitigating-data-scarcity-for-neural-language-models/160443/",4,{"url":53,"name":13,"@type":56,"author":57,"headline":13,"publisher":59,"fileFormat":62,"inLanguage":24,"description":14,"dateModified":63,"datePublished":64,"encodingFormat":62,"isAccessibleForFree":65,"interactionStatistic":66},"DigitalDocument",{"name":9,"@type":58},"Person",{"url":42,"name":60,"@type":61},"DocShare","Organization","application/pdf","2026-09-04","2026-08-30",true,{"@type":67,"interactionType":68,"userInteractionCount":20},"InteractionCounter",{"@type":69},"ViewAction",{"@type":71,"mainEntity":72},"FAQPage",[73,79,83],{"name":74,"@type":75,"acceptedAnswer":76},"What problem does the dissertation focus on?","Question",{"text":77,"@type":78},"It focuses on mitigating data scarcity in neural language models, i.e., improving model learning when training data is limited.","Answer",{"name":80,"@type":75,"acceptedAnswer":81},"Who are the dissertation committee members?",{"text":82,"@type":78},"The text lists Dr. Mihai Surdeanu (committee chair), Dr. Joshua Levine, Dr. Steven Bethard, and Dr. Gus Hahn-Powell.",{"name":84,"@type":75,"acceptedAnswer":85},"What formal statements are included in the dissertation front matter?",{"text":86,"@type":78},"It includes a Statement by the Author describing submission requirements and licensing, along with acknowledgments, land acknowledgment, and a dedication.","https://schema.org",{"og:url":53,"og:type":89,"og:title":13,"og:site_name":60,"og:description":14},"article",{"robots":91,"canonical":53},"index,follow",{"doc_id":7,"site_id":25},{"code":4,"msg":5,"data":94},[95,99,103,107,111,116,121,124,129,132,136],{"id":21,"doc_module":4,"doc_module_name":47,"category_name":96,"show_sort_weight":97,"slug":98},"Story & Novel",90,"story-novel",{"id":48,"doc_module":4,"doc_module_name":47,"category_name":100,"show_sort_weight":101,"slug":102},"Literature",80,"literature",{"id":54,"doc_module":4,"doc_module_name":47,"category_name":104,"show_sort_weight":105,"slug":106},"Exam",70,"exam",{"id":20,"doc_module":4,"doc_module_name":47,"category_name":108,"show_sort_weight":109,"slug":110},"Comic",60,"comic",{"id":112,"doc_module":4,"doc_module_name":47,"category_name":113,"show_sort_weight":114,"slug":115},6,"Technology",50,"technology",{"id":117,"doc_module":4,"doc_module_name":47,"category_name":118,"show_sort_weight":119,"slug":120},7,"Healthcare",40,"healthcare",{"id":11,"doc_module":4,"doc_module_name":47,"category_name":12,"show_sort_weight":122,"slug":123},30,"research-report",{"id":125,"doc_module":4,"doc_module_name":47,"category_name":126,"show_sort_weight":127,"slug":128},9,"Religion & Spirituality",20,"religion-spirituality",{"id":127,"doc_module":4,"doc_module_name":47,"category_name":130,"show_sort_weight":127,"slug":131},"World Cup","world-cup",{"id":133,"doc_module":4,"doc_module_name":47,"category_name":134,"show_sort_weight":133,"slug":135},10,"Lifestyle","lifestyle",{"id":137,"doc_module":4,"doc_module_name":47,"category_name":138,"show_sort_weight":20,"slug":139},19,"General","general"]