Mitigating Data Scarcity for Neural Language Models

Aug 30, 2026

Upload by Fahsai

Mitigating Data Scarcity for Neural Language Models focuses on addressing limited training data in neural language modeling. The dissertation is presented as a Doctor of Philosophy thesis from the University of Arizona’s Department of Computer Science, supported by committee review and author statements. The materials include an acknowledgments section, land acknowledgment, and dedication, reflecting academic context and collaborative research background. Overall, the work targets practical improvements in how language models learn when available datasets are insufficient.

LanguageEnglish

CategoryResearch & Report

FormatPDF

Pages155

Reading Time6 h 31 min

AccessFree to download

Table of Contents

List of Figures

MITIGATING DATA SCARCITY FOR NEURAL LANGUAGE MODELS by arXiv :2302 .0 1806v 1 [ cs .CL] 3 Feb 2023 Hoang Nguyen Hung Van Copyright © Hoang Nguyen Hung Van 2022 A Dissertation Submitted to the Faculty of the DEPARTMENT OF COMPUTER SCIENCE In Partial Fulﬁllment of the Requirements For the Degree of DOCTOR OF PHILOSOPHY In the Graduate College THE UNIVERSITY OF ARIZONA 2 THE UNIVERSITY OF ARIZONA GRADUATE COLLEGE As members of the Dissertation Committee, we certify that we have read the dissertation prepared by: Hoang Van, titled: Mitigating Data Scarcity for Neural Language Models and recommend that it be accepted as fulfilling the dissertation requirement for the Degree of Doctor of Philosophy. | Dr. Mihai Surdeanu | | --- | | Dr. Joshua Levine | | Dr. Steven Bethard

| Dr. Gus Hahn-Powell Dec 31, 2022 Date: Dec 31, 2022 Date: Dec 31, 2022 Date: Dec 15, 2022 Date: Final approval and acceptance of this dissertation is contingent upon the candidate’s submission of the final copies of the dissertation to the Graduate College. I hereby certify that I have read this dissertation prepared under my direction and recommend that it be accepted as fulfilling the dissertation requirement. _________________________________________________________________ Dr. Mihai Surdeanu Dissertation Committee Chair Computer Science Department Date: Dec 31, 2022 ____________ 3 STATEMENT BY THE AUTHOR This dissertation has been submitted in partial fulﬁllment of requirements for an advanced degree at the University of Arizona and is deposited in the University Library to be made available to borrowers under rules of the Library. Brief quotations from this dissertation are allowable without special permission, provided that accurate acknowledgment of the source is made. This work is licensed under the Creative Commons Attribution-No Derivative Works 3 .0 United States License. To view a copy of this license, visit [http://creativecommons.org/licenses/by-nd/3.0/us/ or](http://creativecommons.org/licenses/by-nd/3.0/us/ or) send a letter to Creative Commons, 171 Second Street, Suite 300, San Francisco, California, 94105, USA. 4 ACKNOWLEDGMENTS First and foremost, my deepest thanks go to my mom to whom I will always bear a debt that I will never be able to repay in full. I want to thank her for tolerating all of my immature stupidities and for being there for me unconditionally. I would also like to express my greatest gratitude to my advisor Mihai, who is also a mentor and a role model to me. Since my ﬁrst interaction with him, I have always been impressed by his utmost care for his students both in terms of their academic success and personal challenges. His research directions and endless lessons have shaped me into the young and enthusiastic researcher as I am now. In the past four and a half years, he has given a treasure of knowledge that I cannot express in writing. Next, I would like to express my sincere gratitude to the other members of my PhD committee, Steve, Josh, and Gus, for their encouragement, support, and guidance. I learned a lot about how to best visualize data and results so that they will convey impactfuland precise meanings. In particular, I would like to thank Steve for always being willing to provide a second perspective on all of my research work. To Gus, thank you for training me to become a real linguist. Thanks to all professors who have dedicated their time to equipping me with the priceless knowledge that made this dissertation possible and shaped the strong foundation for my research career. I will always be grateful to Dr. Begoli and his team at Oak Ridge National Laboratories for their valuable guidance and research collaboration opportunities. Their research has given me the motivation of applying NLP advances in the medical ﬁeld. I will remember all the research discussions and life lessons learned during my time at the lab. I

FAQs

What problem does the dissertation focus on?

It focuses on mitigating data scarcity in neural language models, i.e., improving model learning when training data is limited.

Who are the dissertation committee members?

The text lists Dr. Mihai Surdeanu (committee chair), Dr. Joshua Levine, Dr. Steven Bethard, and Dr. Gus Hahn-Powell.

What formal statements are included in the dissertation front matter?

It includes a Statement by the Author describing submission requirements and licensing, along with acknowledgments, land acknowledgment, and a dedication.

Aug 30, 2026

Upload by Fahsai