[{"data":1,"prerenderedAt":-1},["ShallowReactive",2],{"doc-detail-119839-en":3,"doc-seo-119839-105":30,"detail-sidebar-cat-0-en-105":91},{"code":4,"msg":5,"data":6},0,"success",{"doc_id":7,"user_id":8,"nickname":9,"user_avatar":10,"doc_module":4,"category_id":11,"category_name":12,"doc_title":13,"doc_description":14,"doc_content":15,"file_id":16,"file_url":17,"file_type":18,"file_size":19,"view_count":4,"is_deleted":4,"is_public":20,"is_downloadable":20,"audit_status":20,"page_count":21,"language":22,"language_code":23,"site_id":24,"html_lang":23,"table_of_contents":25,"faqs":26,"seo_title":27,"seo_description":14,"update_tm":28,"read_time":29},119839,8796095360427,"Lucas Martin","https://ap-avatar.wpscdn.com/davatar_994ba38a5ba835b3df7d355c54d3ed8d",8,"Research & Report","Dataset Creation and Imbalance Mitigation in Big Data - Enhancing Machine Learning Models for Forest Fire Prediction","Historically, forest fire prediction methods have relied on heuristics, local insights, and basic statistical models, often missing the complex interaction among temperature, humidity, wind speed, and vegetation type. Limited real-time forecasting, combined with highly variable weather patterns linked to climate change, has revealed gaps in traditional approaches across geographically diverse regions such as Canada. This thesis applies machine learning to build an adaptive, data-driven framework using Copernicus reanalysis data and four algorithms for forest fire classification.","Dataset Creation and Imbalance Mitigation in Big Data: Enhancing Machine Learning Models for Forest  \nFire Prediction  \nby  \nFatemeh Tavakoli  \nA thesis  \npresented to the University of Waterloo  \nin fulfillment of the  \nthesis requirement for the degree of  \nMaster of Applied Science  \nin  \nElectrical and Computer Engineering  \nWaterloo, Ontario, Canada, 2023  \n© Fatemeh Tavakoli 2023  \nAuthor’s Declaration  \nI hereby declare that I am the sole author of this thesis. This is a true copy of the thesis, including any required final revisions, as accepted by my examiners.  \nI understand that my thesis may be made available electronically to the public.  \nAbstract  \nHistorically, forest fire prediction methods have leaned on heuristics, local insights, and basic statistical models, often neglecting the complex interplay of variables such as temperature, humidity, wind speed, and vegetation type. The lack of real-time prediction capabilities, paired with unpredictable weather patterns attributed to climate change, underscores the shortcomings of traditional methods, especially in geographically varied regions like Canada. In contrast, machine learning provides the adaptability needed for real-time responses, e↵ectively harnessing updated data and addressing region-specific forest fire risks. The shift towards machine learning is both a timely and revolutionary approach.  \nThis research addresses the urgent need for e↵ective forest fire prediction and management strategies, specifically in the Canadian context, by harnessing machine learning methodologies. Using Copernicus’s reanalysis data, this study establishes a comprehensive predictive framework employing four cutting-edge machine learning algorithms. Random Forest, XGBoost, LightGBM, and CatBoost. The study features a robust data preprocessing pipeline, class imbalance correction, and rigorous model evaluation measures. Key contributions include the creation of a feature-rich dataset, comprehensive methods for addressing the class imbalance in large scale datasets, and the development of a machine learning framework tailored for forest fire classification. The findings have significant implications for data-driven forest management strategies, with the aim of facilitating proactive fire prevention measures on a large scale.  \nOne primary challenge encountered was the inherent class imbalance in fire classification datasets, with a striking 158:1 ratio between “non-fire” and “fire” events. To address this, the study utilized various re-sampling strategies, encompassing under-sampling, oversampling, and hybrid techniques. Specific methods employed included NearMiss, SMOTE, and SMOTE-ENN. The NearMiss method with a 0 .09 sampling ratio was found to be particularly e↵ective in addressing this imbalance. When combined with NearMiss version 3 at a 0.09 ratio, the XGBoost model outperformed its peers, showcasing an accuracy of 98.08%, a sensitivity of 86 .06%, and a specificity of 93 .03% . The findings indicate that while high recall from NearMiss Version 3 optimized sensitivity, there was sometimes a trade-o↵ with precision.  \nAcknowledgements  \nI would like to express my deepest gratitude to my supervisor, Dr. Sagar Naik, for his unwavering support, insightful critiques, and patient mentorship throughout this research journey.  \nSpecial thanks go to my committee members, Dr. Ayman El-Hag and Dr. Ramadan El Shatshat, for their invaluable feedback and constructive suggestions.  \nI am grateful to my research group Dr. Marzia Zaman, Dr. Srini Sampalli, Dr. ChungHorng Lung, Parveen Kaur, Richard Purcell, and Abdul Mutakabbir for their companionship and support.  \nDedication  \nI dedicate this thesis to my parents, Aliakbar and Hooriyeh, who have always taught me tobe courageous and to step outside my comfort zone. Just as they did when they journeyed from our hometown of Janah, Iran, to Kish Island, then to Tehran, and eventually to Dubai, seeking a brighter future. Soon, they will be embarking on a new ","cbCaid9mzUhTHjeR","https://ap.wps.com/l/cbCaid9mzUhTHjeR","pdf",3680552,1,76,"English","en",105,"# 1 Introduction\n## 1.1 Motivation\n## 1.2 Objective\n## 1.2.1 Research Question\n## 1.2.2 Contributions\n## 1.3 Thesis Outline\n# 2 Literature Review\n## 2.1 Canada Forest Fire in Early Days\n## 2.1.1 Evolution and Efficacy of Canadian Wildland Fire Information System (CWFIS)\n## 2.2 Forest Fire and Machine Learning (ML)\n## 2.2.1 Data Collection\n## 2.2.2 Imbalance Handling Techniques\n## 2.2.3 ML in Forest Fire Domain\n# 3 Methodology\n## 3.1 Overview\n## 3.2 Notion\n## 3.2.1 Haversine Formula","[{\"question\":\"What problem does the thesis focus on for forest fire prediction?\",\"answer\":\"It addresses the need for effective, real-time forest fire prediction and management, particularly in the Canadian context, where weather variability and region-specific risks challenge traditional methods.\"},{\"question\":\"Which machine learning algorithms and data source are used?\",\"answer\":\"The study uses Copernicus reanalysis data and trains four algorithms: Random Forest, XGBoost, LightGBM, and CatBoost, within a feature-rich predictive framework.\"},{\"question\":\"How is the class imbalance handled in the dataset?\",\"answer\":\"With a strong imbalance ratio (158:1 between non-fire and fire), the thesis applies re-sampling methods including under-sampling, oversampling, and hybrid techniques such as NearMiss, SMOTE, and SMOTE-ENN.\"}]","Dataset Creation and Imbalance Mitigation in Big Data - Enhancing Machine Learning Models for Forest Fire Prediction | PDF",1785726574,192,{"code":4,"msg":31,"data":32},"ok",{"site_id":24,"language":23,"slug":33,"title":13,"keywords":34,"description":14,"schema_data":35,"social_meta":86,"head_meta":88,"extra_data":90,"updated_unix":28},"dataset-creation-and-imbalance-mitigation-in-big-data-enhancing-machine-learning-models-for-forest-fire-prediction","",{"@graph":36,"@context":85},[37,54,68],{"@type":38,"itemListElement":39},"BreadcrumbList",[40,44,48,51],{"item":41,"name":42,"@type":43,"position":20},"https://docshare.wps.com","Home","ListItem",{"item":45,"name":46,"@type":43,"position":47},"https://docshare.wps.com/document/","Document",2,{"item":49,"name":12,"@type":43,"position":50},"https://docshare.wps.com/document/research-report/",3,{"item":52,"name":13,"@type":43,"position":53},"https://docshare.wps.com/document/dataset-creation-and-imbalance-mitigation-in-big-data-enhancing-machine-learning-models-for-forest-fire-prediction/119839/",4,{"url":52,"name":13,"@type":55,"author":56,"headline":13,"publisher":58,"fileFormat":61,"inLanguage":23,"description":14,"dateModified":62,"datePublished":62,"encodingFormat":61,"isAccessibleForFree":63,"interactionStatistic":64},"DigitalDocument",{"name":9,"@type":57},"Person",{"url":41,"name":59,"@type":60},"DocShare","Organization","application/pdf","2026-08-03",true,{"@type":65,"interactionType":66,"userInteractionCount":4},"InteractionCounter",{"@type":67},"ViewAction",{"@type":69,"mainEntity":70},"FAQPage",[71,77,81],{"name":72,"@type":73,"acceptedAnswer":74},"What problem does the thesis focus on for forest fire prediction?","Question",{"text":75,"@type":76},"It addresses the need for effective, real-time forest fire prediction and management, particularly in the Canadian context, where weather variability and region-specific risks challenge traditional methods.","Answer",{"name":78,"@type":73,"acceptedAnswer":79},"Which machine learning algorithms and data source are used?",{"text":80,"@type":76},"The study uses Copernicus reanalysis data and trains four algorithms: Random Forest, XGBoost, LightGBM, and CatBoost, within a feature-rich predictive framework.",{"name":82,"@type":73,"acceptedAnswer":83},"How is the class imbalance handled in the dataset?",{"text":84,"@type":76},"With a strong imbalance ratio (158:1 between non-fire and fire), the thesis applies re-sampling methods including under-sampling, oversampling, and hybrid techniques such as NearMiss, SMOTE, and SMOTE-ENN.","https://schema.org",{"og:url":52,"og:type":87,"og:title":13,"og:site_name":59,"og:description":14},"article",{"robots":89,"canonical":52},"index,follow",{"doc_id":7,"site_id":24},{"code":4,"msg":5,"data":92},[93,97,101,105,110,115,120,123,128,131,135],{"id":20,"doc_module":4,"doc_module_name":46,"category_name":94,"show_sort_weight":95,"slug":96},"Story & Novel",90,"story-novel",{"id":47,"doc_module":4,"doc_module_name":46,"category_name":98,"show_sort_weight":99,"slug":100},"Literature",80,"literature",{"id":53,"doc_module":4,"doc_module_name":46,"category_name":102,"show_sort_weight":103,"slug":104},"Exam",70,"exam",{"id":106,"doc_module":4,"doc_module_name":46,"category_name":107,"show_sort_weight":108,"slug":109},5,"Comic",60,"comic",{"id":111,"doc_module":4,"doc_module_name":46,"category_name":112,"show_sort_weight":113,"slug":114},6,"Technology",50,"technology",{"id":116,"doc_module":4,"doc_module_name":46,"category_name":117,"show_sort_weight":118,"slug":119},7,"Healthcare",40,"healthcare",{"id":11,"doc_module":4,"doc_module_name":46,"category_name":12,"show_sort_weight":121,"slug":122},30,"research-report",{"id":124,"doc_module":4,"doc_module_name":46,"category_name":125,"show_sort_weight":126,"slug":127},9,"Religion & Spirituality",20,"religion-spirituality",{"id":126,"doc_module":4,"doc_module_name":46,"category_name":129,"show_sort_weight":126,"slug":130},"World Cup","world-cup",{"id":132,"doc_module":4,"doc_module_name":46,"category_name":133,"show_sort_weight":132,"slug":134},10,"Lifestyle","lifestyle",{"id":136,"doc_module":4,"doc_module_name":46,"category_name":137,"show_sort_weight":106,"slug":138},19,"General","general"]