[{"data":1,"prerenderedAt":-1},["ShallowReactive",2],{"detail-sidebar-cat-0-en-105":3,"doc-seo-203363-105":59,"doc-detail-203363-en":130},{"code":4,"msg":5,"data":6},0,"success",[7,13,18,23,28,33,38,43,48,51,55],{"id":8,"doc_module":4,"doc_module_name":9,"category_name":10,"show_sort_weight":11,"slug":12},1,"Document","Story & Novel",90,"story-novel",{"id":14,"doc_module":4,"doc_module_name":9,"category_name":15,"show_sort_weight":16,"slug":17},2,"Literature",80,"literature",{"id":19,"doc_module":4,"doc_module_name":9,"category_name":20,"show_sort_weight":21,"slug":22},4,"Exam",70,"exam",{"id":24,"doc_module":4,"doc_module_name":9,"category_name":25,"show_sort_weight":26,"slug":27},5,"Comic",60,"comic",{"id":29,"doc_module":4,"doc_module_name":9,"category_name":30,"show_sort_weight":31,"slug":32},6,"Technology",50,"technology",{"id":34,"doc_module":4,"doc_module_name":9,"category_name":35,"show_sort_weight":36,"slug":37},7,"Healthcare",40,"healthcare",{"id":39,"doc_module":4,"doc_module_name":9,"category_name":40,"show_sort_weight":41,"slug":42},8,"Research & Report",30,"research-report",{"id":44,"doc_module":4,"doc_module_name":9,"category_name":45,"show_sort_weight":46,"slug":47},9,"Religion & Spirituality",20,"religion-spirituality",{"id":46,"doc_module":4,"doc_module_name":9,"category_name":49,"show_sort_weight":46,"slug":50},"World Cup","world-cup",{"id":52,"doc_module":4,"doc_module_name":9,"category_name":53,"show_sort_weight":52,"slug":54},10,"Lifestyle","lifestyle",{"id":56,"doc_module":4,"doc_module_name":9,"category_name":57,"show_sort_weight":24,"slug":58},19,"General","general",{"code":4,"msg":60,"data":61},"ok",{"site_id":62,"language":63,"slug":64,"title":65,"keywords":66,"description":67,"schema_data":68,"social_meta":123,"head_meta":125,"extra_data":127,"updated_unix":129},105,"en","evaluating-data-mining-models-a-pattern-language-force-resolution-map","Evaluating Data Mining Models - A Pattern Language - Force Resolution Map","","This paper extracts and documents reusable patterns for evaluating data mining models, organizing five recurring solutions into a coherent pattern language. The patterns vary by application context and by how they address the evaluation challenge when only limited data is available. It also introduces a new pattern component, the “Force Resolution Map”, arguing that these maps clarify how forces are balanced not only in data mining patterns, but in patterns more generally.",{"@graph":69,"@context":122},[70,84,105],{"@type":71,"itemListElement":72},"BreadcrumbList",[73,77,79,82],{"item":74,"name":75,"@type":76,"position":8},"https://docshare.wps.com","Home","ListItem",{"item":78,"name":9,"@type":76,"position":14},"https://docshare.wps.com/document/",{"item":80,"name":40,"@type":76,"position":81},"https://docshare.wps.com/document/research-report/",3,{"item":83,"name":65,"@type":76,"position":19},"https://docshare.wps.com/document/evaluating-data-mining-models-a-pattern-language-force-resolution-map/203363/",{"url":83,"name":65,"@type":85,"image":86,"author":91,"headline":65,"publisher":94,"fileFormat":97,"inLanguage":63,"description":67,"dateModified":98,"datePublished":99,"encodingFormat":97,"isAccessibleForFree":100,"interactionStatistic":101},"DigitalDocument",{"url":87,"@type":88,"width":89,"height":90},"https://docshare.wps.com/thumbnails/evaluating-data-mining-models-a-pattern-language-force-resolution-map/203363.png","ImageObject",300,407,{"name":92,"@type":93},"Rowan","Person",{"url":74,"name":95,"@type":96},"DocShare","Organization","application/pdf","2026-10-08","2026-09-04",true,{"@type":102,"interactionType":103,"userInteractionCount":24},"InteractionCounter",{"@type":104},"ViewAction",{"@type":106,"mainEntity":107},"FAQPage",[108,114,118],{"name":109,"@type":110,"acceptedAnswer":111},"What problem does the paper address in evaluating data mining models?","Question",{"text":112,"@type":113},"It focuses on identifying recurring solutions for evaluating data mining models, especially the need for unbiased performance estimates when only limited data is available.","Answer",{"name":115,"@type":110,"acceptedAnswer":116},"How are the five patterns organized in the paper?",{"text":117,"@type":113},"They are organized as a pattern language, and the patterns differ by their context of application and how they resolve the evaluation problem under data constraints.",{"name":119,"@type":110,"acceptedAnswer":120},"What is the Force Resolution Map (FRM) and why is it introduced?",{"text":121,"@type":113},"FRMs are a graphical tool that uses numeric indicators to show how a pattern resolves its forces, making trade-offs clearer and supporting readers in deciding whether a pattern fits their requirements.","https://schema.org",{"og:url":83,"og:type":124,"og:title":65,"og:site_name":95,"og:description":67},"article",{"robots":126,"canonical":83},"index,follow",{"doc_id":128,"site_id":62},203363,1791410907,{"code":4,"msg":5,"data":131},{"doc_id":128,"user_id":132,"nickname":92,"user_avatar":133,"doc_module":4,"category_id":39,"category_name":40,"doc_title":65,"doc_description":67,"doc_content":134,"file_id":135,"file_url":136,"file_type":137,"file_size":138,"view_count":24,"is_deleted":4,"is_public":8,"is_downloadable":8,"audit_status":8,"page_count":139,"language":140,"language_code":63,"site_id":62,"html_lang":63,"table_of_contents":141,"faqs":142,"seo_title":143,"seo_description":67,"update_tm":144,"read_time":145},1099514067415,"https://ap-avatar.wpscdn.com/avatar/100002539d78ffe74a7?x-image-process=image/resize,m_fixed,w_180,h_180&k=1779092875211072502","Evaluating Data Mining Models: A Pattern Language  \nJerffeson Souza¤ Stan Matwin Nathalie Japkowicz  \nSchool of Information Technology and Engineering University of Ottawa  \nK1N 6N5, Canada  \nfjsouza,stan,[nat](natg@site.uottawa.ca)[g](natg@site.uottawa.ca)[@site.uottawa.ca](natg@site.uottawa.ca)  \nAbstract  \nThis paper extracts and documents patterns that identify recurring solutions for the problem of evaluation of data mining models. The five patterns presented in this paper are organized as a pattern language. The patterns di®er in their context of application and how they solve the evaluation problem, especially when only limited amounts of data are available. Another contribution of this paper is the introduction of a new pattern section called “Force Resolution Map”. We believe that Force Resolution Maps illuminate not only these data mining patterns, but are generally useful in explicating any patterns.  \nKeywords: Model evaluation, data mining, software patterns, force resolution map.  \n1 Introduction  \nEvaluation is one the key points in any data mining process. It serves two purposes: the prediction of how well the ¯nal model will work in the future (or even whether it should be used at all), and as an integral part of many learning methods, which help ¯nd the model that best represents the training data. In this paper, we deal speci¯cally with the ¯rst case, how well the model will work.  \n¤ Sponsored by CAPES (Brazilian Federal Agency for Graduate Studies) .  \nIn most cases, prediction is not as simple as it might appear. The main problem occurs when the data used for training a data mining model are used in estimating the performance of that model. This generates a non-realistic and overoptimistic prediction in a manner considered unacceptable by the data mining community.  \nWhen a vast supply of data is available, this problem is minimised, since one could use a large slice of data for training and would still have another large portion to be used as test data. The pattern Hold-Out deals with this situation. On the other hand, when only a limited amount of data is available, more complex methods are necessary to achieve an unbiased estimate of the model performance over unseen examples. Patterns K-fold Cross-validation, Leave-one-out and Bootstrap present three alternatives for such evaluation, depending on the number of examples available. The pattern Model Evaluation guides a designer in choosing the best technique in a particular context.  \nThese patterns are intended for novices in the data mining world trying to understand the essence of data mining evaluation, for experienced data miners dealing with complex mining projects, and as a reference for experts.  \nIn the next section, we describe how the patterns are organized. Then we propose a new pattern section called “Force Resolution Map”, and describe its motivation, notation and applicability. Next, we present an overview of the pattern language, as well as the patterns themselves. Finally, we o®er some conclusions.  \n2 Guidelines for the Readers  \nThe pattern form used here consists of nine sections. The Context section shows the situations in which the pattern may be applied. The Problem section presents the problem the pattern solves, expressed as a question. The Forces section describes the driving forces behind possible solutions. The Solution section presents an answer to the problem that resolves the forces as well as possible. The Rationale section explains the rationale behind the solution. The Resulting Context section describes the context that obtains after the pattern has been applied. In the Related Patterns section, we list other patterns that have some relationship with this pattern and describe those relationships. The Known Uses section shows where the pattern has been applied. Finally, we introduce the new section Force Resolution Map for a graphical presentation of how the forces are solved.  \nSome sections are not present in some patte","cbCaiqJEPNXYk5PR","https://ap.wps.com/l/cbCaiqJEPNXYk5PR","pdf",139012,23,"English","# Abstract\n# 1 Introduction\n## Evaluation purposes in data mining\n## Overoptimistic prediction and data limitations\n# 2 Guidelines for the Readers\n## Pattern form sections\n# 3 Force Resolution Map (FRM): A New Pattern Component\n## The role of FRMs\n## The graphical representation","[{\"question\":\"What problem does the paper address in evaluating data mining models?\",\"answer\":\"It focuses on identifying recurring solutions for evaluating data mining models, especially the need for unbiased performance estimates when only limited data is available.\"},{\"question\":\"How are the five patterns organized in the paper?\",\"answer\":\"They are organized as a pattern language, and the patterns differ by their context of application and how they resolve the evaluation problem under data constraints.\"},{\"question\":\"What is the Force Resolution Map (FRM) and why is it introduced?\",\"answer\":\"FRMs are a graphical tool that uses numeric indicators to show how a pattern resolves its forces, making trade-offs clearer and supporting readers in deciding whether a pattern fits their requirements.\"}]","Evaluating Data Mining Models - A Pattern Language - Force Resolution Map | PDF",1788560346,58]