[{"data":1,"prerenderedAt":-1},["ShallowReactive",2],{"doc-detail-123059-en":3,"doc-seo-123059-105":30,"detail-sidebar-cat-0-en-105":91},{"code":4,"msg":5,"data":6},0,"success",{"doc_id":7,"user_id":8,"nickname":9,"user_avatar":10,"doc_module":4,"category_id":11,"category_name":12,"doc_title":13,"doc_description":14,"doc_content":15,"file_id":16,"file_url":17,"file_type":18,"file_size":19,"view_count":20,"is_deleted":4,"is_public":20,"is_downloadable":20,"audit_status":20,"page_count":21,"language":22,"language_code":23,"site_id":24,"html_lang":23,"table_of_contents":25,"faqs":26,"seo_title":27,"seo_description":14,"update_tm":28,"read_time":29},123059,8796095461610,"Oliver","https://ap-avatar.wpscdn.com/davatar_276721f389ce27ea32af1340a28f341c",8,"Research & Report","LCEN - A Novel Feature Selection Algorithm for Nonlinear, Interpretable Machine Learning Models - preprint","Interpretable machine learning models strengthen trust in high-stakes applications, yet common sparse linear architectures like LASSO and elastic net are limited to linear predictions and can struggle with feature selection. The LCEN algorithm (LASSO-Clip-EN) enables nonlinear, interpretable models while producing accurate, sparser solutions. LCEN is tested across artificial and empirical datasets and remains robust to noise, multicollinearity, data scarcity, and hyperparameter variation, rediscovering multiple physical laws from data.","LCEN: A Novel Feature Selection Algorithm for Nonlinear, Interpretable Machine Learning Models  \narXiv :2402 . 17 120v2 [ cs .LG] 6 Jun 2024  \nPedro Seber  \nDepartment of Chemical Engineering Massachusetts Institute of Technology Cambridge, MA 02139 [pseber@mit.edu](pseber@mit.edu)  \nRichard D. Braatz  \nDepartment of Chemical Engineering Massachusetts Institute of Technology Cambridge, MA 02139 [braatz@mit.edu](braatz@mit.edu)  \nAbstract  \nInterpretable architectures can have advantages over black-box architectures, and interpretability is essential for the application of machine learning in critical settings, such as aviation or medicine. However, the simplest, most commonly used interpretable architectures, such as LASSO or elastic net (EN), are limited to linear predictions and have poor feature selection capabilities. In this work, we introduce the LASSO-Clip-EN (LCEN) algorithm for the creation of nonlinear, interpretable machine learning models. LCEN is tested on a wide variety of artificial and empirical datasets, frequently creating more accurate, sparser models than other architectures, including those for building sparse, nonlinear models. LCEN is robust against many issues typically present in datasets and modeling, including noise, multicollinearity, data scarcity, and hyperparameter variance. LCEN is also able to rediscover multiple physical laws from empirical data and, for processes with no known physical laws, LCEN achieves better results than many other dense and sparse methods – including using 10.8-fold fewer features than dense methods and  \n8.1-fold fewer features than EN on one dataset, and is comparable to or better than ANNs on multiple datasets.  \n1 Introduction  \nStatistical models are powerful tools to explain, predict, or describe natural phenomena [1] . They connect independent variables (also called “inputs” or “features”) to dependent variables (also called“outputs” or “labels”) to test causal hypotheses, predict novel outputs from known inputs, or summarizing the data structure [1] . Many model architectures exist, including linear, ensemble-based, and deep learning models. Complex architectures are claimed to have greater capability to model phenomena due to their lower bias, but their intricate and numerous mathematical transformations prevent humans from understanding how an output was predicted by a model, or the relative or absolute importance of the inputs. Moreover, a lack of transparency may prevent the model from being trusted in critical or sensitive applications [2] .  \nAs summarized by Ref. [3], there are two main methods to increase interpretability: the use of model-agnostic algorithms, which extract interpretable explanations a posteriori and work for any architecture, or the direct use of interpretable architectures. Interpretable architectures include “decision trees, rules, additive models, attention-based networks, and sparse linear models” [3] . It should be noted that nonlinear models may also be made sparse, and even interpretable, as described later in this section and the rest of this work. As elaborated in the review of Ref. [4], interpretable architectures can have many advantages over black-box or a posteriori explanations, including the ability to assist researchers in refining the model and data, or better highlighting scenarios in which the model fails or lacks robustness. Special attention should be given to sparse models, which identify  \nPreprint. Under review.  \nthe most important features, can make the model more robust to variations in the input data, and can significantly improve the model’s interpretability if an interpretable architecture is used [4] . At the same time, even a linear model or decision tree/rules can become unwieldy and uninterpretable if hundreds or thousands of coefficients or rules are present.  \nFeature selection is the process of selecting the most important features in a model to increase its robustness or interpretability. Many criter","cbCaiqyNdb1LYHd0","https://ap.wps.com/l/cbCaiqyNdb1LYHd0","pdf",1374115,1,20,"English","en",105,"# Abstract\n# 1 Introduction\n## Statistical models and interpretability\n## Feature selection overview\n## Limitations of common interpretable sparse models\n## Extending sparse models to nonlinear settings","[{\"question\":\"What problem does LCEN address in interpretable machine learning?\",\"answer\":\"LCEN targets the limitation of common interpretable sparse linear methods like LASSO and elastic net, which are restricted to linear predictions and often underperform in feature selection.\"},{\"question\":\"How does LCEN perform feature selection and model interpretability?\",\"answer\":\"LCEN creates nonlinear, interpretable machine learning models and frequently yields more accurate, sparser solutions than other architectures, including approaches for sparse nonlinear modeling.\"},{\"question\":\"What kinds of dataset and modeling challenges is LCEN robust against?\",\"answer\":\"LCEN is reported to be robust to noise, multicollinearity, data scarcity, and hyperparameter variance, which often degrade model performance and reliability.\"}]","LCEN - A Novel Feature Selection Algorithm for Nonlinear, Interpretable Machine Learning Models - preprint | PDF",1785814436,50,{"code":4,"msg":31,"data":32},"ok",{"site_id":24,"language":23,"slug":33,"title":13,"keywords":34,"description":14,"schema_data":35,"social_meta":86,"head_meta":88,"extra_data":90,"updated_unix":28},"lcen-a-novel-feature-selection-algorithm-for-nonlinear-interpretable-machine-learning-models-preprint","",{"@graph":36,"@context":85},[37,54,68],{"@type":38,"itemListElement":39},"BreadcrumbList",[40,44,48,51],{"item":41,"name":42,"@type":43,"position":20},"https://docshare.wps.com","Home","ListItem",{"item":45,"name":46,"@type":43,"position":47},"https://docshare.wps.com/document/","Document",2,{"item":49,"name":12,"@type":43,"position":50},"https://docshare.wps.com/document/research-report/",3,{"item":52,"name":13,"@type":43,"position":53},"https://docshare.wps.com/document/lcen-a-novel-feature-selection-algorithm-for-nonlinear-interpretable-machine-learning-models-preprint/123059/",4,{"url":52,"name":13,"@type":55,"author":56,"headline":13,"publisher":58,"fileFormat":61,"inLanguage":23,"description":14,"dateModified":62,"datePublished":62,"encodingFormat":61,"isAccessibleForFree":63,"interactionStatistic":64},"DigitalDocument",{"name":9,"@type":57},"Person",{"url":41,"name":59,"@type":60},"DocShare","Organization","application/pdf","2026-08-04",true,{"@type":65,"interactionType":66,"userInteractionCount":20},"InteractionCounter",{"@type":67},"ViewAction",{"@type":69,"mainEntity":70},"FAQPage",[71,77,81],{"name":72,"@type":73,"acceptedAnswer":74},"What problem does LCEN address in interpretable machine learning?","Question",{"text":75,"@type":76},"LCEN targets the limitation of common interpretable sparse linear methods like LASSO and elastic net, which are restricted to linear predictions and often underperform in feature selection.","Answer",{"name":78,"@type":73,"acceptedAnswer":79},"How does LCEN perform feature selection and model interpretability?",{"text":80,"@type":76},"LCEN creates nonlinear, interpretable machine learning models and frequently yields more accurate, sparser solutions than other architectures, including approaches for sparse nonlinear modeling.",{"name":82,"@type":73,"acceptedAnswer":83},"What kinds of dataset and modeling challenges is LCEN robust against?",{"text":84,"@type":76},"LCEN is reported to be robust to noise, multicollinearity, data scarcity, and hyperparameter variance, which often degrade model performance and reliability.","https://schema.org",{"og:url":52,"og:type":87,"og:title":13,"og:site_name":59,"og:description":14},"article",{"robots":89,"canonical":52},"index,follow",{"doc_id":7,"site_id":24},{"code":4,"msg":5,"data":92},[93,97,101,105,110,114,119,122,126,129,133],{"id":20,"doc_module":4,"doc_module_name":46,"category_name":94,"show_sort_weight":95,"slug":96},"Story & Novel",90,"story-novel",{"id":47,"doc_module":4,"doc_module_name":46,"category_name":98,"show_sort_weight":99,"slug":100},"Literature",80,"literature",{"id":53,"doc_module":4,"doc_module_name":46,"category_name":102,"show_sort_weight":103,"slug":104},"Exam",70,"exam",{"id":106,"doc_module":4,"doc_module_name":46,"category_name":107,"show_sort_weight":108,"slug":109},5,"Comic",60,"comic",{"id":111,"doc_module":4,"doc_module_name":46,"category_name":112,"show_sort_weight":29,"slug":113},6,"Technology","technology",{"id":115,"doc_module":4,"doc_module_name":46,"category_name":116,"show_sort_weight":117,"slug":118},7,"Healthcare",40,"healthcare",{"id":11,"doc_module":4,"doc_module_name":46,"category_name":12,"show_sort_weight":120,"slug":121},30,"research-report",{"id":123,"doc_module":4,"doc_module_name":46,"category_name":124,"show_sort_weight":21,"slug":125},9,"Religion & Spirituality","religion-spirituality",{"id":21,"doc_module":4,"doc_module_name":46,"category_name":127,"show_sort_weight":21,"slug":128},"World Cup","world-cup",{"id":130,"doc_module":4,"doc_module_name":46,"category_name":131,"show_sort_weight":130,"slug":132},10,"Lifestyle","lifestyle",{"id":134,"doc_module":4,"doc_module_name":46,"category_name":135,"show_sort_weight":106,"slug":136},19,"General","general"]