[{"data":1,"prerenderedAt":-1},["ShallowReactive",2],{"doc-detail-128790-en":3,"doc-seo-128790-105":29,"detail-sidebar-cat-0-en-105":90},{"code":4,"msg":5,"data":6},0,"success",{"doc_id":7,"user_id":8,"nickname":9,"user_avatar":10,"doc_module":4,"category_id":11,"category_name":12,"doc_title":13,"doc_description":14,"doc_content":15,"file_id":16,"file_url":17,"file_type":18,"file_size":19,"view_count":20,"is_deleted":4,"is_public":20,"is_downloadable":20,"audit_status":20,"page_count":20,"language":21,"language_code":22,"site_id":23,"html_lang":22,"table_of_contents":24,"faqs":25,"seo_title":26,"seo_description":14,"update_tm":27,"read_time":28},128790,1099523885336,"Violet","https://ap-avatar.wpscdn.com/davatar_276721f389ce27ea32af1340a28f341c",8,"Research & Report","Investigating Skin Cancer Diagnosis with Machine Learning - A Comparative Study of Feature Selection and Feature Extraction Techniques","Early skin cancer detection improves treatment outcomes, motivating automated image-based classification. This project evaluates how feature selection and feature extraction affect model performance for skin cancer image classification on the HAM10000 dataset. Images are resized and converted to grayscale for non-deep approaches, then dimensionality reduction is applied using resizing, Lasso-based selection, Select K Best, and PCA. Deep and transfer learning are compared using VGG16, Xception, InceptionV3 plus LightGBM, and a fine-tuned transfer learning pipeline. Binary and multi-class results are assessed with AUC and accuracy using stratified 3-fold cross-validation. Fine-tuning yields the best overall accuracy, while AUC may drop due to overfitting.","Honors Project Presentation  \nDepartment of Computer Science May 3, 2023  \nAlex Huynh Project Advisor: Man Basnet  \nInvestigating Skin Cancer Diagnosis with Machine Learning: A Comparative Study of Feature Selection and Feature Extraction Techniques  \nIntroduction  \nSkin cancer is a common cancer that requires early detection for effective treatment. Machine learning, particularly deep learning, has shown potential in detecting and classifying skin cancer images. However, high image dimensionality challenges classification models to learn relevant information. To address this, feature  \nselection/extraction techniques reduce image dimensionality. Moreover, machine learning models can learn from more relevant data and capture less noise. This study investigated the performance of various feature  \nselection/extraction techniques for skin cancer image classification on the HAM10000 dataset. We classified the images using three popular binary and multi-class classification models. Lastly, we compared our results against a fine-tuned transfer learning model.  \nObjectives  \n● Determine how changing the number of features of a skin cancer image affects the classification accuracy and AUC.  \n● Determine which feature selection/extraction techniques, when applied to skin cancer images, yield high  classification accuracy and AUC.   \nResults  \nMethods  \n1. Reduce initial complexity: transform all images to grayscale and reduce all images from 600x450 to 300x225 pixels.  \n2. Employ dimensionality reduction:  \na . Feature selection  \ni. Resizing-Reduce image dimensionality to 10%-100% of the original size.  \nii. Lasso-Perform with varying alpha values.  \niii. Select K Best-Apply on \"74%\" sized images (dimensions of 224x224) to compare with transfer learning.  \nb. Feature extraction  \ni. Principal component analysis (PCA) -Compare over variance explained on the 74% sized images.  \nii. Pre-trained deep learning models VGG16, Xception, and InceptionV3 (on RGB images) -Remove the fully connected layer and feed the output into the LightGBM classifier.  \niii. Utilize a fine-tuned transfer learning approach (on RGB images), which involves freezing the base, training, unfreezing the base, andre-training.  \n3. Perform two classification tasks: binary classification and multi-class classification.  \na . Measure area under the curve (AUC), binary accuracy, and multi-accuracy for each task.  \nb. Resizing was performed on three classifiers: LightGBM, XGBoost, and CatBoost. Due to similar performance between the three, LightGBM was used for Lasso, Select K Best, PCA, and the pre-trained deep learning models.  \nc . When using these models, we use stratified cross-validation with a k-fold of 3, tuning on the hyperparameter n  estimators, which defines the complexity of the model.  \nSummary  \n● Transfer learning techniques, specifically through fine-tuning, performed best in binary and multi-accuracy for skin cancer image classification.  \n● Fine-tuned transfer learning models showed lower AUC scores, possibly due to overfitting.  \n● Similar performance metrics can be obtained through multiple methods.  \nFuture Work  \n● A slightly higher cross-validation value can be used rather than 3.  \n● A more expanded range of hyperparameters can strengthen results.  \n● Using RGB images for the non-deep learning techniques can provide a more direct comparison to the deep learning techniques.  \nReferences  \n● Bechelli, Solene, and Jerome Delhommelle. \"Machine Learning and Deep Learning Algorithms for Skin Cancer Classification from Dermoscopic Images. \" Bioengineering 9.3 (2022): 97.  \n● Alkhushayni, Suboh, et al. \"The Application of Differing Machine Learning Algorithms and Their Related Performance in Detecting Skin Cancers and Melanomas. \" Journal of Skin Cancer 2022 (2022) .  \n● Lynn, Nay Chi, and Zin Mar Kyu. \"Segmentation and classification of skin cancer melanoma from skin lesion images. \" 2017 18th international conference on parallel and distributed computing, applications and tech","cbCaidKcZh12Z2w4","https://ap.wps.com/l/cbCaidKcZh12Z2w4","pdf",423887,1,"English","en",105,"# Introduction\n## Objectives\n## Methods\n## Results\n## Summary\n## Future Work\n## References","[{\"question\":\"How does the study reduce image dimensionality before classification?\",\"answer\":\"All images are converted to grayscale and resized from 600x450 to 300x225. Dimensionality reduction is then applied via resizing percentages, Lasso, Select K Best, and PCA for the relevant approaches.\"},{\"question\":\"What feature selection and extraction techniques are compared?\",\"answer\":\"Feature selection includes resizing-based reduction, Lasso with varying alpha values, and Select K Best on 74% sized images. Feature extraction includes PCA based on variance explained, and deep feature extraction using VGG16, Xception, and InceptionV3 before LightGBM classification.\"},{\"question\":\"Which approach performs best and how are binary vs multi-class results evaluated?\",\"answer\":\"Fine-tuned transfer learning performs best for both binary and multi-class accuracy. Performance is measured using AUC for binary settings and accuracy for multi-class, computed with stratified 3-fold cross-validation and hyperparameter tuning of n_estimators.\"}]","Investigating Skin Cancer Diagnosis with Machine Learning - A Comparative Study of Feature Selection and Feature Extraction Techniques | PDF",1786003460,3,{"code":4,"msg":30,"data":31},"ok",{"site_id":23,"language":22,"slug":32,"title":13,"keywords":33,"description":14,"schema_data":34,"social_meta":85,"head_meta":87,"extra_data":89,"updated_unix":27},"investigating-skin-cancer-diagnosis-with-machine-learning-a-comparative-study-of-feature-selection-and-feature-extraction-techniques","",{"@graph":35,"@context":84},[36,52,67],{"@type":37,"itemListElement":38},"BreadcrumbList",[39,43,47,49],{"item":40,"name":41,"@type":42,"position":20},"https://docshare.wps.com","Home","ListItem",{"item":44,"name":45,"@type":42,"position":46},"https://docshare.wps.com/document/","Document",2,{"item":48,"name":12,"@type":42,"position":28},"https://docshare.wps.com/document/research-report/",{"item":50,"name":13,"@type":42,"position":51},"https://docshare.wps.com/document/investigating-skin-cancer-diagnosis-with-machine-learning-a-comparative-study-of-feature-selection-and-feature-extraction-techniques/128790/",4,{"url":50,"name":13,"@type":53,"author":54,"headline":13,"publisher":56,"fileFormat":59,"inLanguage":22,"description":14,"dateModified":60,"datePublished":61,"encodingFormat":59,"isAccessibleForFree":62,"interactionStatistic":63},"DigitalDocument",{"name":9,"@type":55},"Person",{"url":40,"name":57,"@type":58},"DocShare","Organization","application/pdf","2026-08-23","2026-08-06",true,{"@type":64,"interactionType":65,"userInteractionCount":20},"InteractionCounter",{"@type":66},"ViewAction",{"@type":68,"mainEntity":69},"FAQPage",[70,76,80],{"name":71,"@type":72,"acceptedAnswer":73},"How does the study reduce image dimensionality before classification?","Question",{"text":74,"@type":75},"All images are converted to grayscale and resized from 600x450 to 300x225. Dimensionality reduction is then applied via resizing percentages, Lasso, Select K Best, and PCA for the relevant approaches.","Answer",{"name":77,"@type":72,"acceptedAnswer":78},"What feature selection and extraction techniques are compared?",{"text":79,"@type":75},"Feature selection includes resizing-based reduction, Lasso with varying alpha values, and Select K Best on 74% sized images. Feature extraction includes PCA based on variance explained, and deep feature extraction using VGG16, Xception, and InceptionV3 before LightGBM classification.",{"name":81,"@type":72,"acceptedAnswer":82},"Which approach performs best and how are binary vs multi-class results evaluated?",{"text":83,"@type":75},"Fine-tuned transfer learning performs best for both binary and multi-class accuracy. Performance is measured using AUC for binary settings and accuracy for multi-class, computed with stratified 3-fold cross-validation and hyperparameter tuning of n_estimators.","https://schema.org",{"og:url":50,"og:type":86,"og:title":13,"og:site_name":57,"og:description":14},"article",{"robots":88,"canonical":50},"index,follow",{"doc_id":7,"site_id":23},{"code":4,"msg":5,"data":91},[92,96,100,104,109,114,119,122,127,130,134],{"id":20,"doc_module":4,"doc_module_name":45,"category_name":93,"show_sort_weight":94,"slug":95},"Story & Novel",90,"story-novel",{"id":46,"doc_module":4,"doc_module_name":45,"category_name":97,"show_sort_weight":98,"slug":99},"Literature",80,"literature",{"id":51,"doc_module":4,"doc_module_name":45,"category_name":101,"show_sort_weight":102,"slug":103},"Exam",70,"exam",{"id":105,"doc_module":4,"doc_module_name":45,"category_name":106,"show_sort_weight":107,"slug":108},5,"Comic",60,"comic",{"id":110,"doc_module":4,"doc_module_name":45,"category_name":111,"show_sort_weight":112,"slug":113},6,"Technology",50,"technology",{"id":115,"doc_module":4,"doc_module_name":45,"category_name":116,"show_sort_weight":117,"slug":118},7,"Healthcare",40,"healthcare",{"id":11,"doc_module":4,"doc_module_name":45,"category_name":12,"show_sort_weight":120,"slug":121},30,"research-report",{"id":123,"doc_module":4,"doc_module_name":45,"category_name":124,"show_sort_weight":125,"slug":126},9,"Religion & Spirituality",20,"religion-spirituality",{"id":125,"doc_module":4,"doc_module_name":45,"category_name":128,"show_sort_weight":125,"slug":129},"World Cup","world-cup",{"id":131,"doc_module":4,"doc_module_name":45,"category_name":132,"show_sort_weight":131,"slug":133},10,"Lifestyle","lifestyle",{"id":135,"doc_module":4,"doc_module_name":45,"category_name":136,"show_sort_weight":105,"slug":137},19,"General","general"]