[{"data":1,"prerenderedAt":-1},["ShallowReactive",2],{"doc-detail-121953-en":3,"doc-seo-121953-105":30,"detail-sidebar-cat-0-en-105":83},{"code":4,"msg":5,"data":6},0,"success",{"doc_id":7,"user_id":8,"nickname":9,"user_avatar":10,"doc_module":4,"category_id":11,"category_name":12,"doc_title":13,"doc_description":14,"doc_content":15,"file_id":16,"file_url":17,"file_type":18,"file_size":19,"view_count":4,"is_deleted":4,"is_public":20,"is_downloadable":20,"audit_status":20,"page_count":21,"language":22,"language_code":23,"site_id":24,"html_lang":23,"table_of_contents":25,"faqs":26,"seo_title":27,"seo_description":14,"update_tm":28,"read_time":29},121953,137441390410,"Hazel","https://ap-avatar.wpscdn.com/avatar/2000252f4ab5702993?_k=1776741390130283984",8,"Research & Report","Dermacen Analytica - A Novel Methodology Integrating Multi-Modal Large Language Models with Machine Learning in tele-dermatology","The rise of Artificial Intelligence creates great promise in medical discovery, diagnostics, and patient management, yet the complexity of medical domains requires an integrated approach. Dermacen Analytica presents an AI-empowered system and methodology that assists diagnosis of skin lesions and related dermatological conditions by combining machine learning algorithms, segmentation tools, and large language models. The workflow integrates large language models with transformer-based vision models and a multi-stage evaluation pipeline using publicly available medical case studies and images. Performance is scored through machine learning and natural language processing techniques emphasizing similarity comparison and natural language inference, supported by expert evaluation with a structured checklist, achieving weighted scores of about 0.87 for contextual understanding and diagnostic accuracy.","arXiv :2403 . 14243v1 [ cs .CL] 21 Mar 2024  \nDermacen Analytica: A Novel Methodology Integrating Multi-Modal Large Language Models with Machine Learning in  \ntele-dermatology  \nDimitrios P. Panagouliasa (panagoulias [d@unipi.gr](d@unipi.gr)), Evridiki Tsoureli-Nikitab  \n([evinikita@gmail.com](evinikita@gmail.com)), Maria Virvoua ([mvirvou@unipi.gr](mvirvou@unipi.gr)), George A.  \nTsihrintzisa ([geoatsi@unipi.gr](geoatsi@unipi.gr))  \na Department of Informatics, University of Piraeus 185 34, Greece b Athens University Medical School, Athens 115 27, Greece  \nCorresponding Author:  \nGeorge A. Tsihrintzis  \nDepartment of Informatics, University of Piraeus 185 34, Greece Tel: (+30) 697 2882168  \nEmail: [geoatsi@unipi.gr](geoatsi@unipi.gr)  \nDermacen Analytica: A Novel Methodology Integrating Multi-Modal Large Language Models with Machine Learning in tele-dermatology  \nDimitrios P. Panagouliasa , Evridiki Tsoureli-Nikitab , Maria Virvoua , George  \nA. Tsihrintzisa,1  \na Department of Informatics, University of Piraeus, Piraeus 185 34, Greece b Athens University Medical School, Athens, Greece  \nAbstract  \nThe rise of Artificial Intelligence creates great promise in the field of medical discovery, diagnostics and patient management. However, the vast complexity of all medical domains require a more complex approach that combines machine learning algorithms, classifiers, segmentation algorithms and, lately, large language models. In this paper, we describe, implement and assess an Artificial Intelligence-empowered system and methodology aimed at assisting the diagnosis process of skin lesions and other skin conditions within the field of dermatology that aims to holistically address the diagnostic process in this domain. The workflow integrates large language, transformer-based vision models and sophisticated machine learning tools. This holistic approach achieves a nuanced interpretation of dermatological conditions that simulates and facilitatesa dermatologist’s workflow. We assess our proposed methodology through a thorough cross-model validation technique embedded in an evaluation pipeline that utilizes publicly available medical case studies of skin conditions and relevant images. To quantitatively score the system performance, advanced machine learning and natural language processing tools are employed which focus on similarity comparison and natural language inference. Additionally, we incorporate  \n∗ Corresponding author.  \nEmail addresses: [panagoulias_d@unipi.gr](panagoulias_d@unipi.gr) (Dimitrios P. Panagoulias), [evinikita@gmail.com](evinikita@gmail.com) (Evridiki Tsoureli-Nikita), [mvirvou@unipi.gr](mvirvou@unipi.gr) (Maria Virvou), [geoatsi@unipi.gr](geoatsi@unipi.gr) (George A. Tsihrintzis)  \nPreprint submitted to arXiv March 22, 2024  \na human expert evaluation process based on a structured checklist to further validate our results. We implemented the proposed methodology in a system which achieved approximate (weighted) scores of 0.87 for both contextual understanding and diagnostic accuracy, demonstrating the efficacy of our approach in enhancing dermatological analysis. The proposed methodology is expected to prove useful in the development of next-generation tele-dermatology applications, enhancing remote consultation capabilities and access to care, especially in underserved areas.  \nKeywords: Artificial Intelligence-empowered software engineering, Multimodal Large Language Models, GPT-4V, Telehealth  \n1. Introduction  \nThe rise of Artificial Intelligence (AI) and its transformative effect on many fields and domains provides significant opportunities for the revamping and reengineering of the diagnostic process. However, in order to navigate through the complexity of the medical field effectively, a multifaceted approach is essential that integrates several AI technologies including explainability (Panagoulias et al. , 2024b), trustworthiness and holistic evaluation properties (Virvou, 2023) . Machine learning alg","cbCaibvs9P61GD6v","https://ap.wps.com/l/cbCaibvs9P61GD6v","pdf",4907863,1,46,"English","en",105,"# Introduction\n## AI-enabled dermatology diagnostics\n## Proposed Dermacen Analytica workflow\n## Key workflow components","[{\"question\":\"How is the methodology evaluated and validated?\",\"answer\":\"It uses a thorough cross-model validation technique with an evaluation pipeline based on publicly available medical case studies and images, plus quantitative scoring via similarity comparison and natural language inference and expert evaluation using a structured checklist.\"}]","Dermacen Analytica - A Novel Methodology Integrating Multi-Modal Large Language Models with Machine Learning in tele-dermatology | PDF",1785807995,116,{"code":4,"msg":31,"data":32},"ok",{"site_id":24,"language":23,"slug":33,"title":13,"keywords":34,"description":14,"schema_data":35,"social_meta":78,"head_meta":80,"extra_data":82,"updated_unix":28},"dermacen-analytica-a-novel-methodology-integrating-multi-modal-large-language-models-with-machine-learning-in-tele-dermatology","",{"@graph":36,"@context":77},[37,54,68],{"@type":38,"itemListElement":39},"BreadcrumbList",[40,44,48,51],{"item":41,"name":42,"@type":43,"position":20},"https://docshare.wps.com","Home","ListItem",{"item":45,"name":46,"@type":43,"position":47},"https://docshare.wps.com/document/","Document",2,{"item":49,"name":12,"@type":43,"position":50},"https://docshare.wps.com/document/research-report/",3,{"item":52,"name":13,"@type":43,"position":53},"https://docshare.wps.com/document/dermacen-analytica-a-novel-methodology-integrating-multi-modal-large-language-models-with-machine-learning-in-tele-dermatology/121953/",4,{"url":52,"name":13,"@type":55,"author":56,"headline":13,"publisher":58,"fileFormat":61,"inLanguage":23,"description":14,"dateModified":62,"datePublished":62,"encodingFormat":61,"isAccessibleForFree":63,"interactionStatistic":64},"DigitalDocument",{"name":9,"@type":57},"Person",{"url":41,"name":59,"@type":60},"DocShare","Organization","application/pdf","2026-08-04",true,{"@type":65,"interactionType":66,"userInteractionCount":4},"InteractionCounter",{"@type":67},"ViewAction",{"@type":69,"mainEntity":70},"FAQPage",[71],{"name":72,"@type":73,"acceptedAnswer":74},"How is the methodology evaluated and validated?","Question",{"text":75,"@type":76},"It uses a thorough cross-model validation technique with an evaluation pipeline based on publicly available medical case studies and images, plus quantitative scoring via similarity comparison and natural language inference and expert evaluation using a structured checklist.","Answer","https://schema.org",{"og:url":52,"og:type":79,"og:title":13,"og:site_name":59,"og:description":14},"article",{"robots":81,"canonical":52},"index,follow",{"doc_id":7,"site_id":24},{"code":4,"msg":5,"data":84},[85,89,93,97,102,107,112,115,120,123,127],{"id":20,"doc_module":4,"doc_module_name":46,"category_name":86,"show_sort_weight":87,"slug":88},"Story & Novel",90,"story-novel",{"id":47,"doc_module":4,"doc_module_name":46,"category_name":90,"show_sort_weight":91,"slug":92},"Literature",80,"literature",{"id":53,"doc_module":4,"doc_module_name":46,"category_name":94,"show_sort_weight":95,"slug":96},"Exam",70,"exam",{"id":98,"doc_module":4,"doc_module_name":46,"category_name":99,"show_sort_weight":100,"slug":101},5,"Comic",60,"comic",{"id":103,"doc_module":4,"doc_module_name":46,"category_name":104,"show_sort_weight":105,"slug":106},6,"Technology",50,"technology",{"id":108,"doc_module":4,"doc_module_name":46,"category_name":109,"show_sort_weight":110,"slug":111},7,"Healthcare",40,"healthcare",{"id":11,"doc_module":4,"doc_module_name":46,"category_name":12,"show_sort_weight":113,"slug":114},30,"research-report",{"id":116,"doc_module":4,"doc_module_name":46,"category_name":117,"show_sort_weight":118,"slug":119},9,"Religion & Spirituality",20,"religion-spirituality",{"id":118,"doc_module":4,"doc_module_name":46,"category_name":121,"show_sort_weight":118,"slug":122},"World Cup","world-cup",{"id":124,"doc_module":4,"doc_module_name":46,"category_name":125,"show_sort_weight":124,"slug":126},10,"Lifestyle","lifestyle",{"id":128,"doc_module":4,"doc_module_name":46,"category_name":129,"show_sort_weight":98,"slug":130},19,"General","general"]