[{"data":1,"prerenderedAt":-1},["ShallowReactive",2],{"doc-detail-117808-en":3,"doc-seo-117808-105":30,"detail-sidebar-cat-0-en-105":91},{"code":4,"msg":5,"data":6},0,"success",{"doc_id":7,"user_id":8,"nickname":9,"user_avatar":10,"doc_module":4,"category_id":11,"category_name":12,"doc_title":13,"doc_description":14,"doc_content":15,"file_id":16,"file_url":17,"file_type":18,"file_size":19,"view_count":4,"is_deleted":4,"is_public":20,"is_downloadable":20,"audit_status":20,"page_count":21,"language":22,"language_code":23,"site_id":24,"html_lang":23,"table_of_contents":25,"faqs":26,"seo_title":27,"seo_description":14,"update_tm":28,"read_time":29},117808,549758146520,"Patrick","https://ap-avatar.wpscdn.com/avatar/80002397d8c0411e94?_k=1775819394049821470",8,"Research & Report","Demystifying image-based machine learning: a practical guide to automated analysis of field imagery using modern machine learning tools","Image-based machine learning methods are increasingly used for data analysis across science and industry because they can rapidly and automatically extract contextual and spatial information from images, reducing reliance on large human labor. Despite strong demonstrated potential in ocean research, tools remain underused in species and environmental monitoring, biodiversity surveys, fisheries estimation, rare-event detection, animal behavior studies, and citizen science. This review provides an approachable end-to-end guide for applying image-based machine learning effectively, including data preparation, model training and deployment, and diagnosing issues that cause poor performance on new imagery.","TYPE Review  \nPUBLISHED 05 June 2023  \nDOI 10.3389/fmars.2023.1157370  \nOPEN ACCESS  \nEDITED BY  \nMark C. Benfield, Louisiana State University, United States  \nREVIEWED BY Nils Piechaud,  \nNorwegian Institute of Marine Research (IMR), Norway  \nLina Zhou,  \nHong Kong Polytechnic University,  \nHong Kong SAR, China  \n*CORRESPONDENCE Andrew M. Hein  \n [andrew.hein@cornell.edu](andrew.hein@cornell.edu)  \nRECEIVED 08 February 2023  \nACCEPTED 19 May 2023  \nPUBLISHED 05 June 2023  \nCITATION  \nBelcher BT, Bower EH, Burford B, Celis MR, Fahimipour AK, Guevara IL, Katija K, Khokhar Z, Manjunath A, Nelson S, Olivetti S, Orenstein E, Saleh MH, Vaca B, Valladares S, Hein SA and Hein AM (2023) Demystifying image-based machine learning: a practical guide to automated analysis of field imagery using modern machine learning tools.  \nFront. Mar. Sci. 10:1157370 .  \ndoi: 10.3389/fmars.2023.1157370  \nCOPYRIGHT  \n© 2023 Belcher, Bower, Burford, Celis, Fahimipour, Guevara, Katija, Khokhar, Manjunath, Nelson, Olivetti, Orenstein, Saleh, Vaca, Valladares, Hein and Hein. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY) . The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.  \nDemystifying image-based machine learning: a practical guide to automated analysis of field imagery using modern machine learning tools  \nByron T. Belcher 1, Eliana H. Bower 1, Benjamin Burford 1,2, Maria Rosa Celis 1,2, Ashkaan K. Fahimipour 1,2,3,  \nIsabela L. Guevara 1, Kakani Katija 4, Zulekha Khokhar 1, Anjana Manjunath 1, Samuel Nelson 1,2, Simone Olivetti 1,2, Eric Orenstein 4, Mohamad H. Saleh 1, Brayan Vaca 1, Salma Valladares 1, Stella A. Hein 1,5 and Andrew M. Hein 1,6*  \n1AI for the Ocean program, University of California Santa Cruz, Santa Cruz, CA, United States,  \n2 Institute of Marine Sciences, University of California Santa Cruz, Santa Cruz, CA, United States,  \n3 Florida Atlantic University, Department of Biology, Boca Raton, FL, United States, 4 Monterey Bay Aquarium Research Institute, Research and Development, Moss Landing, CA, United States, 5Cornell University, College of Agriculture and Life Sciences, Ithaca, NY, United States, 6 Department of Computational Biology, Cornell University, Ithaca, NY, United States  \nImage-based machine learning methods are becoming among the most widelyused forms of data analysis across science, technology, engineering, and industry. These methods are powerful because they can rapidly and automatically extract rich contextual and spatial information from images, a process that has historically required a large amount of human labor. A wide range of recent scientific applications have demonstrated the potential of these methods to change how researchers study the ocean. However, despite their promise, machine learning tools are still under-exploited in many domains including species and environmental monitoring, biodiversity surveys, fisheries abundance and size estimation, rare event and species detection, the study of animal behavior, and citizen science. Our objective in this article is to provide an approachable, end-to-end guide to help researchers apply image-based machine learning methods effectively to their own research problems. Using a case study, we describe how to prepare data, train and deploy models, and overcome common issues that can cause models to underperform. Importantly, we discuss how to diagnose problems that can cause poor model performance on new imagery to build robust tools that can vastly accelerate data acquisition in the marine realm. Code to perform analyses is provided at [https://github.com/](https://github.com/)[ ](https://github.com/)heinsense2/AIO_CaseStudy. ","cbCailfQBK06DpjV","https://ap.wps.com/l/cbCailfQBK06DpjV","pdf",4320051,1,24,"English","en",105,"# Introduction\n## Challenges of visual data and high-dimensional imagery\n## Role of image analysis and objective of image-based machine learning","[{\"question\":\"What is the main purpose of this review for researchers?\",\"answer\":\"To provide an approachable end-to-end guide that helps researchers apply image-based machine learning methods effectively to their own problems. It uses a case study to explain preparation, training, deployment, and troubleshooting.\"},{\"question\":\"Which types of tasks does image-based machine learning aim to automate?\",\"answer\":\"It aims to classify content in images, localize and count objects, and partition images into meaningful regions. These mirror tasks humans perform through visual interpretation.\"},{\"question\":\"Why do machine learning models sometimes underperform on new imagery?\",\"answer\":\"Common issues related to model performance on new images are discussed, including problems that can be diagnosed to build more robust tools. The review emphasizes overcoming factors that limit generalization.\"}]","Demystifying image-based machine learning: a practical guide to automated analysis of field imagery using modern machine learning tools | PDF",1785679673,60,{"code":4,"msg":31,"data":32},"ok",{"site_id":24,"language":23,"slug":33,"title":13,"keywords":34,"description":14,"schema_data":35,"social_meta":86,"head_meta":88,"extra_data":90,"updated_unix":28},"demystifying-image-based-machine-learning-a-practical-guide-to-automated-analysis-of-field-imagery-using-modern-machine-learning-tools","",{"@graph":36,"@context":85},[37,54,68],{"@type":38,"itemListElement":39},"BreadcrumbList",[40,44,48,51],{"item":41,"name":42,"@type":43,"position":20},"https://docshare.wps.com","Home","ListItem",{"item":45,"name":46,"@type":43,"position":47},"https://docshare.wps.com/document/","Document",2,{"item":49,"name":12,"@type":43,"position":50},"https://docshare.wps.com/document/research-report/",3,{"item":52,"name":13,"@type":43,"position":53},"https://docshare.wps.com/document/demystifying-image-based-machine-learning-a-practical-guide-to-automated-analysis-of-field-imagery-using-modern-machine-learning-tools/117808/",4,{"url":52,"name":13,"@type":55,"author":56,"headline":13,"publisher":58,"fileFormat":61,"inLanguage":23,"description":14,"dateModified":62,"datePublished":62,"encodingFormat":61,"isAccessibleForFree":63,"interactionStatistic":64},"DigitalDocument",{"name":9,"@type":57},"Person",{"url":41,"name":59,"@type":60},"DocShare","Organization","application/pdf","2026-08-02",true,{"@type":65,"interactionType":66,"userInteractionCount":4},"InteractionCounter",{"@type":67},"ViewAction",{"@type":69,"mainEntity":70},"FAQPage",[71,77,81],{"name":72,"@type":73,"acceptedAnswer":74},"What is the main purpose of this review for researchers?","Question",{"text":75,"@type":76},"To provide an approachable end-to-end guide that helps researchers apply image-based machine learning methods effectively to their own problems. It uses a case study to explain preparation, training, deployment, and troubleshooting.","Answer",{"name":78,"@type":73,"acceptedAnswer":79},"Which types of tasks does image-based machine learning aim to automate?",{"text":80,"@type":76},"It aims to classify content in images, localize and count objects, and partition images into meaningful regions. These mirror tasks humans perform through visual interpretation.",{"name":82,"@type":73,"acceptedAnswer":83},"Why do machine learning models sometimes underperform on new imagery?",{"text":84,"@type":76},"Common issues related to model performance on new images are discussed, including problems that can be diagnosed to build more robust tools. The review emphasizes overcoming factors that limit generalization.","https://schema.org",{"og:url":52,"og:type":87,"og:title":13,"og:site_name":59,"og:description":14},"article",{"robots":89,"canonical":52},"index,follow",{"doc_id":7,"site_id":24},{"code":4,"msg":5,"data":92},[93,97,101,105,109,114,119,122,127,130,134],{"id":20,"doc_module":4,"doc_module_name":46,"category_name":94,"show_sort_weight":95,"slug":96},"Story & Novel",90,"story-novel",{"id":47,"doc_module":4,"doc_module_name":46,"category_name":98,"show_sort_weight":99,"slug":100},"Literature",80,"literature",{"id":53,"doc_module":4,"doc_module_name":46,"category_name":102,"show_sort_weight":103,"slug":104},"Exam",70,"exam",{"id":106,"doc_module":4,"doc_module_name":46,"category_name":107,"show_sort_weight":29,"slug":108},5,"Comic","comic",{"id":110,"doc_module":4,"doc_module_name":46,"category_name":111,"show_sort_weight":112,"slug":113},6,"Technology",50,"technology",{"id":115,"doc_module":4,"doc_module_name":46,"category_name":116,"show_sort_weight":117,"slug":118},7,"Healthcare",40,"healthcare",{"id":11,"doc_module":4,"doc_module_name":46,"category_name":12,"show_sort_weight":120,"slug":121},30,"research-report",{"id":123,"doc_module":4,"doc_module_name":46,"category_name":124,"show_sort_weight":125,"slug":126},9,"Religion & Spirituality",20,"religion-spirituality",{"id":125,"doc_module":4,"doc_module_name":46,"category_name":128,"show_sort_weight":125,"slug":129},"World Cup","world-cup",{"id":131,"doc_module":4,"doc_module_name":46,"category_name":132,"show_sort_weight":131,"slug":133},10,"Lifestyle","lifestyle",{"id":135,"doc_module":4,"doc_module_name":46,"category_name":136,"show_sort_weight":106,"slug":137},19,"General","general"]