[{"data":1,"prerenderedAt":-1},["ShallowReactive",2],{"doc-detail-121772-en":3,"doc-seo-121772-105":30,"detail-sidebar-cat-0-en-105":91},{"code":4,"msg":5,"data":6},0,"success",{"doc_id":7,"user_id":8,"nickname":9,"user_avatar":10,"doc_module":4,"category_id":11,"category_name":12,"doc_title":13,"doc_description":14,"doc_content":15,"file_id":16,"file_url":17,"file_type":18,"file_size":19,"view_count":4,"is_deleted":4,"is_public":20,"is_downloadable":20,"audit_status":20,"page_count":21,"language":22,"language_code":23,"site_id":24,"html_lang":23,"table_of_contents":25,"faqs":26,"seo_title":27,"seo_description":14,"update_tm":28,"read_time":29},121772,8796095360427,"Lucas Martin","https://ap-avatar.wpscdn.com/davatar_994ba38a5ba835b3df7d355c54d3ed8d",8,"Research & Report","Comparison of manual, machine learning, and hybrid methods for video annotation to extract parental care data - Journal article summary","Efficient measurement of parental care in wild animal ecology is central to understanding animal ecology and evolution, yet it is often labour- and time-intensive. This short communication evaluates how manual expert annotation, crowd-sourcing, automatic detection using DeepMeerkat, and a hybrid approach extract parental provisioning from field video recordings of wild house sparrows. Automatic data correlated with experts and predicted brood survival, but it showed biased estimates from nonvisitation detections. Crowd-sourcing and hybrid methods matched expert accuracy, with hybrid requiring ~20% of manual annotation time.","This is a repository copy of Comparison of manual, machine learning, and hybrid methods for video annotation to extract parental care data.  \nWhite Rose Research Online URL for this paper:  \n[https://eprints.whiterose.ac.uk/206736/](https://eprints.whiterose.ac.uk/206736/)  \nVersion: Published Version  \nArticle:  \nChan, [A.H.H. orcid.org/0000-0002-5405-7155](A.H.H. orcid.org/0000-0002-5405-7155) , Liu, J., Burke, [T. orcid.org/0000-0003-3848-](T. orcid.org/0000-0003-3848-)[ ](T. orcid.org/0000-0003-3848-)[1244 et al.](1244 et al.) (2 more authors) (2023) Comparison of manual, machine learning, and hybrid methods for video annotation to extract parental care data. Journal of Avian Biology. e03167 . ISSN 0908-8857  \n[https://doi.org/10.1111/jav.03167](https://doi.org/10.1111/jav.03167)  \nReuse  \nThis article is distributed under the terms of the Creative Commons Attribution (CC BY) licence. This licence allows you to distribute, remix, tweak, and build upon the work, even commercially, as long as you credit the authors for the original work. More information and the full terms of the licence here: [https://creativecommons.org/licenses/](https://creativecommons.org/licenses/)  \nTakedown  \nIf you consider content in White Rose Research Online to be in breach of UK law, please notify us by  \nemailing [eprints@whiterose.ac.uk](eprints@whiterose.ac.uk) including the URL of the record and the reason for the withdrawal request.  \n[eprints@whiterose.ac.uk](eprints@whiterose.ac.uk)[ ](eprints@whiterose.ac.uk)[https://eprints.whiterose.ac.uk/](https://eprints.whiterose.ac.uk/)  \nJOURNAL OF  \nAVIAN BIOLOGY  \nShort communication  \nComparison of manual, machine learning, and hybrid methods for video annotation to extract parental care data  \nAlex Hoi Hang Chan✉1,2,3, Jingqi Liu1, Terry Burke4, William D. Pearse1,* and Julia Schroeder1,*  \n1Department of Life Sciences, Imperial College London, Ascot, UK  \n2Centre for the Advanced Study of Collective Behaviour, University of Konstanz, Konstanz, Germany 3Max Planck Institute of Animal Behaviour, Radolfzell, Germany  \n4Department of Animal and Plant Sciences, University of Sheffield, Sheffield, UK  \nCorrespondence: Alex Hoi Hang Chan ([thealex.chan2@gmail.com](thealex.chan2@gmail.com))  \nJournal of Avian Biology 2023: e03167  \ndoi: 10.1111/jav.03167  \nSubject Editor: Wesley Hochachka  \nEditor-in-Chief: Staffan Bensch Accepted 16 October 2023  \n[www.avianbiology.org](www.avianbiology.org)  \nMeasuring parental care behaviour in the wild is central to the study of animal ecology and evolution, but it is often labour- and time-intensive. Efficient open-source tools have recently emerged that allow animal behaviour to be quantified from videos using machine learning and computer vision techniques, but there is limited appraisal of how these tools perform compared to traditional methods. To gain insight into how different methods perform in extracting data from videos taken in the field, we compared estimates of the parental provisioning rate of wild house sparrows Passer domesticus from video recordings. We compared four methods: manual annotation by experts, crowd-sourcing, automatic detection based on the open-source software DeepMeerkat, and a hybrid annotation method. We found that the data collected by the automatic method correlated with expert annotation (r = 0.62) and further show that these data are biologically meaningful as they predict brood survival. However, the automatic method produced largely biased estimates due to the detection of nonvisitation events, while the crowd-sourcing and hybrid annotation produced estimates that are equivalent to expert annotation. The hybrid annotation method takes approximately 20% of annotation time compared to manual annotation, making it a more cost-effective way to collect data from videos. We provide a successful case study of how different approaches can be adopted and evaluated with a pre-existing dataset, to make informed decisions on the best w","cbCaig6Jnkm05r1F","https://ap.wps.com/l/cbCaig6Jnkm05r1F","pdf",512610,1,12,"English","en",105,"# Introduction\n## Methods comparison for extracting parental provisioning from videos\n## Results: correlation, bias, and biological meaning\n## Implications for cost-effective annotation workflows","[{\"question\":\"Which four video annotation methods were compared in the study?\",\"answer\":\"The study compared manual expert annotation, crowd-sourcing, automatic detection using DeepMeerkat, and a hybrid annotation method.\"},{\"question\":\"How did the automatic method perform relative to expert annotations?\",\"answer\":\"Automatic detections correlated with expert annotation (r = 0.62) and predicted brood survival, but produced largely biased estimates due to detection of nonvisitation events.\"},{\"question\":\"Why is the hybrid annotation approach considered more efficient?\",\"answer\":\"The hybrid method required about 20% of the annotation time compared with manual annotation while producing estimates equivalent to expert annotation.\"}]","Comparison of manual, machine learning, and hybrid methods for video annotation to extract parental care data - Journal article summary | PDF",1785806761,30,{"code":4,"msg":31,"data":32},"ok",{"site_id":24,"language":23,"slug":33,"title":13,"keywords":34,"description":14,"schema_data":35,"social_meta":86,"head_meta":88,"extra_data":90,"updated_unix":28},"comparison-of-manual-machine-learning-and-hybrid-methods-for-video-annotation-to-extract-parental-care-data-journal-article-summary","",{"@graph":36,"@context":85},[37,54,68],{"@type":38,"itemListElement":39},"BreadcrumbList",[40,44,48,51],{"item":41,"name":42,"@type":43,"position":20},"https://docshare.wps.com","Home","ListItem",{"item":45,"name":46,"@type":43,"position":47},"https://docshare.wps.com/document/","Document",2,{"item":49,"name":12,"@type":43,"position":50},"https://docshare.wps.com/document/research-report/",3,{"item":52,"name":13,"@type":43,"position":53},"https://docshare.wps.com/document/comparison-of-manual-machine-learning-and-hybrid-methods-for-video-annotation-to-extract-parental-care-data-journal-article-summary/121772/",4,{"url":52,"name":13,"@type":55,"author":56,"headline":13,"publisher":58,"fileFormat":61,"inLanguage":23,"description":14,"dateModified":62,"datePublished":62,"encodingFormat":61,"isAccessibleForFree":63,"interactionStatistic":64},"DigitalDocument",{"name":9,"@type":57},"Person",{"url":41,"name":59,"@type":60},"DocShare","Organization","application/pdf","2026-08-04",true,{"@type":65,"interactionType":66,"userInteractionCount":4},"InteractionCounter",{"@type":67},"ViewAction",{"@type":69,"mainEntity":70},"FAQPage",[71,77,81],{"name":72,"@type":73,"acceptedAnswer":74},"Which four video annotation methods were compared in the study?","Question",{"text":75,"@type":76},"The study compared manual expert annotation, crowd-sourcing, automatic detection using DeepMeerkat, and a hybrid annotation method.","Answer",{"name":78,"@type":73,"acceptedAnswer":79},"How did the automatic method perform relative to expert annotations?",{"text":80,"@type":76},"Automatic detections correlated with expert annotation (r = 0.62) and predicted brood survival, but produced largely biased estimates due to detection of nonvisitation events.",{"name":82,"@type":73,"acceptedAnswer":83},"Why is the hybrid annotation approach considered more efficient?",{"text":84,"@type":76},"The hybrid method required about 20% of the annotation time compared with manual annotation while producing estimates equivalent to expert annotation.","https://schema.org",{"og:url":52,"og:type":87,"og:title":13,"og:site_name":59,"og:description":14},"article",{"robots":89,"canonical":52},"index,follow",{"doc_id":7,"site_id":24},{"code":4,"msg":5,"data":92},[93,97,101,105,110,115,120,122,127,130,134],{"id":20,"doc_module":4,"doc_module_name":46,"category_name":94,"show_sort_weight":95,"slug":96},"Story & Novel",90,"story-novel",{"id":47,"doc_module":4,"doc_module_name":46,"category_name":98,"show_sort_weight":99,"slug":100},"Literature",80,"literature",{"id":53,"doc_module":4,"doc_module_name":46,"category_name":102,"show_sort_weight":103,"slug":104},"Exam",70,"exam",{"id":106,"doc_module":4,"doc_module_name":46,"category_name":107,"show_sort_weight":108,"slug":109},5,"Comic",60,"comic",{"id":111,"doc_module":4,"doc_module_name":46,"category_name":112,"show_sort_weight":113,"slug":114},6,"Technology",50,"technology",{"id":116,"doc_module":4,"doc_module_name":46,"category_name":117,"show_sort_weight":118,"slug":119},7,"Healthcare",40,"healthcare",{"id":11,"doc_module":4,"doc_module_name":46,"category_name":12,"show_sort_weight":29,"slug":121},"research-report",{"id":123,"doc_module":4,"doc_module_name":46,"category_name":124,"show_sort_weight":125,"slug":126},9,"Religion & Spirituality",20,"religion-spirituality",{"id":125,"doc_module":4,"doc_module_name":46,"category_name":128,"show_sort_weight":125,"slug":129},"World Cup","world-cup",{"id":131,"doc_module":4,"doc_module_name":46,"category_name":132,"show_sort_weight":131,"slug":133},10,"Lifestyle","lifestyle",{"id":135,"doc_module":4,"doc_module_name":46,"category_name":136,"show_sort_weight":106,"slug":137},19,"General","general"]