[{"data":1,"prerenderedAt":-1},["ShallowReactive",2],{"doc-detail-125789-en":3,"doc-seo-125789-105":30,"detail-sidebar-cat-0-en-105":91},{"code":4,"msg":5,"data":6},0,"success",{"doc_id":7,"user_id":8,"nickname":9,"user_avatar":10,"doc_module":4,"category_id":11,"category_name":12,"doc_title":13,"doc_description":14,"doc_content":15,"file_id":16,"file_url":17,"file_type":18,"file_size":19,"view_count":20,"is_deleted":4,"is_public":20,"is_downloadable":20,"audit_status":20,"page_count":21,"language":22,"language_code":23,"site_id":24,"html_lang":23,"table_of_contents":25,"faqs":26,"seo_title":27,"seo_description":14,"update_tm":28,"read_time":29},125789,4810365810221,"Aurora","https://ap-avatar.wpscdn.com/davatar_155a257f0dc6eb9ab79c44ca47cae57d",8,"Research & Report","Efficient Neural Networks for Tiny Machine Learning - A Comprehensive Review","Tiny Machine Learning (TinyML) enables intelligent tasks on resource-constrained devices, and efficient neural networks are central to making deep learning feasible under strict compute, memory, and energy limits. This review analyzes advances in neural network architectures and TinyML deployments on ultra-low power microcontrollers, focusing on model compression, quantization, and low-rank factorization. It also addresses deployment challenges and solutions such as pruning, hardware acceleration, and algorithm-architecture co-design, concluding with key limitations and future research directions for balancing model complexity and resource constraints.","arXiv :2311 . 11883v1 [ stat .ML] 20 Nov 2023  \nEfficient Neural Networks for Tiny Machine Learning: A Comprehensive Review  \nMinh Tri Lˆe 1 , Pierre Wolinski 1 , Julyan Arbel 1,⋆  \n1 Centre Inria de l’Universit´e Grenoble Alpes, France  \n⋆ Corresponding [author:](author: julyan.arbel@inria.fr)[ julyan.arbel@inria.fr](author: julyan.arbel@inria.fr)  \nAbstract  \nThe field of Tiny Machine Learning (TinyML) has gained significant attention due to its potential to enable intelligent applications on resource-constrained devices. This review providesan in-depth analysis of the advancements in efficient neural networks and the deployment of deep learning models on ultra-low power microcontrollers (MCUs) for TinyML applications. It begins by introducing neural networks and discussing their architectures and resource requirements. It then explores MEMS-based applications on ultra-low power MCUs, highlighting their potential for enabling TinyML on resource-constrained devices. The core of the review centres on efficient neural networks for TinyML. It covers techniques such as model compression, quantization, and lowrank factorization, which optimize neural network architectures for minimal resource utilization on MCUs. The paper then delves into the deployment of deep learning models on ultra-low power MCUs, addressing challenges such as limited computational capabilities and memory resources. Techniques like model pruning, hardware acceleration, and algorithm-architecture co-design are discussed as strategies to enable efficient deployment. Lastly, the review provides an overview of current limitations in the field, including the trade-off between model complexity and resource constraints. Overall, this review paper presents a comprehensive analysis of efficient neural networksand deployment strategies for TinyML on ultra-low-power MCUs. It identifies future research directions for unlocking the full potential of TinyML applications on resource-constrained devices.  \nKeywords: Deep learning; Efficient Neural Networks; Tiny Machine Learning; Deployment Strategies  \nContents  \n1 Introduction 3  \n2 Neural networks 4  \n2.1 Feedforward neural networks ................................. 4  \n2.2 Properties ............................................ 5  \n2.3 Modern deep learning architectures .............................. 6  \n2.4 From large deep learning models to TinyML ......................... 9  \n3 MEMS-based applications on ultra-low power microcontrollers 10  \n3.1 Overview ............................................ 10  \n3.2 Scope of applications ...................................... 11  \n3.3 Challenges of ultra-low power hardware ........................... 12  \n4 Efficient neural networks for TinyML 13  \n4.1 Knowledge distillation ..................................... 14  \n4.2 Model pruning ......................................... 15  \n4.3 Quantization .......................................... 18  \n4.4 Weight-sharing ......................................... 21  \n4.5 Low-rank matrix and tensor decompositions ......................... 21  \n4.6 Summary ............................................ 21  \n5 Deploying deep learning models on ultra-low power MCUs 22  \n5.1 Challenges for TinyML tools ................................. 22  \n5.2 TinyML tools solutions ..................................... 23  \n5.2.1 Low-level library .................................... 23  \n5.2.2 TinyML frameworks .................................. 23  \n6 Limitations of TinyML 24  \n7 Conclusion and discussion 25  \n1 Introduction  \nArtificial intelligence. Over the last decade, artificial intelligence (AI) has revolutionized our daily experiences and technological advancements, empowering machines to perform tasks that traditionally require human-like intelligence, such as recognizing objects or speech or playing advanced games like Go.  \nMachine learning (ML) is the most prominent AI approach, which trains computers to learn patterns and representations from","cbCaisDbJL9UN2gF","https://ap.wps.com/l/cbCaisDbJL9UN2gF","pdf",862209,1,39,"English","en",105,"# Introduction\n## Neural networks\n## MEMS-based applications on ultra-low power microcontrollers\n## Efficient neural networks for TinyML\n## Deploying deep learning models on ultra-low power MCUs\n## Limitations of TinyML\n## Conclusion and discussion","[{\"question\":\"What is the main goal of Tiny Machine Learning in this review?\",\"answer\":\"The review focuses on enabling intelligent applications on resource-constrained devices by running deep learning on ultra-low power microcontrollers.\"},{\"question\":\"Which techniques are highlighted to make neural networks more efficient for TinyML?\",\"answer\":\"It covers model compression methods including knowledge distillation, model pruning, quantization, weight-sharing, and low-rank matrix/tensor decompositions.\"},{\"question\":\"What deployment challenges and solutions are discussed for ultra-low power MCUs?\",\"answer\":\"The paper discusses limited computational and memory resources, and presents strategies such as pruning, hardware acceleration, and algorithm-architecture co-design, along with TinyML tool options.\"}]","Efficient Neural Networks for Tiny Machine Learning - A Comprehensive Review | PDF",1785901214,98,{"code":4,"msg":31,"data":32},"ok",{"site_id":24,"language":23,"slug":33,"title":13,"keywords":34,"description":14,"schema_data":35,"social_meta":86,"head_meta":88,"extra_data":90,"updated_unix":28},"efficient-neural-networks-for-tiny-machine-learning-a-comprehensive-review","",{"@graph":36,"@context":85},[37,54,68],{"@type":38,"itemListElement":39},"BreadcrumbList",[40,44,48,51],{"item":41,"name":42,"@type":43,"position":20},"https://docshare.wps.com","Home","ListItem",{"item":45,"name":46,"@type":43,"position":47},"https://docshare.wps.com/document/","Document",2,{"item":49,"name":12,"@type":43,"position":50},"https://docshare.wps.com/document/research-report/",3,{"item":52,"name":13,"@type":43,"position":53},"https://docshare.wps.com/document/efficient-neural-networks-for-tiny-machine-learning-a-comprehensive-review/125789/",4,{"url":52,"name":13,"@type":55,"author":56,"headline":13,"publisher":58,"fileFormat":61,"inLanguage":23,"description":14,"dateModified":62,"datePublished":62,"encodingFormat":61,"isAccessibleForFree":63,"interactionStatistic":64},"DigitalDocument",{"name":9,"@type":57},"Person",{"url":41,"name":59,"@type":60},"DocShare","Organization","application/pdf","2026-08-05",true,{"@type":65,"interactionType":66,"userInteractionCount":20},"InteractionCounter",{"@type":67},"ViewAction",{"@type":69,"mainEntity":70},"FAQPage",[71,77,81],{"name":72,"@type":73,"acceptedAnswer":74},"What is the main goal of Tiny Machine Learning in this review?","Question",{"text":75,"@type":76},"The review focuses on enabling intelligent applications on resource-constrained devices by running deep learning on ultra-low power microcontrollers.","Answer",{"name":78,"@type":73,"acceptedAnswer":79},"Which techniques are highlighted to make neural networks more efficient for TinyML?",{"text":80,"@type":76},"It covers model compression methods including knowledge distillation, model pruning, quantization, weight-sharing, and low-rank matrix/tensor decompositions.",{"name":82,"@type":73,"acceptedAnswer":83},"What deployment challenges and solutions are discussed for ultra-low power MCUs?",{"text":84,"@type":76},"The paper discusses limited computational and memory resources, and presents strategies such as pruning, hardware acceleration, and algorithm-architecture co-design, along with TinyML tool options.","https://schema.org",{"og:url":52,"og:type":87,"og:title":13,"og:site_name":59,"og:description":14},"article",{"robots":89,"canonical":52},"index,follow",{"doc_id":7,"site_id":24},{"code":4,"msg":5,"data":92},[93,97,101,105,110,115,120,123,128,131,135],{"id":20,"doc_module":4,"doc_module_name":46,"category_name":94,"show_sort_weight":95,"slug":96},"Story & Novel",90,"story-novel",{"id":47,"doc_module":4,"doc_module_name":46,"category_name":98,"show_sort_weight":99,"slug":100},"Literature",80,"literature",{"id":53,"doc_module":4,"doc_module_name":46,"category_name":102,"show_sort_weight":103,"slug":104},"Exam",70,"exam",{"id":106,"doc_module":4,"doc_module_name":46,"category_name":107,"show_sort_weight":108,"slug":109},5,"Comic",60,"comic",{"id":111,"doc_module":4,"doc_module_name":46,"category_name":112,"show_sort_weight":113,"slug":114},6,"Technology",50,"technology",{"id":116,"doc_module":4,"doc_module_name":46,"category_name":117,"show_sort_weight":118,"slug":119},7,"Healthcare",40,"healthcare",{"id":11,"doc_module":4,"doc_module_name":46,"category_name":12,"show_sort_weight":121,"slug":122},30,"research-report",{"id":124,"doc_module":4,"doc_module_name":46,"category_name":125,"show_sort_weight":126,"slug":127},9,"Religion & Spirituality",20,"religion-spirituality",{"id":126,"doc_module":4,"doc_module_name":46,"category_name":129,"show_sort_weight":126,"slug":130},"World Cup","world-cup",{"id":132,"doc_module":4,"doc_module_name":46,"category_name":133,"show_sort_weight":132,"slug":134},10,"Lifestyle","lifestyle",{"id":136,"doc_module":4,"doc_module_name":46,"category_name":137,"show_sort_weight":106,"slug":138},19,"General","general"]