[{"data":1,"prerenderedAt":-1},["ShallowReactive",2],{"doc-detail-118557-en":3,"doc-seo-118557-105":29,"detail-sidebar-cat-0-en-105":91},{"code":4,"msg":5,"data":6},0,"success",{"doc_id":7,"user_id":8,"nickname":9,"user_avatar":10,"doc_module":4,"category_id":11,"category_name":12,"doc_title":13,"doc_description":14,"doc_content":15,"file_id":16,"file_url":17,"file_type":18,"file_size":19,"view_count":20,"is_deleted":4,"is_public":20,"is_downloadable":20,"audit_status":20,"page_count":11,"language":21,"language_code":22,"site_id":23,"html_lang":22,"table_of_contents":24,"faqs":25,"seo_title":26,"seo_description":14,"update_tm":27,"read_time":28},118557,13056703019662,"Evangeline","https://ap-avatar.wpscdn.com/avatar/be000253a8e92610077?_k=1778726343310543188",8,"Research & Report","Co-Designing NVM-based Systems - for Machine Learning and In-memory Search Applications","This invited paper examines how non-volatile memory (NVM) technologies can improve machine learning workloads on resource-constrained edge devices and accelerate large-scale search. It analyzes energy efficiency and latency reduction via in-memory computation and different NVM write modes, while addressing PCM write-latency, endurance, and retention trade-offs and the read-destructive wear implications of FeRAM. It also evaluates NVM-based CAM/CIM accelerator architectures, focusing on how device choice and array partitioning/merge schemes affect performance, area, latency, energy, and accuracy.","(Invited Paper) Co-Designing NVM-based Systems  \nfor Machine Learning and In-memory Search Applications  \nJrg Henkel∗ , Lokesh Siddhu∗ , Hassan Nassar∗ , Lars Bauer, Jian-Jia Chen†, Christian Hakert†, Tristan Seidl†, Kuan Hsun Chen‡, Xiaobo Sharon Hu§ , Mengyuan Li§ , Chia-Lin Yang¶ , Ming-Liang Wei¶  \n∗ Karlsruhe Institute of Technology, Germany, †TU Dortmund, Germany, ‡University of Twente, the Netherlands,  \n§ University of Notre Dame, Indiana, USA, ¶ National Taiwan University, Taiwan  \nAbstract—With the rapid development of the Internet of Things, machine learning applications on edge devices with limited resources face challenges due to large data scales and irregular memory access patterns. Non-volatile memory (NVM) technologies provide promising solutions by offering larger capacity, low leakage power, and data persistence. In this paper, we discuss the potential of NVM technology in enhancing machine learning applications by improving energy efficiency and reducing latency through in-memory computation and different NVM write modes. The insights from this analysis provide valuable guidance to device researchers and system architects working to develop highperformance systems for machine learning and accelerators in large-scale search applications using NVMs.  \nI. INTRODUCTION  \nIn the rapidly evolving field of machine learning (ML), especially on edge devices with constrained resources, the integration of Non-Volatile Memories (NVMs) such as Phase Change Memory (PCM) offers notable advantages. PCM’s larger capacity, low leakage power, and data persistence make it a promising candidate for enhancing ML capabilities atthe edge. However, integrating PCM into edge devices isnot without challenges, particularly concerning (slow) write performance and endurance. To address these obstacles, researchers have suggested using various PCM write modes that provide a balance between write latency and data retention. For instance, fast write mode significantly reduces write latency and energy consumption, but due to low retention time, it demands data refreshing. Addressing these trade-offs is essential for optimizing the role of PCM in edge ML applications.  \nAnother NVM technology widely used in edge devices is Ferroelectric RAM (FeRAM), which offers fast access speedsand large capacities suitable for edge contexts. The ability of FeRAM to be used as byte-addressable memory allows software to directly store important runtime information inside of the FeRAM, which can assist fast transfer between powersaving states of the system. Especially for timing predictable ML applications, minimal overhead transitions between powersaving states allow for energetic optimization while not affecting the timeliness of the system. On the downside, FeRAM is a read-destructive memory, which increases wear and shortens its lifespan, necessitating careful management in critical ML applications.  \nBeyond edge ML applications, NVMs have also demonstrated potential in accelerating large-scale search operations, a common requirement in many machine learning tasks. The vast data scale and irregular memory access patterns involved in these operations present significant challenges. NVM-based content addressable memories (CAMs) have emerged as a promising compute in memory (CIM) search solution for these applications. However, selecting the optimal NVM devices and architectures for CAM-based accelerator is a complex task. Atthe architecture level, factors such as the size of the basic CAM array and the partition and merge schemes used to combine array results significantly influence application-level accuracy as well as the area, latency, and energy efficiency. Furthermore, read/write costs and device variability associated with different NVMs affect overall performance and accuracy. It is crucial to examine how various NVM device and architecture choices impact the performance of in-memory search accelerators. A thorough examination/research of how variou","cbCaisRM8QSHl7AV","https://ap.wps.com/l/cbCaisRM8QSHl7AV","pdf",781479,1,"English","en",105,"# Abstract\n# I. Introduction\n## Edge ML with NVMs: PCM and FeRAM trade-offs\n## NVM-based in-memory search: CAM/CIM architecture choices\n## Weight-access challenges in deep learning and limitations of eDRAM\n## Processing-in-NVM concepts and analog-domain constraints","[{\"question\":\"How do NVM technologies help edge machine learning workloads?\",\"answer\":\"NVMs such as PCM and FeRAM offer larger capacity, low leakage power, and persistence. The paper highlights benefits for energy efficiency and latency reduction, while also addressing write performance and endurance constraints.\"},{\"question\":\"What trade-offs arise when using PCM for edge ML?\",\"answer\":\"Fast PCM write modes reduce write latency and energy consumption, but require data refreshing due to low retention time. Slow write modes better preserve data longer but increase latency, so balancing both is essential.\"},{\"question\":\"Why are NVM-based CAM/CIM accelerators relevant for in-memory search?\",\"answer\":\"Large-scale search uses vast data and irregular memory access patterns that traditional architectures struggle with. NVM-based CAMs enable compute-in-memory search, but device selection and CAM array partition/merge strategies significantly affect accuracy and efficiency.\"}]","Co-Designing NVM-based Systems - for Machine Learning and In-memory Search Applications | PDF",1785684154,20,{"code":4,"msg":30,"data":31},"ok",{"site_id":23,"language":22,"slug":32,"title":13,"keywords":33,"description":14,"schema_data":34,"social_meta":86,"head_meta":88,"extra_data":90,"updated_unix":27},"co-designing-nvm-based-systems-for-machine-learning-and-in-memory-search-applications","",{"@graph":35,"@context":85},[36,53,68],{"@type":37,"itemListElement":38},"BreadcrumbList",[39,43,47,50],{"item":40,"name":41,"@type":42,"position":20},"https://docshare.wps.com","Home","ListItem",{"item":44,"name":45,"@type":42,"position":46},"https://docshare.wps.com/document/","Document",2,{"item":48,"name":12,"@type":42,"position":49},"https://docshare.wps.com/document/research-report/",3,{"item":51,"name":13,"@type":42,"position":52},"https://docshare.wps.com/document/co-designing-nvm-based-systems-for-machine-learning-and-in-memory-search-applications/118557/",4,{"url":51,"name":13,"@type":54,"author":55,"headline":13,"publisher":57,"fileFormat":60,"inLanguage":22,"description":14,"dateModified":61,"datePublished":62,"encodingFormat":60,"isAccessibleForFree":63,"interactionStatistic":64},"DigitalDocument",{"name":9,"@type":56},"Person",{"url":40,"name":58,"@type":59},"DocShare","Organization","application/pdf","2026-08-05","2026-08-02",true,{"@type":65,"interactionType":66,"userInteractionCount":20},"InteractionCounter",{"@type":67},"ViewAction",{"@type":69,"mainEntity":70},"FAQPage",[71,77,81],{"name":72,"@type":73,"acceptedAnswer":74},"How do NVM technologies help edge machine learning workloads?","Question",{"text":75,"@type":76},"NVMs such as PCM and FeRAM offer larger capacity, low leakage power, and persistence. The paper highlights benefits for energy efficiency and latency reduction, while also addressing write performance and endurance constraints.","Answer",{"name":78,"@type":73,"acceptedAnswer":79},"What trade-offs arise when using PCM for edge ML?",{"text":80,"@type":76},"Fast PCM write modes reduce write latency and energy consumption, but require data refreshing due to low retention time. Slow write modes better preserve data longer but increase latency, so balancing both is essential.",{"name":82,"@type":73,"acceptedAnswer":83},"Why are NVM-based CAM/CIM accelerators relevant for in-memory search?",{"text":84,"@type":76},"Large-scale search uses vast data and irregular memory access patterns that traditional architectures struggle with. NVM-based CAMs enable compute-in-memory search, but device selection and CAM array partition/merge strategies significantly affect accuracy and efficiency.","https://schema.org",{"og:url":51,"og:type":87,"og:title":13,"og:site_name":58,"og:description":14},"article",{"robots":89,"canonical":51},"index,follow",{"doc_id":7,"site_id":23},{"code":4,"msg":5,"data":92},[93,97,101,105,110,115,120,123,127,130,134],{"id":20,"doc_module":4,"doc_module_name":45,"category_name":94,"show_sort_weight":95,"slug":96},"Story & Novel",90,"story-novel",{"id":46,"doc_module":4,"doc_module_name":45,"category_name":98,"show_sort_weight":99,"slug":100},"Literature",80,"literature",{"id":52,"doc_module":4,"doc_module_name":45,"category_name":102,"show_sort_weight":103,"slug":104},"Exam",70,"exam",{"id":106,"doc_module":4,"doc_module_name":45,"category_name":107,"show_sort_weight":108,"slug":109},5,"Comic",60,"comic",{"id":111,"doc_module":4,"doc_module_name":45,"category_name":112,"show_sort_weight":113,"slug":114},6,"Technology",50,"technology",{"id":116,"doc_module":4,"doc_module_name":45,"category_name":117,"show_sort_weight":118,"slug":119},7,"Healthcare",40,"healthcare",{"id":11,"doc_module":4,"doc_module_name":45,"category_name":12,"show_sort_weight":121,"slug":122},30,"research-report",{"id":124,"doc_module":4,"doc_module_name":45,"category_name":125,"show_sort_weight":28,"slug":126},9,"Religion & Spirituality","religion-spirituality",{"id":28,"doc_module":4,"doc_module_name":45,"category_name":128,"show_sort_weight":28,"slug":129},"World Cup","world-cup",{"id":131,"doc_module":4,"doc_module_name":45,"category_name":132,"show_sort_weight":131,"slug":133},10,"Lifestyle","lifestyle",{"id":135,"doc_module":4,"doc_module_name":45,"category_name":136,"show_sort_weight":106,"slug":137},19,"General","general"]