[{"data":1,"prerenderedAt":-1},["ShallowReactive",2],{"doc-seo-672777-105":3,"detail-sidebar-cat-0-en-105":79,"doc-detail-672777-en":129},{"code":4,"msg":5,"data":6},0,"ok",{"site_id":7,"language":8,"slug":9,"title":10,"keywords":11,"description":12,"schema_data":13,"social_meta":72,"head_meta":74,"extra_data":76,"updated_unix":78},105,"en","nvidia-dgx-a100-system-architecture-technical-white-paper-wp-10083-001-v01-july-2020","NVIDIA DGX A100 System Architecture - Technical White Paper - WP-10083-001 v01 - July 2020","","A technical white paper describing the NVIDIA DGX A100 system architecture as a universal foundation for AI infrastructure. It explains why traditional compute is inefficient for AI workloads, then details the design built around the NVIDIA A100 Tensor Core GPU, including AI performance features, multi-GPU and multi-node scalability via DGX reference architectures, and high-throughput interconnects. The document also covers networking, PCIe Gen4 foundations, security mechanisms, the optimized DGX software stack, and performance results such as MLPerf v0.7 training records.",{"@graph":14,"@context":71},[15,34,54],{"@type":16,"itemListElement":17},"BreadcrumbList",[18,23,27,31],{"item":19,"name":20,"@type":21,"position":22},"https://docshare.wps.com","Home","ListItem",1,{"item":24,"name":25,"@type":21,"position":26},"https://docshare.wps.com/document/","Document",2,{"item":28,"name":29,"@type":21,"position":30},"https://docshare.wps.com/document/technology/","Technology",3,{"item":32,"name":10,"@type":21,"position":33},"https://docshare.wps.com/document/nvidia-dgx-a100-system-architecture-technical-white-paper-wp-10083-001-v01-july-2020/672777/",4,{"url":32,"name":10,"@type":35,"image":36,"author":41,"headline":10,"publisher":44,"fileFormat":47,"inLanguage":8,"description":12,"dateModified":48,"datePublished":48,"encodingFormat":47,"isAccessibleForFree":49,"interactionStatistic":50},"DigitalDocument",{"url":37,"@type":38,"width":39,"height":40},"https://docshare.wps.com/thumbnails/nvidia-dgx-a100-system-architecture-technical-white-paper-wp-10083-001-v01-july-2020/672777.png","ImageObject",300,407,{"name":42,"@type":43},"cimolpedes","Person",{"url":19,"name":45,"@type":46},"DocShare","Organization","application/pdf","2026-11-02",true,{"@type":51,"interactionType":52,"userInteractionCount":26},"InteractionCounter",{"@type":53},"ViewAction",{"@type":55,"mainEntity":56},"FAQPage",[57,63,67],{"name":58,"@type":59,"acceptedAnswer":60},"Why does the paper position the DGX A100 as a universal AI infrastructure system?","Question",{"text":61,"@type":62},"It argues that traditional compute infrastructures are unsuitable for AI because of slow CPU architectures and shifting requirements across workloads and project phases. The DGX family is designed to reduce integration complexity while delivering strong performance and scalable deployment options.","Answer",{"name":64,"@type":59,"acceptedAnswer":65},"What are key hardware elements emphasized in the DGX A100 architecture?",{"text":66,"@type":62},"The paper highlights the NVIDIA A100 Tensor Core GPU as the core compute engine, along with features such as high-bandwidth HBM2 memory, third-generation tensor cores, structured sparsity, and Multi-Instance GPU (MIG). It also covers system acceleration through NVLink/NVSwitch and high networking throughput.",{"name":68,"@type":59,"acceptedAnswer":69},"What performance and validation topics does the document include?",{"text":70,"@type":62},"It discusses performance claims and includes a section on breaking AI performance records for MLPerf v0.7 training. It also references figure-level details related to inference throughput with MIG and training/inference performance.","https://schema.org",{"og:url":32,"og:type":73,"og:title":10,"og:site_name":45,"og:description":12},"article",{"robots":75,"canonical":32},"index,follow",{"doc_id":77,"site_id":7},672777,1793607183,{"code":4,"msg":80,"data":81},"success",[82,86,90,94,99,103,108,113,118,121,125],{"id":22,"doc_module":4,"doc_module_name":25,"category_name":83,"show_sort_weight":84,"slug":85},"Story & Novel",90,"story-novel",{"id":26,"doc_module":4,"doc_module_name":25,"category_name":87,"show_sort_weight":88,"slug":89},"Literature",80,"literature",{"id":33,"doc_module":4,"doc_module_name":25,"category_name":91,"show_sort_weight":92,"slug":93},"Exam",70,"exam",{"id":95,"doc_module":4,"doc_module_name":25,"category_name":96,"show_sort_weight":97,"slug":98},5,"Comic",60,"comic",{"id":100,"doc_module":4,"doc_module_name":25,"category_name":29,"show_sort_weight":101,"slug":102},6,50,"technology",{"id":104,"doc_module":4,"doc_module_name":25,"category_name":105,"show_sort_weight":106,"slug":107},7,"Healthcare",40,"healthcare",{"id":109,"doc_module":4,"doc_module_name":25,"category_name":110,"show_sort_weight":111,"slug":112},8,"Research & Report",30,"research-report",{"id":114,"doc_module":4,"doc_module_name":25,"category_name":115,"show_sort_weight":116,"slug":117},9,"Religion & Spirituality",20,"religion-spirituality",{"id":116,"doc_module":4,"doc_module_name":25,"category_name":119,"show_sort_weight":116,"slug":120},"World Cup","world-cup",{"id":122,"doc_module":4,"doc_module_name":25,"category_name":123,"show_sort_weight":122,"slug":124},10,"Lifestyle","lifestyle",{"id":126,"doc_module":4,"doc_module_name":25,"category_name":127,"show_sort_weight":95,"slug":128},19,"General","general",{"code":4,"msg":80,"data":130},{"doc_id":77,"user_id":131,"nickname":42,"user_avatar":132,"doc_module":4,"category_id":100,"category_name":29,"doc_title":10,"doc_description":12,"doc_content":133,"file_id":134,"file_url":135,"file_type":136,"file_size":137,"view_count":26,"is_deleted":4,"is_public":22,"is_downloadable":22,"audit_status":22,"page_count":138,"language":139,"language_code":8,"site_id":7,"html_lang":8,"table_of_contents":140,"faqs":141,"seo_title":142,"seo_description":12,"update_tm":78,"read_time":143},962094243610,"https://ap-avatar.wpscdn.com/davatar_3d24733baf745e90a7e4bdd5f77d97b2","NVIDIA DGX A100 System Architecture  \nThe Universal System for AI Infrastructure Technical White Paper  \nContact  \nSky Blue Microsystems GmbH  \nGeisenhausenerstr. 18  \n81379 Munich, Germany  \n+49 89 780 2970, [info@skyblue.de](info@skyblue.de)[ ](info@skyblue.de)[www.skyblue.de](www.skyblue.de)  \nIn Great Britain:  \nZerif Technologies Ltd.  \nWinnington House, 2 Woodberry Grove Finchley, London N12 0DR  \n+44 115 855 7883, [info@zerif.co.uk](info@zerif.co.uk)[ ](info@zerif.co.uk)[www.zerif.co.uk](www.zerif.co.uk)  \nWP-10083-001 _v01 | July 2020  \nTable of Contents  \n1 Introduction ............................................................................................................................. 1  \n2 System Architecture................................................................................................................ 2  \n3 NVIDIA A100 GPU-8th Generation Data Center GPU for the Age of Elastic Computing .... 3  \n3.1 Third-Generation Tensor Cores ...................................................................................... 3  \n3.2 Tensor Float-32 (T F32) Uses Tensor Cores by Default ................................................... 4  \n3.3 Fine-grained Structured Sparsity ................................................................................... 6  \n3.4 Multi-Instance GPU (MIG) ............................................................................................... 7  \n4 Third-Generation NVLink and NVSwitch to Accelerate Large Complex Workloads........... 10  \n5 Highest Networking Throughput with Mellanox ConnectX-6 .............................................. 11  \n6 First Accelerated System With All PCIe Gen4 ...................................................................... 12  \n7 Security.................................................................................................................................. 13  \n7.1 Self-Encrypted Drives ................................................................................................... 13  \n7.2 Trusted Platform Module (T PM) Technology ................................................................ 13  \n8 Fully Optimized DGX Software Stack .................................................................................... 14  \n9 Game Changing Performance .............................................................................................. 16  \n10 Breaking AI Performance Records for MLPerf v0.7 Training ........................................... 17  \n11 Direct Access to NVIDIA DGX perts ..................................................................................... 18  \n12 Summary ............................................................................................................................. 18  \n13 Appendix: Graph Details ..................................................................................................... 19  \n13.1 Details for Figure 7: Inference Throughput with MIG ............................................... 19  \n13.2 Details for Figure 12: DGX A100 AI Training and Inference Performance ................ 20  \nNVIDIA DGX A100 System Architecture WP-10083-001 _v01 | 1  \n1 Introduction  \nOrganizations of all kinds are incorporating AI into their research, development, product, and business processes. This helps them meet and exceed their particular goals, and also helps them gain experience and knowledge to take on even bigger challenges. However, traditional compute infrastructures are not suitable for AI due to slow CPU architectures and varying system requirements for different workloads and project phases. This drives up complexity, increases cost, and limits scale.  \nTo help organizations overcome these obstacles and succeed in a world that desperately needs the power of AI to solve big challenges, NVIDIA designed the world's first family of systems purpose-built for AI—NVIDIA DGX™ systems. By leveraging powerful NVIDIA GPUs and designing from the ground up for ","cbCaikhHLEJjOAKG","https://ap.wps.com/l/cbCaikhHLEJjOAKG","pdf",3128076,23,"English","# 1 Introduction\n# 2 System Architecture\n# 3 NVIDIA A100 GPU-8th Generation Data Center GPU for the Age of Elastic Computing\n## 3.1 Third-Generation Tensor Cores\n## 3.2 Tensor Float-32 (T F32) Uses Tensor Cores by Default\n## 3.3 Fine-grained Structured Sparsity\n## 3.4 Multi-Instance GPU (MIG)\n# 4 Third-Generation NVLink and NVSwitch to Accelerate Large Complex Workloads\n# 5 Highest Networking Throughput with Mellanox ConnectX-6\n# 6 First Accelerated System With All PCIe Gen4\n# 7 Security\n## 7.1 Self-Encrypted Drives\n## 7.2 Trusted Platform Module (T PM) Technology\n# 8 Fully Optimized DGX Software Stack\n# 9 Game Changing Performance\n# 10 Breaking AI Performance Records for MLPerf v0.7 Training\n# 11 Direct Access to NVIDIA DGX perts\n# 12 Summary\n# 13 Appendix: Graph Details\n## 13.1 Details for Figure 7: Inference Throughput with MIG\n## 13.2 Details for Figure 12: DGX A100 AI Training and Inference Performance","[{\"question\":\"Why does the paper position the DGX A100 as a universal AI infrastructure system?\",\"answer\":\"It argues that traditional compute infrastructures are unsuitable for AI because of slow CPU architectures and shifting requirements across workloads and project phases. The DGX family is designed to reduce integration complexity while delivering strong performance and scalable deployment options.\"},{\"question\":\"What are key hardware elements emphasized in the DGX A100 architecture?\",\"answer\":\"The paper highlights the NVIDIA A100 Tensor Core GPU as the core compute engine, along with features such as high-bandwidth HBM2 memory, third-generation tensor cores, structured sparsity, and Multi-Instance GPU (MIG). It also covers system acceleration through NVLink/NVSwitch and high networking throughput.\"},{\"question\":\"What performance and validation topics does the document include?\",\"answer\":\"It discusses performance claims and includes a section on breaking AI performance records for MLPerf v0.7 training. It also references figure-level details related to inference throughput with MIG and training/inference performance.\"}]","NVIDIA DGX A100 System Architecture - Technical White Paper - WP-10083-001 v01 - July 2020 | PDF",58]