[{"data":1,"prerenderedAt":-1},["ShallowReactive",2],{"doc-detail-43478-en":3,"doc-seo-43478-105":30,"detail-sidebar-cat-0-en-105":91},{"code":4,"msg":5,"data":6},0,"success",{"doc_id":7,"user_id":8,"nickname":9,"user_avatar":10,"doc_module":4,"category_id":11,"category_name":12,"doc_title":13,"doc_description":14,"doc_content":15,"file_id":16,"file_url":17,"file_type":18,"file_size":19,"view_count":20,"is_deleted":4,"is_public":21,"is_downloadable":21,"audit_status":21,"page_count":22,"language":23,"language_code":24,"site_id":25,"html_lang":24,"table_of_contents":26,"faqs":27,"seo_title":13,"seo_description":14,"update_tm":28,"read_time":29},43478,1099514068365,"Aurelia","https://ap-avatar.wpscdn.com/avatar/10000253d8d9f28188e?_k=1776742907772140068",8,"Research & Report","HTF-MPR: A Heterogeneous TensorFlow Mapper Targeting Performance using Genetic Algorithms and Gradient Boosting Regressors","HTF-MPR introduces a performance-focused heterogeneous TensorFlow mapping framework that optimizes how devices are assigned to TensorFlow operations in distributed training. The method uses a genetic algorithm to search for mappings beyond TensorFlow’s default mapper, while Gradient Boosting Regressors provide a fitness predictive model to expand the search space. Experiments on ALEXNET, MNIST softmax, and VGG-16 show overall training-stage speedups of 1.18, 3.33, and 1.13, respectively.","HTF-MPR: A Heterogeneous TensorFlow Mapper Targeting Performance using Genetic Algorithmsand Gradient Boosting Regressors  \nAhmad Albaqsami, Maryam S. Hosseini, Nader Bagherzadeh  \nDepartment of Electrical Engineering and Computer Science, University of California, Irvine, CA, USA  \nEmail: {aalbaqsa,mseyyedh,[nader](nader}@uci.edu)[}](nader}@uci.edu)[@uci.edu](nader}@uci.edu)  \nAbstract—TensorFlow [1] is a library developed by Google to implement Artificial Neural Networks using computational dataflow graphs. The neural network has many iterations during training. A distributed, parallel environment is ideal to speedup learning. Parallelism requires proper mapping of devices to TensorFlow operations. We developed HTF-MPR framework for that reason. HTF-MPR utilizes a genetic algorithm approach to search for the best mapping that outperforms the default Tensorflow mapper. By using Gradient Boosting Regressors to create the fitness predictive model, the search space is expanded which increases the chances of finding a solution mapping. Our results on well-known neural network benchmarks, such as ALEXNET, MNIST softmax classifier, and VGG-16, show an overall speedup in the training stage by 1.18, 3.33, and 1.13, respectively.  \nI. INTRODUCTION  \nMachine Learning (ML) algorithms [2] have found a large number of applications in computer vision, data tracking, recommender systems, search engines and Artificial Intelligence (AI) in games. One notable advancement in ML algorithms is the use of Artificial Neural Networks (ANNs) [3] . ANNs are constructs that mimic how the brain works. In their most basic form, they consist of synapses and neurons, where the synapses are the weights and neurons are the functions (see Fig 1) . Companies invest in improving and utilizing ANNs for different tasks [4], leading to many applications applied to ANNs, creating deep and complex ANN architectures, finding techniques and accelerating the training and the inference of ANNs [5]–[7] . A number of softwares libraries have been developed to ease the construction of ANNs for end-users. One such library is TensorFlow [8]; a computational graph and numerical models library developed by Google. The application programming interface (API) makes it possible for data scientists to work with large models and many data samples in a distributed system without prior knowledge of the hardware architecture.  \nThe current state-of-the-art ANNs consist of hundreds of thousands of parameters, and require large data sets to train. The number of layers, features (inputs) and interconnections, result in a large number of parameters that require training, which prolongs the training process.  \nTraining in ANNs are iterative [9]; in each iteration, the process would require a feed-forward step through the ANN, and a back-propagation that flows backwards. With each iteration, a set of data-samples (batch, or mini-batch) are fed  \n,ŝĚĚĞŶ >ĂLJĞƌ ϭ  \n/ŶƉƵƚ ,ŝĚĚĞŶ >ĂLJĞƌ Ϯ  \nKƵƚƉƵƚ  \nĂͿ 􀀄ƌƚŝĨŝĐŝĂů EĞƵƌĂů EĞƚǁŽƌŬ  \n/ŶƉƵƚ ,ŝĚĚĞŶ ,ŝĚĚĞŶ KƵƚƉƵƚ  \n>ĂLJĞƌ ϭ d& KƉĞƌĂƚŝŽŶ  \n>ĂLJĞƌ Ϯ d& KƉĞƌĂƚŝŽŶ  \nďͿ dĞŶƐŽƌĨůŽǁ 'ƌĂƉŚ  \nFig. 1. Artificial Neural Network and its TensorFlow depiction  \nto the ANN. This modifies the parameters (weights and biases) which reduces a given loss-function.  \nIn TensorFlow, parameters, functions, and inputs are represented by computational graphs [1] . Computational graphs consist of edges and vertices in a Directed Acyclic Graph (DAG) . Edges carry multi-dimensional arrays known as tensors, and vertices are the functions, known as operations, applied to tensors. A simple translation from ANN to a TensorFlow computational graph is shown in Fig 1b.  \nSpeedup of these computational graphs is of importance. One such approach is to reduce the number of parameters ina ANN [10] . In [10], the authors compressed the ANN by pruning the number of neurons and synapses, which reduces the number of computations. However, this would slightly change the accuracy of the prediction model [10] . ","cbCaicSr9t15HEJq","https://ap.wps.com/l/cbCaicSr9t15HEJq","pdf",608405,2,1,6,"English","en",105,"# Introduction\n## TensorFlow computational graphs and mapping\n## Limits of default mapping\n## Alternative mapping strategies","[{\"question\":\"What problem does HTF-MPR address in TensorFlow?\",\"answer\":\"HTF-MPR targets the need for proper mapping of heterogeneous devices to TensorFlow operations to accelerate distributed neural network training.\"},{\"question\":\"How does HTF-MPR search for an improved mapping?\",\"answer\":\"It uses a genetic algorithm to explore mappings, guided by a fitness predictive model built with Gradient Boosting Regressors.\"},{\"question\":\"What speedups are reported on common benchmarks?\",\"answer\":\"The reported overall speedups in the training stage are 1.18 for ALEXNET, 3.33 for MNIST softmax, and 1.13 for VGG-16.\"}]",1783381707,15,{"code":4,"msg":31,"data":32},"ok",{"site_id":25,"language":24,"slug":33,"title":13,"keywords":34,"description":14,"schema_data":35,"social_meta":86,"head_meta":88,"extra_data":90,"updated_unix":28},"htf-mpr-a-heterogeneous-tensorflow-mapper-targeting-performance-using-genetic-algorithms-and-gradient-boosting-regressors","",{"@graph":36,"@context":85},[37,53,68],{"@type":38,"itemListElement":39},"BreadcrumbList",[40,44,47,50],{"item":41,"name":42,"@type":43,"position":21},"https://docshare.wps.com","Home","ListItem",{"item":45,"name":46,"@type":43,"position":20},"https://docshare.wps.com/document/","Document",{"item":48,"name":12,"@type":43,"position":49},"https://docshare.wps.com/document/research-report/",3,{"item":51,"name":13,"@type":43,"position":52},"https://docshare.wps.com/document/htf-mpr-a-heterogeneous-tensorflow-mapper-targeting-performance-using-genetic-algorithms-and-gradient-boosting-regressors/43478/",4,{"url":51,"name":13,"@type":54,"author":55,"headline":13,"publisher":57,"fileFormat":60,"inLanguage":24,"description":14,"dateModified":61,"datePublished":62,"encodingFormat":60,"isAccessibleForFree":63,"interactionStatistic":64},"DigitalDocument",{"name":9,"@type":56},"Person",{"url":41,"name":58,"@type":59},"DocShare","Organization","application/pdf","2026-07-13","2026-07-06",true,{"@type":65,"interactionType":66,"userInteractionCount":20},"InteractionCounter",{"@type":67},"ViewAction",{"@type":69,"mainEntity":70},"FAQPage",[71,77,81],{"name":72,"@type":73,"acceptedAnswer":74},"What problem does HTF-MPR address in TensorFlow?","Question",{"text":75,"@type":76},"HTF-MPR targets the need for proper mapping of heterogeneous devices to TensorFlow operations to accelerate distributed neural network training.","Answer",{"name":78,"@type":73,"acceptedAnswer":79},"How does HTF-MPR search for an improved mapping?",{"text":80,"@type":76},"It uses a genetic algorithm to explore mappings, guided by a fitness predictive model built with Gradient Boosting Regressors.",{"name":82,"@type":73,"acceptedAnswer":83},"What speedups are reported on common benchmarks?",{"text":84,"@type":76},"The reported overall speedups in the training stage are 1.18 for ALEXNET, 3.33 for MNIST softmax, and 1.13 for VGG-16.","https://schema.org",{"og:url":51,"og:type":87,"og:title":13,"og:site_name":58,"og:description":14},"article",{"robots":89,"canonical":51},"index,follow",{"doc_id":7,"site_id":25},{"code":4,"msg":5,"data":92},[93,97,101,105,110,114,119,122,127,130,134],{"id":21,"doc_module":4,"doc_module_name":46,"category_name":94,"show_sort_weight":95,"slug":96},"Story & Novel",90,"story-novel",{"id":20,"doc_module":4,"doc_module_name":46,"category_name":98,"show_sort_weight":99,"slug":100},"Literature",80,"literature",{"id":52,"doc_module":4,"doc_module_name":46,"category_name":102,"show_sort_weight":103,"slug":104},"Exam",70,"exam",{"id":106,"doc_module":4,"doc_module_name":46,"category_name":107,"show_sort_weight":108,"slug":109},5,"Comic",60,"comic",{"id":22,"doc_module":4,"doc_module_name":46,"category_name":111,"show_sort_weight":112,"slug":113},"Technology",50,"technology",{"id":115,"doc_module":4,"doc_module_name":46,"category_name":116,"show_sort_weight":117,"slug":118},7,"Healthcare",40,"healthcare",{"id":11,"doc_module":4,"doc_module_name":46,"category_name":12,"show_sort_weight":120,"slug":121},30,"research-report",{"id":123,"doc_module":4,"doc_module_name":46,"category_name":124,"show_sort_weight":125,"slug":126},9,"Religion & Spirituality",20,"religion-spirituality",{"id":125,"doc_module":4,"doc_module_name":46,"category_name":128,"show_sort_weight":125,"slug":129},"World Cup","world-cup",{"id":131,"doc_module":4,"doc_module_name":46,"category_name":132,"show_sort_weight":131,"slug":133},10,"Lifestyle","lifestyle",{"id":135,"doc_module":4,"doc_module_name":46,"category_name":136,"show_sort_weight":106,"slug":137},19,"General","general"]