[{"data":1,"prerenderedAt":-1},["ShallowReactive",2],{"detail-sidebar-cat-1-en-105":3,"doc-seo-239665-105":53,"doc-detail-239665-en":127},{"code":4,"msg":5,"data":6},0,"success",[7,14,19,24,29,34,39,44,49],{"id":8,"doc_module":9,"doc_module_name":10,"category_name":11,"show_sort_weight":12,"slug":13},11,1,"Template","Presentations",90,"presentations",{"id":15,"doc_module":9,"doc_module_name":10,"category_name":16,"show_sort_weight":17,"slug":18},12,"Resumes",80,"resumes",{"id":20,"doc_module":9,"doc_module_name":10,"category_name":21,"show_sort_weight":22,"slug":23},14,"Invoices",70,"invoices",{"id":25,"doc_module":9,"doc_module_name":10,"category_name":26,"show_sort_weight":27,"slug":28},15,"Posters",60,"posters",{"id":30,"doc_module":9,"doc_module_name":10,"category_name":31,"show_sort_weight":32,"slug":33},16,"Social Media",50,"social-media",{"id":35,"doc_module":9,"doc_module_name":10,"category_name":36,"show_sort_weight":37,"slug":38},17,"Forms",40,"forms",{"id":40,"doc_module":9,"doc_module_name":10,"category_name":41,"show_sort_weight":42,"slug":43},18,"Letters",30,"letters",{"id":45,"doc_module":9,"doc_module_name":10,"category_name":46,"show_sort_weight":47,"slug":48},21,"Paper Templates",5,"papers-templates",{"id":50,"doc_module":9,"doc_module_name":10,"category_name":51,"show_sort_weight":4,"slug":52},158,"General","general-158",{"code":4,"msg":54,"data":55},"ok",{"site_id":56,"language":57,"slug":58,"title":59,"keywords":60,"description":61,"schema_data":62,"social_meta":120,"head_meta":122,"extra_data":124,"updated_unix":126},105,"en","sfo15-506-capabilities-of-workload-automation-test-harness-setup-execution-flow-limitations","SFO15-506 - Capabilities of Workload Automation Test Harness - setup, execution flow, limitations","","SFO15-506 introduces a Workload Automation (WA) test harness designed for repeatable benchmark execution across Android, Linux, and ChromeOS. The content covers setup requirements on a Ubuntu host, target-board networking assumptions, and Python-based installation steps using pip and required packages. It details the WA execution flow, including YAML-driven agendas, instrumentation and perf event selection, workload sequencing, and demo guidance for remote board runs. Key limitations include one-to-one WA instances, Python 2.7 dependency, static target IP assumptions, constrained reporting, and reliance on SSH, followed by next-step improvements toward automated PASS/FAIL reporting.",{"@graph":63,"@context":119},[64,80,102],{"@type":65,"itemListElement":66},"BreadcrumbList",[67,71,74,77],{"item":68,"name":69,"@type":70,"position":9},"https://docshare.wps.com","Home","ListItem",{"item":72,"name":10,"@type":70,"position":73},"https://docshare.wps.com/template/",2,{"item":75,"name":11,"@type":70,"position":76},"https://docshare.wps.com/template/presentations/",3,{"item":78,"name":59,"@type":70,"position":79},"https://docshare.wps.com/template/sfo15-506-capabilities-of-workload-automation-test-harness-setup-execution-flow-limitations/239665/",4,{"url":78,"name":59,"@type":81,"image":82,"author":87,"headline":59,"publisher":90,"fileFormat":93,"inLanguage":57,"description":61,"dateModified":94,"datePublished":95,"encodingFormat":93,"isAccessibleForFree":96,"interactionStatistic":97},"DigitalDocument",{"url":83,"@type":84,"width":85,"height":86},"https://docshare.wps.com/thumbnails/sfo15-506-capabilities-of-workload-automation-test-harness-setup-execution-flow-limitations/239665.png","ImageObject",442,249,{"name":88,"@type":89},"Genevieve","Person",{"url":68,"name":91,"@type":92},"DocShare","Organization","application/pdf","2026-11-04","2026-09-11",true,{"@type":98,"interactionType":99,"userInteractionCount":101},"InteractionCounter",{"@type":100},"ViewAction",13,{"@type":103,"mainEntity":104},"FAQPage",[105,111,115],{"name":106,"@type":107,"acceptedAnswer":108},"What platforms and programming language does the workload automation test harness support?","Question",{"text":109,"@type":110},"The harness supports Android, Linux, and ChromeOS, and it is written in Python.","Answer",{"name":112,"@type":107,"acceptedAnswer":113},"What are the primary setup requirements for running WA?",{"text":114,"@type":110},"A Ubuntu 14.04 LTS host with Python 2.7 and required packages installed is used, along with a Pandaboard target board. Networking is required, and SSH is needed when running WA on Linux targets.",{"name":116,"@type":107,"acceptedAnswer":117},"What limitations affect WA execution and reporting?",{"text":118,"@type":110},"WA is limited to a one-to-one model (one WA instance per board), requires Python 2.7, assumes the target IP is static, offers limited reporting capabilities, and depends on SSH for Linux execution.","https://schema.org",{"og:url":78,"og:type":121,"og:title":59,"og:site_name":91,"og:description":61},"article",{"robots":123,"canonical":78},"index,follow",{"doc_id":125,"site_id":56},239665,1791727954,{"code":4,"msg":5,"data":128},{"doc_id":125,"user_id":129,"nickname":88,"user_avatar":130,"doc_module":9,"category_id":8,"category_name":11,"doc_title":59,"doc_description":61,"doc_content":131,"file_id":132,"file_url":133,"file_type":134,"file_size":135,"view_count":101,"is_deleted":4,"is_public":9,"is_downloadable":9,"audit_status":9,"page_count":25,"language":136,"language_code":57,"site_id":56,"html_lang":57,"table_of_contents":137,"faqs":138,"seo_title":139,"seo_description":61,"update_tm":140,"read_time":47},1374391974585,"https://ap-avatar.wpscdn.com/davatar_276721f389ce27ea32af1340a28f341c","Presented by  \nLisa Nguyen  \nDate  \nFriday 25 September 2015  \nEvent  \nSFO15  \nSFO15-506:  \nCapabilities of Workload Automation  \nTest Harness  \nLisa Nguyen, Linaro  \nIntroduction  \n● Created by ARM  \n● Run benchmarks repeatably  \n● Supports Android, Linux, and ChromeOS  \n● Written in python  \nSetup example  \n● Host (laptop) running Ubuntu 14.04 LTS  \n● Pandaboard as target (running either Android or Ubuntu)  \n● Networking required!  \n● Host has python 2.7, build-essential, git, and OpenSSH packages installed  \nSetup commands  \nOn Ubuntu:  \n● sudo apt-get install python-pip  \n● sudo apt-get install python-serial Install packages via pip:  \n● sudo pip install--upgrade pip  \n● sudo pip install--upgrade setuptools ● sudo pip install pexpect  \n● sudo pip install pyserial  \n● sudo pip install docutils  \n● sudo pip install python-dateutil  \n● sudo pip install wlauto  \nDemo  \nRun WA remotely on a board in Kevin Hilman’s lab and show some nifty commands!  \nWA Execution Flow  \nSample agenda  \nglobal: iterations: 2  \n\\# instrumentation: [perf]  \n\\# perf:  \n\\# events: ['task-clock', 'faults', 'migrations', 'cs', 'sched: sched_stat_runtime']  \nworkloads:  \n-name: hackbench  \n-name: ebizzy workload_params:  \nchunks: 4  \n-name: rt-app workload_params:  \nconfig: browser-short.json  \n-name: rt-app workload_params:  \nconfig: mp3-short.json  \n-name: cyclictest  \n-name: stream workload_params:  \nthreads: 4  \n● written in YAML  \n● global config settings for workloads  \n● lists workloads to execute in order  \n● Download a sample agenda at [http://people.linaro.org/](http://people.linaro.org/)~lisa. nguyen/agenda.yaml  \nLinaro’s use of WA  \n● Collect power measurements  \n○ Pre-instrumented boards  \n● Run set of benchmarks on various boards  \nLimitations  \n● One-to-one. One WA instance per board.  \n● Only supported in python 2.7  \n● Assumes that target IP is static  \n● Limited reporting capabilities  \n● SSH is still required for running WA on Linux  \nNext steps  \n● Investigate feasibility of using reports to declare PASS/FAIL  \n○ Every board has different thresholds for performance/power  \n○ Intel’s LKP handles this well  \n● Work with [kernelci.org](kernelci.org) to add another dimension to automated testing","cbCaiuxZf9NEl4FH","https://ap.wps.com/l/cbCaiuxZf9NEl4FH","pdf",1664201,"English","# Introduction\n## Setup example\n## Demo\n## WA Execution Flow\n## Linaro’s use of WA\n## Limitations\n## Next steps","[{\"question\":\"What platforms and programming language does the workload automation test harness support?\",\"answer\":\"The harness supports Android, Linux, and ChromeOS, and it is written in Python.\"},{\"question\":\"What are the primary setup requirements for running WA?\",\"answer\":\"A Ubuntu 14.04 LTS host with Python 2.7 and required packages installed is used, along with a Pandaboard target board. Networking is required, and SSH is needed when running WA on Linux targets.\"},{\"question\":\"What limitations affect WA execution and reporting?\",\"answer\":\"WA is limited to a one-to-one model (one WA instance per board), requires Python 2.7, assumes the target IP is static, offers limited reporting capabilities, and depends on SSH for Linux execution.\"}]","SFO15-506 - Capabilities of Workload Automation Test Harness - setup, execution flow, limitations | PDF",1789151705]