[{"data":1,"prerenderedAt":-1},["ShallowReactive",2],{"detail-sidebar-cat-0-en-105":3,"doc-seo-290592-105":59,"doc-detail-290592-en":131},{"code":4,"msg":5,"data":6},0,"success",[7,13,18,23,28,33,38,43,48,51,55],{"id":8,"doc_module":4,"doc_module_name":9,"category_name":10,"show_sort_weight":11,"slug":12},1,"Document","Story & Novel",90,"story-novel",{"id":14,"doc_module":4,"doc_module_name":9,"category_name":15,"show_sort_weight":16,"slug":17},2,"Literature",80,"literature",{"id":19,"doc_module":4,"doc_module_name":9,"category_name":20,"show_sort_weight":21,"slug":22},4,"Exam",70,"exam",{"id":24,"doc_module":4,"doc_module_name":9,"category_name":25,"show_sort_weight":26,"slug":27},5,"Comic",60,"comic",{"id":29,"doc_module":4,"doc_module_name":9,"category_name":30,"show_sort_weight":31,"slug":32},6,"Technology",50,"technology",{"id":34,"doc_module":4,"doc_module_name":9,"category_name":35,"show_sort_weight":36,"slug":37},7,"Healthcare",40,"healthcare",{"id":39,"doc_module":4,"doc_module_name":9,"category_name":40,"show_sort_weight":41,"slug":42},8,"Research & Report",30,"research-report",{"id":44,"doc_module":4,"doc_module_name":9,"category_name":45,"show_sort_weight":46,"slug":47},9,"Religion & Spirituality",20,"religion-spirituality",{"id":46,"doc_module":4,"doc_module_name":9,"category_name":49,"show_sort_weight":46,"slug":50},"World Cup","world-cup",{"id":52,"doc_module":4,"doc_module_name":9,"category_name":53,"show_sort_weight":52,"slug":54},10,"Lifestyle","lifestyle",{"id":56,"doc_module":4,"doc_module_name":9,"category_name":57,"show_sort_weight":24,"slug":58},19,"General","general",{"code":4,"msg":60,"data":61},"ok",{"site_id":62,"language":63,"slug":64,"title":65,"keywords":66,"description":67,"schema_data":68,"social_meta":124,"head_meta":126,"extra_data":128,"updated_unix":130},105,"en","playbook-data-analysis-tool-collecting-interaction-data-from-extremely-remote-users","Playbook Data Analysis Tool - Collecting Interaction Data from Extremely Remote Users","","Remote user testing for usability is constrained by inaccessible locations, limited bandwidth, and operational disruption risks, making traditional lab co-located evaluation inadequate for active missions. P-DAT (Playbook Data Analysis Tool) is a NASA Ames HCI evaluation system designed to unobtrusively capture interaction data from astronauts using Playbook. By enabling structured, bandwidth-efficient, mobile-friendly remote data collection, it supports in-depth analysis to improve intuitive planning and execution features and guide future crew autonomy tools.",{"@graph":69,"@context":123},[70,84,106],{"@type":71,"itemListElement":72},"BreadcrumbList",[73,77,79,82],{"item":74,"name":75,"@type":76,"position":8},"https://docshare.wps.com","Home","ListItem",{"item":78,"name":9,"@type":76,"position":14},"https://docshare.wps.com/document/",{"item":80,"name":30,"@type":76,"position":81},"https://docshare.wps.com/document/technology/",3,{"item":83,"name":65,"@type":76,"position":19},"https://docshare.wps.com/document/playbook-data-analysis-tool-collecting-interaction-data-from-extremely-remote-users/290592/",{"url":83,"name":65,"@type":85,"image":86,"author":91,"headline":65,"publisher":94,"fileFormat":97,"inLanguage":63,"description":67,"dateModified":98,"datePublished":99,"encodingFormat":97,"isAccessibleForFree":100,"interactionStatistic":101},"DigitalDocument",{"url":87,"@type":88,"width":89,"height":90},"https://docshare.wps.com/thumbnails/playbook-data-analysis-tool-collecting-interaction-data-from-extremely-remote-users/290592.png","ImageObject",300,407,{"name":92,"@type":93},"Adam","Person",{"url":74,"name":95,"@type":96},"DocShare","Organization","application/pdf","2026-10-19","2026-09-17",true,{"@type":102,"interactionType":103,"userInteractionCount":105},"InteractionCounter",{"@type":104},"ViewAction",12,{"@type":107,"mainEntity":108},"FAQPage",[109,115,119],{"name":110,"@type":111,"acceptedAnswer":112},"Why is in-person usability testing difficult for Playbook users?","Question",{"text":113,"@type":114},"Users may be in inaccessible remote locations like pressurized habitats, the International Space Station, or isolated underwater missions, where co-located lab testing is not feasible.","Answer",{"name":116,"@type":111,"acceptedAnswer":117},"What problem does P-DAT address for operational usability evaluation?",{"text":118,"@type":114},"It enables accurate remote collection of structured interaction data without relying on screen capture or video recording, which are impractical due to limited bandwidth, storage, and mission disruption constraints.",{"name":120,"@type":111,"acceptedAnswer":121},"How does P-DAT support the development of crew autonomy tools?",{"text":122,"@type":114},"Collected interaction data is returned for in-depth analysis, helping researchers understand usability in realistic mission contexts and informing design of more intuitive Playbook features.","https://schema.org",{"og:url":83,"og:type":125,"og:title":65,"og:site_name":95,"og:description":67},"article",{"robots":127,"canonical":83},"index,follow",{"doc_id":129,"site_id":62},290592,1790315904,{"code":4,"msg":5,"data":132},{"doc_id":129,"user_id":133,"nickname":92,"user_avatar":134,"doc_module":4,"category_id":29,"category_name":30,"doc_title":65,"doc_description":67,"doc_content":135,"file_id":136,"file_url":137,"file_type":138,"file_size":139,"view_count":105,"is_deleted":4,"is_public":8,"is_downloadable":8,"audit_status":8,"page_count":105,"language":140,"language_code":63,"site_id":62,"html_lang":63,"table_of_contents":141,"faqs":142,"seo_title":143,"seo_description":67,"update_tm":144,"read_time":41},1374404737137,"https://ap-avatar.wpscdn.com/davatar_155a257f0dc6eb9ab79c44ca47cae57d","Playbook Data Analysis Tool: Collecting Interaction Data from Extremely Remote Users  \nBob Kanefsky1* , Jimin Zheng1 , Ivonne Deliz2 , Jessica J. Marquez3 , and Steven Hillenius3  \n1 San José State University Research Foundation  \n2 ASRC Research & Technology Solutions  \n3 NASA Ames Research Center, Moffett Field, CA  \n{bob.kanefsky, jimin.zheng, ivy.deliz, jessica.j.marquez, [steven.r.hillenius}@nasa.gov](steven.r.hillenius}@nasa.gov)  \n[Abstract.](Abstract. Typically)[ Typically](Abstract. Typically), user tests for software tools are conducted in person . At NASA, the users may be located at the bottom of the ocean in a pressurized habitat, above the atmosphere in the International Space Station, or in an isolated capsule on a simulated asteroid mission . The Playbook Data Analysis Tool (P-DAT) is a human-computer interaction (HCI) evaluation tool that the NASA Ames HCI Group has developed to record user interactions with Playbook, the group’s existing planning-and-execution software application .  \nOnce the remotely collected user interaction data makes its way back to Earth, researchers can use P-DAT for in-depth analysis . Since a critical component of the Playbook project is to understand how to develop more intuitive software tools for astronauts to plan in space, P-DAT helps guide us in the development of additional easy-to-use features for Playbook, informing the design of future crew autonomy tools .  \nKeywords:  \nusability · human-computer interaction · planning and scheduling · software  \n1. Introduction  \nWhen developing products, it is common for user researchers to iteratively test them using user-research techniques dictated by their evaluation needs and accessibility of target users . Our team, the Human-Computer Interaction Group at NASA Ames Research Center, follows a similar process of user-centered design but has adapted these techniques to work with our unique users and constraints . Since we are a user-focused software development team, one of our core goals when building features and products is to ensure that they are easy to use and able to assist users in the work they need to accomplish. User testing is a standard evaluation technique that we use to iteratively improve our products . Ideally, we would sit side by side with users to evaluate usability. This is adequate for initial evaluations in a lab or where the users’work takes  \nplace in an accessible environment, such as an office desk or ground-based mission control facility. But for users in remote, inaccessible locations, this is not an option . In the past, we balanced co-located, lab-based usability tests with product use in operational missions where feedback is only received through indirect comments, post-mission debriefs, or surveys. Gathering detailed, operational, in-use usability data from our remote users – as is typical during in-person user tests – has not been possible. As our products moved to mobile devices and became primarily used for remote mission operations, this became a growing blind spot in terms of accurate usability evaluation .  \nOperational usability data is critical, as it provides the most realistic product usage information in the context of the operational pressures of a mission; many of the features and tools that we develop have drastically different use patterns when deployed in the environment of an active mission . For example, a software feature that may indicate no major usability issues in a lab setting may have significant usability problems in an operational environment. Notably, these users may be extremely inaccessible, onboard a spacecraft such as the International Space Station (ISS) or in a remote isolated habitat such as the NASA Extreme Environment Mission Operations (NEEMO) mission where several astronauts and engineers live underwater for weeks at a time . Bandwidth is also a major concern; network resources and disk space are limited for spacecraft or remote mission operations, so using typica","cbCaiaZEYe58KTTr","https://ap.wps.com/l/cbCaiaZEYe58KTTr","pdf",629649,"English","# Introduction\n## Playbook Data Analysis Tool (P-DAT)\n# Background\n## Playbook’s Role in Future Crew Autonomy","[{\"question\":\"Why is in-person usability testing difficult for Playbook users?\",\"answer\":\"Users may be in inaccessible remote locations like pressurized habitats, the International Space Station, or isolated underwater missions, where co-located lab testing is not feasible.\"},{\"question\":\"What problem does P-DAT address for operational usability evaluation?\",\"answer\":\"It enables accurate remote collection of structured interaction data without relying on screen capture or video recording, which are impractical due to limited bandwidth, storage, and mission disruption constraints.\"},{\"question\":\"How does P-DAT support the development of crew autonomy tools?\",\"answer\":\"Collected interaction data is returned for in-depth analysis, helping researchers understand usability in realistic mission contexts and informing design of more intuitive Playbook features.\"}]","Playbook Data Analysis Tool - Collecting Interaction Data from Extremely Remote Users | PDF",1789642143]