[{"data":1,"prerenderedAt":-1},["ShallowReactive",2],{"doc-detail-83065-en":3,"doc-seo-83065-105":29,"detail-sidebar-cat-0-en-105":90},{"code":4,"msg":5,"data":6},0,"success",{"doc_id":7,"user_id":8,"nickname":9,"user_avatar":10,"doc_module":4,"category_id":11,"category_name":12,"doc_title":13,"doc_description":14,"doc_content":15,"file_id":16,"file_url":17,"file_type":18,"file_size":19,"view_count":20,"is_deleted":4,"is_public":21,"is_downloadable":21,"audit_status":21,"page_count":11,"language":22,"language_code":23,"site_id":24,"html_lang":23,"table_of_contents":25,"faqs":26,"seo_title":13,"seo_description":14,"update_tm":27,"read_time":28},83065,1374391975076,"Riley","https://ap-avatar.wpscdn.com/avatar/14000253ca4ec9f6853?x-image-process=image/resize,m_fixed,w_180,h_180&k=1783305029341752051",8,"Research & Report","ROBOVAST Automated Scenario-Based Validation of Robots at Scale","Validation of robotic systems depends on the operating conditions under which tests are executed. Scenario selection and variation are often manual and hard to scale, reducing reproducibility and weakening validation conclusions. This work proposes a compositional scenario methodology that formalizes how variability is specified, instantiated, executed, and interpreted. It introduces ROBOVAST, with declarative campaign specifications, plugin-based scenario generation, and scalable containerized execution plus integrated result analysis, demonstrated on 5480 configurations over 100000 runs across five maps.","ROBOVAST: Automated Scenario-Based Validation of Robots at Scale  \nFrederik Pasch 1 Samuel Wiest2 Argentina Ortega2 Nico Hochgeschwender2  \narXiv :2607 .06248v 1 [ cs .RO] 7 Jul 2026  \nAbstract—Validation of robotic systems critically depends on the operating conditions under which they are assessed. Scenario selection and variation are often manual, experiencedriven, and difficult to scale, which harms reproducibility and weakens validation conclusions. We propose a scenario-based methodology that models scenarios compositionally and formalizes how these dimensions are varied, instantiated, executed, and interpreted. Building on this, we introduce ROBOVAST, a framework that realizes declarative campaign specifications, plugin-based scenario generation, and scalable containerized execution with integrated result analysis. We demonstrate the approach with a navigation dataset comprising 5480 scenario configurations and over 100000 execution runs across five indoor maps with varied paths, sensor noise, software parameters, and obstacle settings, totaling more than 1800 hours of simulated operation and 1873 km traveled. Twenty repetitions per configuration allow us to distinguish systematic failures from stochastic anomalies.  \nIndex Terms—simulation-based testing, mobile robotics, automated testing  \nI. INTRODUCTION  \nThe responsible deployment of robotic systems—particularly mobile robots—requires rigorous validation prior to field operation. Validation determines whether a system satisfies requirements such as safety or functional correctness, typically framed as a pass/fail decision [1], but the reliability of these decisions depends on the diversity and scale of tested conditions. In practice, validation is commonly carried out using scenario-based testing, in which robotic system behavior is observed under concrete operating conditions [2] . A scenario is a series of interactions between a System Under Test (SUT) and its environment, capturing configurations of environmental conditions, tasks, system parameters, and contextual factors under which system behavior is evaluated [3] . Empirical studies show that developers deliberately vary such conditions to uncover corner cases and assess safety and reliability, yet scenario selection is often manual, experience-driven, and difficult to reproduce [4] . Simulationbased validation has therefore become central to scenariobased testing [5], [6], enabling controlled, repeatable exploration of operating conditions that would otherwise be costly, impractical, or hazardous [7] . If scenario variation and the number of runs are limited, conclusions may appear valid locally but fail to generalize globally.  \n2 University of Bremen, Germany.{samuel .wiest, argentina .ortega, nico.hochgeschwender}@uni-bremen .de  \n1 Karlsruhe University of Applied Sciences, Germany. frederik.pasch@h-ka .de  \nThis work has partly been supported by the European Union’s Horizon 2020 project SOPRANO (Grant No. 101120990) .  \nFig. 1. The ROBOVAST approach explicitly models scenario variability and enables scalable scenario execution to improve test space exploration.  \nIn scenario testing, test coverage is defined as the percentage of executed scenarios out of the total number of scenarios [3], yet enumerating all possible scenarios is infeasible due to the combinatorial complexity of system configurationsand environmental conditions. Scenario specifications often represent only partial descriptions of operating conditions. This is reflected in two common challenges in testing: How can meaningful test coverage be defined when the total scenario space is effectively unbounded? and how much testing is sufficient to draw reliable conclusions? Addressing both requires systematic exploration of the test space.  \nHowever, existing approaches often treat scenarios as monolithic test cases, rather than as compositions of environmental structure, task specification, system configuration, and contextual factors that ch","cbCaiteYAbE0eWWq","https://ap.wps.com/l/cbCaiteYAbE0eWWq","pdf",2439439,2,1,"English","en",105,"# Introduction\n## Scenario-based testing challenges\n## Research question and contributions\n# Related Work","[{\"question\":\"Why is scenario variation important for robot validation?\",\"answer\":\"Validation reliability depends on diversity and scale of tested conditions. Limited variation can produce conclusions that look correct locally but do not generalize globally.\"},{\"question\":\"What core idea does the ROBOVAST methodology introduce?\",\"answer\":\"It models scenarios compositionally and formalizes how variability dimensions are specified, varied, instantiated, executed, and interpreted to support systematic exploration.\"},{\"question\":\"How does ROBOVAST generate and execute robot scenarios at scale?\",\"answer\":\"It uses declarative campaign specifications, plugin-based scenario generation, and scalable containerized execution with integrated result analysis.\"}]",1784184973,20,{"code":4,"msg":30,"data":31},"ok",{"site_id":24,"language":23,"slug":32,"title":13,"keywords":33,"description":14,"schema_data":34,"social_meta":85,"head_meta":87,"extra_data":89,"updated_unix":27},"robovast-automated-scenario-based-validation-of-robots-at-scale","",{"@graph":35,"@context":84},[36,52,67],{"@type":37,"itemListElement":38},"BreadcrumbList",[39,43,46,49],{"item":40,"name":41,"@type":42,"position":21},"https://docshare.wps.com","Home","ListItem",{"item":44,"name":45,"@type":42,"position":20},"https://docshare.wps.com/document/","Document",{"item":47,"name":12,"@type":42,"position":48},"https://docshare.wps.com/document/research-report/",3,{"item":50,"name":13,"@type":42,"position":51},"https://docshare.wps.com/document/robovast-automated-scenario-based-validation-of-robots-at-scale/83065/",4,{"url":50,"name":13,"@type":53,"author":54,"headline":13,"publisher":56,"fileFormat":59,"inLanguage":23,"description":14,"dateModified":60,"datePublished":61,"encodingFormat":59,"isAccessibleForFree":62,"interactionStatistic":63},"DigitalDocument",{"name":9,"@type":55},"Person",{"url":40,"name":57,"@type":58},"DocShare","Organization","application/pdf","2026-07-24","2026-07-16",true,{"@type":64,"interactionType":65,"userInteractionCount":20},"InteractionCounter",{"@type":66},"ViewAction",{"@type":68,"mainEntity":69},"FAQPage",[70,76,80],{"name":71,"@type":72,"acceptedAnswer":73},"Why is scenario variation important for robot validation?","Question",{"text":74,"@type":75},"Validation reliability depends on diversity and scale of tested conditions. Limited variation can produce conclusions that look correct locally but do not generalize globally.","Answer",{"name":77,"@type":72,"acceptedAnswer":78},"What core idea does the ROBOVAST methodology introduce?",{"text":79,"@type":75},"It models scenarios compositionally and formalizes how variability dimensions are specified, varied, instantiated, executed, and interpreted to support systematic exploration.",{"name":81,"@type":72,"acceptedAnswer":82},"How does ROBOVAST generate and execute robot scenarios at scale?",{"text":83,"@type":75},"It uses declarative campaign specifications, plugin-based scenario generation, and scalable containerized execution with integrated result analysis.","https://schema.org",{"og:url":50,"og:type":86,"og:title":13,"og:site_name":57,"og:description":14},"article",{"robots":88,"canonical":50},"index,follow",{"doc_id":7,"site_id":24},{"code":4,"msg":5,"data":91},[92,96,100,104,109,114,119,122,126,129,133],{"id":21,"doc_module":4,"doc_module_name":45,"category_name":93,"show_sort_weight":94,"slug":95},"Story & Novel",90,"story-novel",{"id":20,"doc_module":4,"doc_module_name":45,"category_name":97,"show_sort_weight":98,"slug":99},"Literature",80,"literature",{"id":51,"doc_module":4,"doc_module_name":45,"category_name":101,"show_sort_weight":102,"slug":103},"Exam",70,"exam",{"id":105,"doc_module":4,"doc_module_name":45,"category_name":106,"show_sort_weight":107,"slug":108},5,"Comic",60,"comic",{"id":110,"doc_module":4,"doc_module_name":45,"category_name":111,"show_sort_weight":112,"slug":113},6,"Technology",50,"technology",{"id":115,"doc_module":4,"doc_module_name":45,"category_name":116,"show_sort_weight":117,"slug":118},7,"Healthcare",40,"healthcare",{"id":11,"doc_module":4,"doc_module_name":45,"category_name":12,"show_sort_weight":120,"slug":121},30,"research-report",{"id":123,"doc_module":4,"doc_module_name":45,"category_name":124,"show_sort_weight":28,"slug":125},9,"Religion & Spirituality","religion-spirituality",{"id":28,"doc_module":4,"doc_module_name":45,"category_name":127,"show_sort_weight":28,"slug":128},"World Cup","world-cup",{"id":130,"doc_module":4,"doc_module_name":45,"category_name":131,"show_sort_weight":130,"slug":132},10,"Lifestyle","lifestyle",{"id":134,"doc_module":4,"doc_module_name":45,"category_name":135,"show_sort_weight":105,"slug":136},19,"General","general"]