[{"data":1,"prerenderedAt":-1},["ShallowReactive",2],{"doc-detail-116981-en":3,"doc-seo-116981-105":30,"detail-sidebar-cat-0-en-105":91},{"code":4,"msg":5,"data":6},0,"success",{"doc_id":7,"user_id":8,"nickname":9,"user_avatar":10,"doc_module":4,"category_id":11,"category_name":12,"doc_title":13,"doc_description":14,"doc_content":15,"file_id":16,"file_url":17,"file_type":18,"file_size":19,"view_count":4,"is_deleted":4,"is_public":20,"is_downloadable":20,"audit_status":20,"page_count":21,"language":22,"language_code":23,"site_id":24,"html_lang":23,"table_of_contents":25,"faqs":26,"seo_title":27,"seo_description":14,"update_tm":28,"read_time":29},116981,8796095360427,"Lucas Martin","https://ap-avatar.wpscdn.com/davatar_994ba38a5ba835b3df7d355c54d3ed8d",8,"Research & Report","Ensuring Safety of Machine Learning Components Using Operational Design Domain","Urban Air Mobility relies increasingly on machine learning for autonomy functions, yet ensuring safety for aviation systems using ML components remains difficult. This work investigates verification and safety aspects of an exemplary camera-based object detector for detecting humans on the ground. It presents an Operational Design Domain (ODD) concept adapted in the context of machine learning assurance and applies runtime monitoring to check conformance during flight. Flight test results show that ODD monitoring can improve operational safety while also enhancing performance by reducing misdetections.","Ensuring Safety of Machine Learning Components Using Operational Design Domain  \nChristoph Torens∗ , Franz Jünger†, Sebastian Schirmer‡, Simon Schopferer § , Dmytro Zhukov¶ , Johann C. Dauer ‖,  \nGerman Aerospace Center (DLR), Institute of Flight Systems, Braunschweig, Germany  \nThe introduction of machine learning in the aviation domain is an ongoing process. This is also true for safety-critical domains, especially for the area of Urban Air Mobility. A significant growth in number of air taxis and an increasing level of autonomy is to be expected allowing for operating a large number of air taxis in complex urban environments. Due to the complexity of the tasks and the environment, key autonomy functions will be realized using machine learning, for example the camera-based detection of objects. However, the safety assurance for avionics systems using machine learning components is challenging. This work investigates safety and verification aspects of machine learning components. A camera-based detection of humans on the ground, [e.g. to](e.g. to) assess a potential landing area, serves as an example for an machine learning-based autonomy functio and was integrated into an Unmanned Aircraft. In the context of this exemplary machine learning component, the concept of Operational Design Domain as recently adapted European Aviation Safety Agency in the context of machine learning assurance is described along with other key concepts of machine learning assurance. Furthermore, runtime assurance is used to monitor conformance to the Operational Design Domain during flight. The presented flight test results indicate that monitoring the Operational Design Domain can support performance as well as the safety of the operation.  \nI. Introduction  \nWith recent advances in artificial intelligence (AI) and machine learning (ML) there is an increasing demand for the use of ML, even for safety-critical applications in the aviation domain. Current research is targeted towards the use of ML to reach high degrees of autonomy in the context of Urban Air Mobility (UAM), i.e. transportation services via air taxis in urban environments. However, a key research question is how ML-enabled autonomy can be safely applied in the context of UAM [1] . It is difficult to comply to rigorous safety requirements and the corresponding standards, as established in aviation for safety-critical systems and software. Furthermore, safety standards for ML applications are currently under development and give only first guidelines [2] . In this paper we use key concepts such as Operational Design Domain (ODD) introduced by these guidelines to derive an architecture that ensures proper operational conditions for an exemplary ML algorithm during flight by the use of runtime monitoring. This algorithm is a state-of-the-art object detector for detecting persons on images captured by a Unmanned Aircraft (UA)’s onboard camera. The components of the derived architecture filter inputs to the ML algorithm that are outside of its ODD based on navigation information and image metadata. Results indicate that using such an architecture to detect images outside of the ODD cannot safeguard the ML component. It improves the overall performance, i.e. reduces the number of misdetections, and may therefore contribute to the overall operational safety.  \nThe remainder of this paper is structured as follows: First, Section III derives components of the architecture based on existing safety and trustworthiness guidelines. Then, Section IV presents the setup for the flight test, followed by the presentation of the software setup for the flight test in Section V. Finally, in Section VI results of the flight test are shown.  \nII. Related work  \n∗Research Associate, Department Unmanned Aircraft, AIAA Senior Member.†Research Associate, Department Unmanned Aircraft  \n‡Research Associate, Department Unmanned Aircraft  \n§ Team Lead Safe Autonomy, Department Unmanned Aircraft ¶ Research Associate, Department U","cbCaiuBT06Oo7tRi","https://ap.wps.com/l/cbCaiuBT06Oo7tRi","pdf",695126,1,14,"English","en",105,"# Introduction\n## Related work\n### ML Safety Assurance\n### Operational Design Domain\n# Architecture and runtime assurance\n# Flight test setup\n## Software setup\n# Flight test results","[{\"question\":\"What is the document’s main focus regarding machine learning in aviation?\",\"answer\":\"It focuses on safety assurance and verification of machine learning components used in aviation, especially for urban air mobility scenarios.\"},{\"question\":\"How is Operational Design Domain (ODD) used in the proposed approach?\",\"answer\":\"ODD defines the operational conditions for the ML component, and the system uses runtime monitoring to ensure the component operates within those conditions during flight.\"},{\"question\":\"What role do the flight test results play in the conclusions?\",\"answer\":\"They indicate that monitoring conformance to the ODD during flight supports both performance and safety, for example by reducing misdetections.\"}]","Ensuring Safety of Machine Learning Components Using Operational Design Domain | PDF",1785672947,35,{"code":4,"msg":31,"data":32},"ok",{"site_id":24,"language":23,"slug":33,"title":13,"keywords":34,"description":14,"schema_data":35,"social_meta":86,"head_meta":88,"extra_data":90,"updated_unix":28},"ensuring-safety-of-machine-learning-components-using-operational-design-domain","",{"@graph":36,"@context":85},[37,54,68],{"@type":38,"itemListElement":39},"BreadcrumbList",[40,44,48,51],{"item":41,"name":42,"@type":43,"position":20},"https://docshare.wps.com","Home","ListItem",{"item":45,"name":46,"@type":43,"position":47},"https://docshare.wps.com/document/","Document",2,{"item":49,"name":12,"@type":43,"position":50},"https://docshare.wps.com/document/research-report/",3,{"item":52,"name":13,"@type":43,"position":53},"https://docshare.wps.com/document/ensuring-safety-of-machine-learning-components-using-operational-design-domain/116981/",4,{"url":52,"name":13,"@type":55,"author":56,"headline":13,"publisher":58,"fileFormat":61,"inLanguage":23,"description":14,"dateModified":62,"datePublished":62,"encodingFormat":61,"isAccessibleForFree":63,"interactionStatistic":64},"DigitalDocument",{"name":9,"@type":57},"Person",{"url":41,"name":59,"@type":60},"DocShare","Organization","application/pdf","2026-08-02",true,{"@type":65,"interactionType":66,"userInteractionCount":4},"InteractionCounter",{"@type":67},"ViewAction",{"@type":69,"mainEntity":70},"FAQPage",[71,77,81],{"name":72,"@type":73,"acceptedAnswer":74},"What is the document’s main focus regarding machine learning in aviation?","Question",{"text":75,"@type":76},"It focuses on safety assurance and verification of machine learning components used in aviation, especially for urban air mobility scenarios.","Answer",{"name":78,"@type":73,"acceptedAnswer":79},"How is Operational Design Domain (ODD) used in the proposed approach?",{"text":80,"@type":76},"ODD defines the operational conditions for the ML component, and the system uses runtime monitoring to ensure the component operates within those conditions during flight.",{"name":82,"@type":73,"acceptedAnswer":83},"What role do the flight test results play in the conclusions?",{"text":84,"@type":76},"They indicate that monitoring conformance to the ODD during flight supports both performance and safety, for example by reducing misdetections.","https://schema.org",{"og:url":52,"og:type":87,"og:title":13,"og:site_name":59,"og:description":14},"article",{"robots":89,"canonical":52},"index,follow",{"doc_id":7,"site_id":24},{"code":4,"msg":5,"data":92},[93,97,101,105,110,115,120,123,128,131,135],{"id":20,"doc_module":4,"doc_module_name":46,"category_name":94,"show_sort_weight":95,"slug":96},"Story & Novel",90,"story-novel",{"id":47,"doc_module":4,"doc_module_name":46,"category_name":98,"show_sort_weight":99,"slug":100},"Literature",80,"literature",{"id":53,"doc_module":4,"doc_module_name":46,"category_name":102,"show_sort_weight":103,"slug":104},"Exam",70,"exam",{"id":106,"doc_module":4,"doc_module_name":46,"category_name":107,"show_sort_weight":108,"slug":109},5,"Comic",60,"comic",{"id":111,"doc_module":4,"doc_module_name":46,"category_name":112,"show_sort_weight":113,"slug":114},6,"Technology",50,"technology",{"id":116,"doc_module":4,"doc_module_name":46,"category_name":117,"show_sort_weight":118,"slug":119},7,"Healthcare",40,"healthcare",{"id":11,"doc_module":4,"doc_module_name":46,"category_name":12,"show_sort_weight":121,"slug":122},30,"research-report",{"id":124,"doc_module":4,"doc_module_name":46,"category_name":125,"show_sort_weight":126,"slug":127},9,"Religion & Spirituality",20,"religion-spirituality",{"id":126,"doc_module":4,"doc_module_name":46,"category_name":129,"show_sort_weight":126,"slug":130},"World Cup","world-cup",{"id":132,"doc_module":4,"doc_module_name":46,"category_name":133,"show_sort_weight":132,"slug":134},10,"Lifestyle","lifestyle",{"id":136,"doc_module":4,"doc_module_name":46,"category_name":137,"show_sort_weight":106,"slug":138},19,"General","general"]