[{"data":1,"prerenderedAt":-1},["ShallowReactive",2],{"doc-detail-126645-en":3,"doc-seo-126645-105":30,"detail-sidebar-cat-0-en-105":83},{"code":4,"msg":5,"data":6},0,"success",{"doc_id":7,"user_id":8,"nickname":9,"user_avatar":10,"doc_module":4,"category_id":11,"category_name":12,"doc_title":13,"doc_description":14,"doc_content":15,"file_id":16,"file_url":17,"file_type":18,"file_size":19,"view_count":4,"is_deleted":4,"is_public":20,"is_downloadable":20,"audit_status":20,"page_count":21,"language":22,"language_code":23,"site_id":24,"html_lang":23,"table_of_contents":25,"faqs":26,"seo_title":27,"seo_description":14,"update_tm":28,"read_time":29},126645,549768064778,"Finn","https://ap-avatar.wpscdn.com/davatar_6f874abed73319feea01a86fa6f0fab8",8,"Research & Report","How Much Are Machine Assistants Worth? Willingness to Pay for Machine Learning-Based Software Testing","Machine learning (ML) technologies drive many products and services, yet pricing remains uncertain. In software testing, ML-enabled tools can generate and support complex, human-like test case work, but little is known about users’ willingness to pay and which tool attributes matter most. A choice-based conjoint analysis with 119 participants in Germany examines desired features and payment preferences. Results indicate that high accuracy is most important, followed by ease of use and integration into existing environments.","Association for Information Systems  \nAIS Electronic Library (AISeL)  \n\n| ECIS 2023 Research Papers | ECIS 2023 Proceedings |\n| --- | --- |\n| 5-11-2023\u003Cbr>How Much Are Machine Assistants Worth? Willingness to Pay for Machine Learning-Based Software Testing\u003Cbr>Maren F. Mehler\u003Cbr>Technical University of Darmstadt, [maren.mehler@tu-darmstadt.de](maren.mehler@tu-darmstadt.de)\u003Cbr>Oliver A. Vetter\u003Cbr>Technical University of Darmstadt, [oliver.vetter@tu-darmstadt.de](oliver.vetter@tu-darmstadt.de)\u003Cbr>Follow this and additional works at: [https://aisel.aisnet.org/ecis2023_rp](https://aisel.aisnet.org/ecis2023_rp) |  |\n\nRecommended Citation  \nMehler, Maren F. and Vetter, Oliver A., \"How Much Are Machine Assistants Worth? Willingness to Pay for Machine Learning-Based Software Testing\" (2023) . ECIS 2023 Research Papers. 355.  \n[https://aisel.aisnet.org/ecis2023_rp/355](https://aisel.aisnet.org/ecis2023_rp/355)  \nThis material is brought to you by the ECIS 2023 Proceedings at AIS Electronic Library (AISeL) . It has been accepted for inclusion in ECIS 2023 Research Papers by an authorized administrator of AIS Electronic Library (AISeL) . For more information, please [contact](contact elibrary@aisnet.org)[ elibrary@aisnet.org](contact elibrary@aisnet.org).  \nHOW MUCH ARE MACHINE ASSISTANTS WORTH? WILLINGNESS TO PAY FOR MACHINE LEARNING-BASED  \nSOFTWARE TESTING  \nResearch Paper  \nMaren F. Mehler, Technical University of Darmstadt, Germany, [mehler@is.tu-darmstadt.de](mehler@is.tu-darmstadt.de)[ ](mehler@is.tu-darmstadt.de)Oliver A. Vetter, Technical University of Darmstadt, Germany, [vetter@is.tu-darmstadt.de](vetter@is.tu-darmstadt.de)  \nAbstract  \nMachine Learning (ML) technologies have become the foundation of a plethora of products and services. While the economic potential of such ML-infused solutions has become irrefutable, there is still uncertainty onpricing. Currently, software testing is one area to benefit from ML services assisting in the creation of test cases; a task both complex and demanding human-like outputs. Yet, little is known on the willingness to pay of users, inhibiting the suppliers ’ incentive to develop suitable tools. To provide insights into desired features and willingness to pay for such ML-based tools, we perform a choicebased conjoint analysis with 119 participants in Germany. Our results show that a high level of accuracy is particularly important for users, followed by ease of use and integration into existing environments. Thus, we not only guide future developers on which attributes to prioritize but also which characteristics of ML-based services are relevant for future research.  \nKeywords: Software Testing, Machine Learning, Choice-based Conjoint Analysis, Willingness to Pay.  \n1 Introduction  \nAn enormous amount of novel machine learning (ML) services has recently gained traction in the market. However, pricing these services is notoriously difficult and how much users are willing to pay is uncertain, especially since it is not clear which attributes are important to the users of ML services. Various use cases of ML services exist that support users in their day-to-day tasks and support independent decision making (Peters, Pumplun and Buxmann, 2020; Berente et al., 2021; von Wedeland Hagist, 2022) . A so far rarely explored use case of a ML-infused service supporting decision making, which shows high potential, is the application of ML in the context of software testing. Software testing is an essential part of the software development process as it ensures the quality of the software (Zhao, Hu and Gong, 2021) . Due to the high share of human labor in form of experience and knowledge, software testing consumes a lot of time and hence leads to high costs (Enoiu, Tukseferi and Feldt, 2020; Guveyi, Aktas and Kalipsiz, 2020) . According to a survey among CIOs, 23% of the annual IT expenditure is spent yearly on software quality assurance. Although the costs decreased slightly in recent years (cf. 35% in ","cbCailEmxEMJ6CVR","https://ap.wps.com/l/cbCailEmxEMJ6CVR","pdf",511651,1,18,"English","en",105,"# Abstract\n# Introduction\n## ML services and pricing uncertainty\n## Role of ML in software testing\n## Costs, effort, and complexity in testing\n## Existing tools, market adoption, and provider incentives\n# Methodology\n## Choice-based conjoint analysis\n# Results\n## Accuracy, ease of use, and integration preferences\n# Implications for future research","[{\"question\":\"Which attributes do users prioritize when considering ML-based testing tools?\",\"answer\":\"Users place the highest importance on accuracy, followed by ease of use and integration into existing environments.\"}]","How Much Are Machine Assistants Worth? Willingness to Pay for Machine Learning-Based Software Testing | PDF",1785934016,45,{"code":4,"msg":31,"data":32},"ok",{"site_id":24,"language":23,"slug":33,"title":13,"keywords":34,"description":14,"schema_data":35,"social_meta":78,"head_meta":80,"extra_data":82,"updated_unix":28},"how-much-are-machine-assistants-worth-willingness-to-pay-for-machine-learning-based-software-testing","",{"@graph":36,"@context":77},[37,54,68],{"@type":38,"itemListElement":39},"BreadcrumbList",[40,44,48,51],{"item":41,"name":42,"@type":43,"position":20},"https://docshare.wps.com","Home","ListItem",{"item":45,"name":46,"@type":43,"position":47},"https://docshare.wps.com/document/","Document",2,{"item":49,"name":12,"@type":43,"position":50},"https://docshare.wps.com/document/research-report/",3,{"item":52,"name":13,"@type":43,"position":53},"https://docshare.wps.com/document/how-much-are-machine-assistants-worth-willingness-to-pay-for-machine-learning-based-software-testing/126645/",4,{"url":52,"name":13,"@type":55,"author":56,"headline":13,"publisher":58,"fileFormat":61,"inLanguage":23,"description":14,"dateModified":62,"datePublished":62,"encodingFormat":61,"isAccessibleForFree":63,"interactionStatistic":64},"DigitalDocument",{"name":9,"@type":57},"Person",{"url":41,"name":59,"@type":60},"DocShare","Organization","application/pdf","2026-08-05",true,{"@type":65,"interactionType":66,"userInteractionCount":4},"InteractionCounter",{"@type":67},"ViewAction",{"@type":69,"mainEntity":70},"FAQPage",[71],{"name":72,"@type":73,"acceptedAnswer":74},"Which attributes do users prioritize when considering ML-based testing tools?","Question",{"text":75,"@type":76},"Users place the highest importance on accuracy, followed by ease of use and integration into existing environments.","Answer","https://schema.org",{"og:url":52,"og:type":79,"og:title":13,"og:site_name":59,"og:description":14},"article",{"robots":81,"canonical":52},"index,follow",{"doc_id":7,"site_id":24},{"code":4,"msg":5,"data":84},[85,89,93,97,102,107,112,115,120,123,127],{"id":20,"doc_module":4,"doc_module_name":46,"category_name":86,"show_sort_weight":87,"slug":88},"Story & Novel",90,"story-novel",{"id":47,"doc_module":4,"doc_module_name":46,"category_name":90,"show_sort_weight":91,"slug":92},"Literature",80,"literature",{"id":53,"doc_module":4,"doc_module_name":46,"category_name":94,"show_sort_weight":95,"slug":96},"Exam",70,"exam",{"id":98,"doc_module":4,"doc_module_name":46,"category_name":99,"show_sort_weight":100,"slug":101},5,"Comic",60,"comic",{"id":103,"doc_module":4,"doc_module_name":46,"category_name":104,"show_sort_weight":105,"slug":106},6,"Technology",50,"technology",{"id":108,"doc_module":4,"doc_module_name":46,"category_name":109,"show_sort_weight":110,"slug":111},7,"Healthcare",40,"healthcare",{"id":11,"doc_module":4,"doc_module_name":46,"category_name":12,"show_sort_weight":113,"slug":114},30,"research-report",{"id":116,"doc_module":4,"doc_module_name":46,"category_name":117,"show_sort_weight":118,"slug":119},9,"Religion & Spirituality",20,"religion-spirituality",{"id":118,"doc_module":4,"doc_module_name":46,"category_name":121,"show_sort_weight":118,"slug":122},"World Cup","world-cup",{"id":124,"doc_module":4,"doc_module_name":46,"category_name":125,"show_sort_weight":124,"slug":126},10,"Lifestyle","lifestyle",{"id":128,"doc_module":4,"doc_module_name":46,"category_name":129,"show_sort_weight":98,"slug":130},19,"General","general"]