[{"data":1,"prerenderedAt":-1},["ShallowReactive",2],{"doc-detail-128477-en":3,"doc-seo-128477-105":31,"detail-sidebar-cat-0-en-105":92},{"code":4,"msg":5,"data":6},0,"success",{"doc_id":7,"user_id":8,"nickname":9,"user_avatar":10,"doc_module":4,"category_id":11,"category_name":12,"doc_title":13,"doc_description":14,"doc_content":15,"file_id":16,"file_url":17,"file_type":18,"file_size":19,"view_count":20,"is_deleted":4,"is_public":21,"is_downloadable":21,"audit_status":21,"page_count":22,"language":23,"language_code":24,"site_id":25,"html_lang":24,"table_of_contents":26,"faqs":27,"seo_title":28,"seo_description":14,"update_tm":29,"read_time":30},128477,13056712833777,"Logic","https://ap-avatar.wpscdn.com/davatar_29158cc5080c5b710cf443261637dec0",8,"Research & Report","Computational Notebooks as Co-Design Tools - Engaging Young Adults Living with Diabetes, Family Carers, and Clinicians with Machine Learning Models","Engaging end user groups with machine learning models can align predictive system design with people’s needs and expectations. This co-design study examines benefits and challenges of using computational notebooks to support ML model development with young adults, family carers, and clinicians. An example diabetes risk prediction model was used in codesign workshops and retrospective interviews. Participants valued interactive data visualisations for multidisciplinary learning, anticipating benefits and harms, and creating fictional feature-importance plots, while reporting difficulties including code execution and managing information and power imbalances.","Ayobi, A. , Hughes, J. , Duckworth, C. J. , Dylag, J. J. , James, S. , Marshall, P. , Guy, M. J. , Kumaran, A. , Chapman, A. , Boniface, M. , & O'Kane, A. A. (2023) . Computational Notebooks as Co-Design Tools: Engaging Young Adults Living with Diabetes, Family Carers, and Clinicians with Machine Learning Models. In CHI 2023-Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems: Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems Article 300 (Conference on Human  \nFactors in Computing Systems-Proceedings) . Association for Computing Machinery. [https://doi.org/10.1145/3544548.3581424](https://doi.org/10.1145/3544548.3581424)[ ](https://doi.org/10.1145/3544548.3581424)Peer reviewed version  \nLink to published version (if available):  \n10.1145/3544548.3581424  \nLink to publication record on the Bristol Research Portal  \nPDF-document  \nThis is the accepted author manuscript (AAM) . The final published version (version of record) is available online via ACM at [https://doi.org/10.1145/3544548.3581424.Please](https://doi.org/10.1145/3544548.3581424.Please) refer to any applicable terms of use of the publisher.  \nUniversity of Bristol – Bristol Research Portal  \nGeneral rights  \nThis document is made available in accordance with publisher policies. Please cite only the published version using the reference above. Full terms of use are available: [http://www.bristol.ac.uk/red/research-policy/pure/user-guides/brp-terms/](http://www.bristol.ac.uk/red/research-policy/pure/user-guides/brp-terms/)  \nComputational Notebooks as Co-Design Tools: Engaging Young Adults Living with Diabetes, Family Carers, and Clinicians with Machine Learning Models  \nAmid Ayobi  \nUniversity College London, London, United Kingdom  \nJacob Hughes  \nUniversity of Bristol, Bristol, United Kingdom  \nChristopher J Duckworth  \nUniversity of Southampton, Southampton, United Kingdom  \nJakubJ Dylag  \nUniversity of Southampton, Southampton, United Kingdom  \nSam James  \nUniversity of Bristol, Bristol, United Kingdom  \nPaul Marshall  \nUniversity of Bristol, Bristol, United Kingdom  \nMatthew Guy  \nUniversity Hospital Southampton, Southampton, United Kingdom  \nAnitha Kumaran  \nUniversity Hospital Southampton, Southampton, United Kingdom  \nAdriane Chapman  \nUniversity of Southampton, Southampton, United Kingdom  \nMichael Boniface  \nUniversity of Southampton, Southampton, United Kingdom  \nAisling Ann O'Kane  \nUniversity of Bristol, Bristol, United Kingdom  \n\"© Ayobi et al. 2023. This is the author's version of the work. It is posted here for your personal use. Not for redistribution. The definitive version is being published in: Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems (CHI ’23), April 23–28, 2023, Hamburg, Germany. ACM, New York, NY, USA, 20 pages. [https://doi.org/10.1145/3544548.3581424](https://doi.org/10.1145/3544548.3581424)  \nEngaging end user groups with machine learning (ML) models can help align the design of predictive systems with people’s needs and expectations. We present a co-design study investigating the benefits and challenges of using computational notebooks to inform ML models with end user groups. We used a computational notebook to engage young adults, carers, and clinicians with an example ML model that predicted health risk in diabetes care. Through codesign workshops and retrospective interviews, we found that participants particularly valued using the interactive data visualisations of the computational notebook to scaffold multidisciplinary learning, anticipate benefits and harms of the example ML model, and create fictional feature importance plots to highlight care needs. Participants also reported challenges, from running code cells to managing information asymmetries and power imbalances. We discuss the potential of leveraging computational notebooks as interactive co-design tools to meet end user needs early in ML model lifecycles.  \nCCS CONCEPTS • Human-centered ","cbCaiab65PEmyNhV","https://ap.wps.com/l/cbCaiab65PEmyNhV","pdf",2930250,2,1,28,"English","en",105,"# Introduction\n## Human-centred and participatory approaches to AI design\n## Computational notebooks for multidisciplinary collaboration\n# Co-design study (workshops and interviews)\n## Example ML model for diabetes risk prediction\n## Valued notebook capabilities\n## Reported challenges","[{\"question\":\"What is the purpose of using computational notebooks in this study?\",\"answer\":\"The study investigates how computational notebooks can support co-design by engaging young adults, carers, and clinicians with machine learning models.\"},{\"question\":\"How did participants interact with the example diabetes ML model?\",\"answer\":\"They participated in codesign workshops and retrospective interviews using a computational notebook that included interactive data visualisations for an ML model predicting health risk in diabetes care.\"},{\"question\":\"What challenges did participants report when using the notebooks?\",\"answer\":\"Participants reported challenges such as running code cells and dealing with information asymmetries and power imbalances.\"}]","Computational Notebooks as Co-Design Tools - Engaging Young Adults Living with Diabetes, Family Carers, and Clinicians with Machine Learning Models | PDF",1786001271,71,{"code":4,"msg":32,"data":33},"ok",{"site_id":25,"language":24,"slug":34,"title":13,"keywords":35,"description":14,"schema_data":36,"social_meta":87,"head_meta":89,"extra_data":91,"updated_unix":29},"computational-notebooks-as-co-design-tools-engaging-young-adults-living-with-diabetes-family-carers-and-clinicians-with-machine-learning-models","",{"@graph":37,"@context":86},[38,54,69],{"@type":39,"itemListElement":40},"BreadcrumbList",[41,45,48,51],{"item":42,"name":43,"@type":44,"position":21},"https://docshare.wps.com","Home","ListItem",{"item":46,"name":47,"@type":44,"position":20},"https://docshare.wps.com/document/","Document",{"item":49,"name":12,"@type":44,"position":50},"https://docshare.wps.com/document/research-report/",3,{"item":52,"name":13,"@type":44,"position":53},"https://docshare.wps.com/document/computational-notebooks-as-co-design-tools-engaging-young-adults-living-with-diabetes-family-carers-and-clinicians-with-machine-learning-models/128477/",4,{"url":52,"name":13,"@type":55,"author":56,"headline":13,"publisher":58,"fileFormat":61,"inLanguage":24,"description":14,"dateModified":62,"datePublished":63,"encodingFormat":61,"isAccessibleForFree":64,"interactionStatistic":65},"DigitalDocument",{"name":9,"@type":57},"Person",{"url":42,"name":59,"@type":60},"DocShare","Organization","application/pdf","2026-08-24","2026-08-06",true,{"@type":66,"interactionType":67,"userInteractionCount":20},"InteractionCounter",{"@type":68},"ViewAction",{"@type":70,"mainEntity":71},"FAQPage",[72,78,82],{"name":73,"@type":74,"acceptedAnswer":75},"What is the purpose of using computational notebooks in this study?","Question",{"text":76,"@type":77},"The study investigates how computational notebooks can support co-design by engaging young adults, carers, and clinicians with machine learning models.","Answer",{"name":79,"@type":74,"acceptedAnswer":80},"How did participants interact with the example diabetes ML model?",{"text":81,"@type":77},"They participated in codesign workshops and retrospective interviews using a computational notebook that included interactive data visualisations for an ML model predicting health risk in diabetes care.",{"name":83,"@type":74,"acceptedAnswer":84},"What challenges did participants report when using the notebooks?",{"text":85,"@type":77},"Participants reported challenges such as running code cells and dealing with information asymmetries and power imbalances.","https://schema.org",{"og:url":52,"og:type":88,"og:title":13,"og:site_name":59,"og:description":14},"article",{"robots":90,"canonical":52},"index,follow",{"doc_id":7,"site_id":25},{"code":4,"msg":5,"data":93},[94,98,102,106,111,116,121,124,129,132,136],{"id":21,"doc_module":4,"doc_module_name":47,"category_name":95,"show_sort_weight":96,"slug":97},"Story & Novel",90,"story-novel",{"id":20,"doc_module":4,"doc_module_name":47,"category_name":99,"show_sort_weight":100,"slug":101},"Literature",80,"literature",{"id":53,"doc_module":4,"doc_module_name":47,"category_name":103,"show_sort_weight":104,"slug":105},"Exam",70,"exam",{"id":107,"doc_module":4,"doc_module_name":47,"category_name":108,"show_sort_weight":109,"slug":110},5,"Comic",60,"comic",{"id":112,"doc_module":4,"doc_module_name":47,"category_name":113,"show_sort_weight":114,"slug":115},6,"Technology",50,"technology",{"id":117,"doc_module":4,"doc_module_name":47,"category_name":118,"show_sort_weight":119,"slug":120},7,"Healthcare",40,"healthcare",{"id":11,"doc_module":4,"doc_module_name":47,"category_name":12,"show_sort_weight":122,"slug":123},30,"research-report",{"id":125,"doc_module":4,"doc_module_name":47,"category_name":126,"show_sort_weight":127,"slug":128},9,"Religion & Spirituality",20,"religion-spirituality",{"id":127,"doc_module":4,"doc_module_name":47,"category_name":130,"show_sort_weight":127,"slug":131},"World Cup","world-cup",{"id":133,"doc_module":4,"doc_module_name":47,"category_name":134,"show_sort_weight":133,"slug":135},10,"Lifestyle","lifestyle",{"id":137,"doc_module":4,"doc_module_name":47,"category_name":138,"show_sort_weight":107,"slug":139},19,"General","general"]