[{"data":1,"prerenderedAt":-1},["ShallowReactive",2],{"doc-detail-119758-en":3,"doc-seo-119758-105":30,"detail-sidebar-cat-0-en-105":91},{"code":4,"msg":5,"data":6},0,"success",{"doc_id":7,"user_id":8,"nickname":9,"user_avatar":10,"doc_module":4,"category_id":11,"category_name":12,"doc_title":13,"doc_description":14,"doc_content":15,"file_id":16,"file_url":17,"file_type":18,"file_size":19,"view_count":4,"is_deleted":4,"is_public":20,"is_downloadable":20,"audit_status":20,"page_count":21,"language":22,"language_code":23,"site_id":24,"html_lang":23,"table_of_contents":25,"faqs":26,"seo_title":27,"seo_description":14,"update_tm":28,"read_time":29},119758,549758146520,"Patrick","https://ap-avatar.wpscdn.com/avatar/80002397d8c0411e94?_k=1775819394049821470",8,"Research & Report","On Using Information Retrieval to Recommend Machine Learning Good Practices for Software Engineers","Machine learning (ML) is widely applied across disciplines, yet missing good ML practices can degrade performance and produce unexpected system behavior. While established documentation and literature exist, many software engineers and non-ML experts rely on gray sources such as blogs and Q&A platforms, where relevant guidance is hard to distill. To address this, the work introduces Idaka, a recommender system that selects ML practices according to user context. Idaka implements both information retrieval (using BM25) and large language model generation (using Alpaca), enabling comparative evaluation of retrieval approaches for ML best practices.","On Using Information Retrieval to Recommend Machine Learning Good Practices for Software Engineers  \narXiv :2308 . 12095v2 [ cs . SE] 25 Aug 2023  \nLaura Cabra-Acela  \nUniversidad de Los Andes Bogotá, Colombia [lh.cabra@uniandes.edu.co](lh.cabra@uniandes.edu.co)  \nAnamaria Mojica-Hanke  \nUniversity of Passau Passau, Germany Universidad de los Andes Bogotá, Colombia [ai.mojica10@uniandes.edu.co](ai.mojica10@uniandes.edu.co)  \nMario Linares-Vásquez  \nUniversidad de Los Andes Bogotá, Colombia [m.linaresv@uniandes.edu.co](m.linaresv@uniandes.edu.co)  \nSteffen Herbold  \nUniversity of Passau Passau, Germany [steffen.herbold@uni-passau.de](steffen.herbold@uni-passau.de)  \nABSTRACT  \nMachine learning (ML) is nowadays widely used for different purposes and in several disciplines. From self-driving cars to automated medical diagnosis, machine learning models extensively support users’ daily activities, and software engineering tasks are no exception. Not embracing good ML practices may lead to pitfalls that hinder the performance of an ML system and potentially lead to unexpected results. Despite the existence of documentation and literature about ML best practices, many non-ML experts turn towards gray literature like blogs and Q&A systems when looking for help and guidance when implementing ML systems. To better aid users in distilling relevant knowledge from such sources, we propose a recommender system that recommends ML practices based on the user’s context. As a first step in creating a recommender system for machine learning practices, we implemented Idaka. A tool that provides two different approaches for retrieving/generating ML best practices: i) an information retrieval (IR) engine and ii) a large language model. The IR-engine uses BM25 as the algorithm for retrieving the practices, and a large language model, in our case Alpaca. The platform has been designed to allow comparative studies of best practices retrieval tools. Idaka is publicly available at GitHub: [https://bit.ly/idaka.](https://bit.ly/idaka. Video:)[ Video](https://bit.ly/idaka. Video:)[:](https://bit.ly/idaka. Video:) [https://youtu.be/cEb-AhIPxnM](https://youtu.be/cEb-AhIPxnM).  \nCCS CONCEPTS  \n• Computing methodologies → Machine learning; • Information systems → Information retrieval; • Software and its engineering → Software creation and management.  \nPermission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions [from permissions@acm.org](from permissions@acm.org).  \nESEC/FSE 2023, 11-17 November, 2023, San Francisco, USA © 2023 Association for Computing Machinery.  \nACM ISBN 978-x-xxxx-xxxx-x/YY/MM. . . $15.00 [https://doi.org/10.1145/nnnnnnn.nnnnnnn](https://doi.org/10.1145/nnnnnnn.nnnnnnn)  \nKEYWORDS  \nMachine learning, Good practices, Information retrieval, Large language models  \nACM Reference Format:  \nLaura Cabra-Acela, Anamaria Mojica-Hanke, Mario Linares-Vásquez, and Steffen Herbold. 2023. On Using Information Retrieval to Recommend Machine Learning Good Practices for Software Engineers. In Proceedings of The 31st ACM Joint European Software Engineering Conference and Symposium on the Foundations of Software Engineering (ESEC/FSE 2023). ACM, New York, NY, USA, 5 pages. [https://doi.org/10.1145/nnnnnnn.nnnnnnn](https://doi.org/10.1145/nnnnnnn.nnnnnnn)  \n1 INTRODUCTION  \nNowadays, Machine Learning (ML) is used for various applications, including vehicle automation [38, 41], medical applications [3, 32], adding to the list of daily live ML applications such as chatbots [1]","cbCaiuIMWNhd2BLs","https://ap.wps.com/l/cbCaiuIMWNhd2BLs","pdf",1294529,1,5,"English","en",105,"# Introduction\n# Proposed Approach\n## Search Engine for ML Best Practices\n# Conclusion and Future Work","[{\"question\":\"What problem does the work address when recommending machine learning practices?\",\"answer\":\"It addresses how non-ML experts struggle to locate and distill relevant ML best practices from abundant sources, which can lead to poor adoption of sound practices. It proposes contextual recommendations to reduce this friction.\"},{\"question\":\"How does Idaka retrieve and generate ML best practices?\",\"answer\":\"Idaka provides two approaches: an information retrieval engine that uses BM25 to retrieve practices and a large language model (Alpaca) to generate or support recommendations.\"},{\"question\":\"What is the purpose of providing both IR and large language model approaches?\",\"answer\":\"The platform is designed to enable comparative studies and systematic evaluation of tools for retrieving or producing ML best practices along an ML pipeline.\"}]","On Using Information Retrieval to Recommend Machine Learning Good Practices for Software Engineers | PDF",1785726151,13,{"code":4,"msg":31,"data":32},"ok",{"site_id":24,"language":23,"slug":33,"title":13,"keywords":34,"description":14,"schema_data":35,"social_meta":86,"head_meta":88,"extra_data":90,"updated_unix":28},"on-using-information-retrieval-to-recommend-machine-learning-good-practices-for-software-engineers","",{"@graph":36,"@context":85},[37,54,68],{"@type":38,"itemListElement":39},"BreadcrumbList",[40,44,48,51],{"item":41,"name":42,"@type":43,"position":20},"https://docshare.wps.com","Home","ListItem",{"item":45,"name":46,"@type":43,"position":47},"https://docshare.wps.com/document/","Document",2,{"item":49,"name":12,"@type":43,"position":50},"https://docshare.wps.com/document/research-report/",3,{"item":52,"name":13,"@type":43,"position":53},"https://docshare.wps.com/document/on-using-information-retrieval-to-recommend-machine-learning-good-practices-for-software-engineers/119758/",4,{"url":52,"name":13,"@type":55,"author":56,"headline":13,"publisher":58,"fileFormat":61,"inLanguage":23,"description":14,"dateModified":62,"datePublished":62,"encodingFormat":61,"isAccessibleForFree":63,"interactionStatistic":64},"DigitalDocument",{"name":9,"@type":57},"Person",{"url":41,"name":59,"@type":60},"DocShare","Organization","application/pdf","2026-08-03",true,{"@type":65,"interactionType":66,"userInteractionCount":4},"InteractionCounter",{"@type":67},"ViewAction",{"@type":69,"mainEntity":70},"FAQPage",[71,77,81],{"name":72,"@type":73,"acceptedAnswer":74},"What problem does the work address when recommending machine learning practices?","Question",{"text":75,"@type":76},"It addresses how non-ML experts struggle to locate and distill relevant ML best practices from abundant sources, which can lead to poor adoption of sound practices. It proposes contextual recommendations to reduce this friction.","Answer",{"name":78,"@type":73,"acceptedAnswer":79},"How does Idaka retrieve and generate ML best practices?",{"text":80,"@type":76},"Idaka provides two approaches: an information retrieval engine that uses BM25 to retrieve practices and a large language model (Alpaca) to generate or support recommendations.",{"name":82,"@type":73,"acceptedAnswer":83},"What is the purpose of providing both IR and large language model approaches?",{"text":84,"@type":76},"The platform is designed to enable comparative studies and systematic evaluation of tools for retrieving or producing ML best practices along an ML pipeline.","https://schema.org",{"og:url":52,"og:type":87,"og:title":13,"og:site_name":59,"og:description":14},"article",{"robots":89,"canonical":52},"index,follow",{"doc_id":7,"site_id":24},{"code":4,"msg":5,"data":92},[93,97,101,105,109,114,119,122,127,130,134],{"id":20,"doc_module":4,"doc_module_name":46,"category_name":94,"show_sort_weight":95,"slug":96},"Story & Novel",90,"story-novel",{"id":47,"doc_module":4,"doc_module_name":46,"category_name":98,"show_sort_weight":99,"slug":100},"Literature",80,"literature",{"id":53,"doc_module":4,"doc_module_name":46,"category_name":102,"show_sort_weight":103,"slug":104},"Exam",70,"exam",{"id":21,"doc_module":4,"doc_module_name":46,"category_name":106,"show_sort_weight":107,"slug":108},"Comic",60,"comic",{"id":110,"doc_module":4,"doc_module_name":46,"category_name":111,"show_sort_weight":112,"slug":113},6,"Technology",50,"technology",{"id":115,"doc_module":4,"doc_module_name":46,"category_name":116,"show_sort_weight":117,"slug":118},7,"Healthcare",40,"healthcare",{"id":11,"doc_module":4,"doc_module_name":46,"category_name":12,"show_sort_weight":120,"slug":121},30,"research-report",{"id":123,"doc_module":4,"doc_module_name":46,"category_name":124,"show_sort_weight":125,"slug":126},9,"Religion & Spirituality",20,"religion-spirituality",{"id":125,"doc_module":4,"doc_module_name":46,"category_name":128,"show_sort_weight":125,"slug":129},"World Cup","world-cup",{"id":131,"doc_module":4,"doc_module_name":46,"category_name":132,"show_sort_weight":131,"slug":133},10,"Lifestyle","lifestyle",{"id":135,"doc_module":4,"doc_module_name":46,"category_name":136,"show_sort_weight":21,"slug":137},19,"General","general"]