[{"data":1,"prerenderedAt":-1},["ShallowReactive",2],{"doc-detail-160152-en":3,"doc-seo-160152-105":30,"detail-sidebar-cat-0-en-105":91},{"code":4,"msg":5,"data":6},0,"success",{"doc_id":7,"user_id":8,"nickname":9,"user_avatar":10,"doc_module":4,"category_id":11,"category_name":12,"doc_title":13,"doc_description":14,"doc_content":15,"file_id":16,"file_url":17,"file_type":18,"file_size":19,"view_count":4,"is_deleted":4,"is_public":20,"is_downloadable":20,"audit_status":20,"page_count":21,"language":22,"language_code":23,"site_id":24,"html_lang":23,"table_of_contents":25,"faqs":26,"seo_title":27,"seo_description":14,"update_tm":28,"read_time":29},160152,1099523882182,"Alex Sinclair","https://ap-avatar.wpscdn.com/davatar_6f874abed73319feea01a86fa6f0fab8",8,"Research & Report","Tasks and Visualizations Used for Data Profiling - A Survey and Interview Study","High-quality data underpins decision making and depends on robust, organization-dependent processes that ensure data is fit for purpose. This paper presents a survey of 53 data analysts across industries, followed by in-depth interviews with 24 participants, focusing on computational and visual methods for characterizing data and evaluating data quality. The work contributes comprehensive task and visualization lists and addresses what effective profiling looks like, revealing diverse practices, visualization exemplars, and recommendations for formalizing processes through rulebooks.","[eprints@whiterose.ac.uk](eprints@whiterose.ac.uk)[ ](eprints@whiterose.ac.uk)[https://eprints.whiterose.ac.uk](https://eprints.whiterose.ac.uk)  \nUniversities of Leeds, Sheffield and York  \nDeposited via The University of Leeds.  \nWhite Rose Research Online URL for this paper:  \n[https://eprints.whiterose.ac.uk/id/eprint/197083/](https://eprints.whiterose.ac.uk/id/eprint/197083/)  \n[Version: Accepted Version](Version: Accepted Version)  \nArticle:  \nRuddle, RA, Cheshire, J and Fernstad, SJ (2024) Tasks and Visualizations Used for Data Profiling: A Survey and Interview Study. IEEE Transactions on Visualization and Computer  \nGraphics, 30 (7) . pp. 3400-3412. ISSN: 1077-2626  \n[https://doi.org/10.1109/TVCG.2023.3234337](https://doi.org/10.1109/TVCG.2023.3234337)  \n© 2023, IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses, in any current or future media, including reprinting/republishing this material for advertising or promotional purposes, creating new collective works, forresale or redistribution to servers or lists, or reuse of any copyrighted component of this work in other works.  \nReuse  \nItems deposited in White Rose Research Online are protected by copyright, with all rights reserved unless indicated otherwise. They may be downloaded and/or printed for private study, or other acts as permitted by national copyright laws. The publisher or other rights holders may allow further reproduction and re-use of the full text version. This is indicated by the licence information on the White Rose Research Online record for the item.  \nTakedown  \nIf you consider content in White Rose Research Online to be in breach of UK law, please notify us by  \nemailing [eprints@whiterose.ac.uk](eprints@whiterose.ac.uk) including the URL of the record and the reason for the withdrawal request.  \nTasks and Visualizations used for Data Profiling: A Survey and Interview Study  \nRoy A. Ruddle, James Cheshire, and Sara Johansson Fernstad  \nAbstract—The use of good-quality data to inform decision making is entirely dependent on robust processes to ensure it is fit for purpose. Such processes vary between organisations, and between those tasked with designing and following them. In this paper wereport on a survey of 53 data analysts from many industry sectors, 24 of whom also participated in in-depth interviews, about  \ncomputational and visual methods for characterizing data and investigating data quality. The paper makes contributions in two key  \nareas. The first is to data science fundamentals, because our lists of data profiling tasks and visualization techniques are more comprehensive than those published elsewhere. The second concerns the application question “what does good profiling look like to those who routinely perform it?”, which we answer by highlighting the diversity of profiling tasks, unusual practice and exemplars of visualization, and recommendations about formalizing processes and creating rulebooks.  \nIndex Terms—Data profiling, data quality, survey, interview.  \n~~ ~~ ✦ ~~ ~~  \n1 INTRODUCTION  \nGOOD-QUALITY data has become an essential part of  \ndecision making, and is entirely dependent on robust processes to ensure it is fit for purpose. Data analysts therefore spend huge amounts of time performing the exploratory analysis required to characterize data (e.g., distributions) and assess its quality (e.g., missing values), which are known collectively as “data profiling” [1], [2], before it is used in detailed analysis and decision making.  \nThe motivating hypotheses for our research are twofold. First, most analysts perform profiling in an ad-hoc manner, following an undocumented process that makes data profiling more an art than a science that adopts a rigorous and reproducible method. Second, visualization techniques are underused in profiling, perhaps due to a lack of formal education/training in visualization and knowledge of how to apply visualization for complex/large-scale data.","cbCaitWnPHnSIV8A","https://ap.wps.com/l/cbCaitWnPHnSIV8A","pdf",3123160,1,42,"English","en",105,"# Introduction\n## Related Work","[{\"question\":\"What is the focus of the survey in the paper?\",\"answer\":\"The survey examines the computational and visual methods data analysts use to characterize data and investigate data quality.\"},{\"question\":\"How many participants took part in the survey and interviews?\",\"answer\":\"The study surveys 53 data analysts, and 24 of them also participate in in-depth interviews.\"},{\"question\":\"What contributions does the paper make?\",\"answer\":\"It provides more comprehensive lists of data profiling tasks and visualization techniques than previously published work, and it explains what “good profiling” looks like to experienced practitioners through observed diversity and recommendations.\"}]","Tasks and Visualizations Used for Data Profiling - A Survey and Interview Study | PDF",1788051030,106,{"code":4,"msg":31,"data":32},"ok",{"site_id":24,"language":23,"slug":33,"title":13,"keywords":34,"description":14,"schema_data":35,"social_meta":86,"head_meta":88,"extra_data":90,"updated_unix":28},"tasks-and-visualizations-used-for-data-profiling-a-survey-and-interview-study","",{"@graph":36,"@context":85},[37,54,68],{"@type":38,"itemListElement":39},"BreadcrumbList",[40,44,48,51],{"item":41,"name":42,"@type":43,"position":20},"https://docshare.wps.com","Home","ListItem",{"item":45,"name":46,"@type":43,"position":47},"https://docshare.wps.com/document/","Document",2,{"item":49,"name":12,"@type":43,"position":50},"https://docshare.wps.com/document/research-report/",3,{"item":52,"name":13,"@type":43,"position":53},"https://docshare.wps.com/document/tasks-and-visualizations-used-for-data-profiling-a-survey-and-interview-study/160152/",4,{"url":52,"name":13,"@type":55,"author":56,"headline":13,"publisher":58,"fileFormat":61,"inLanguage":23,"description":14,"dateModified":62,"datePublished":62,"encodingFormat":61,"isAccessibleForFree":63,"interactionStatistic":64},"DigitalDocument",{"name":9,"@type":57},"Person",{"url":41,"name":59,"@type":60},"DocShare","Organization","application/pdf","2026-08-30",true,{"@type":65,"interactionType":66,"userInteractionCount":4},"InteractionCounter",{"@type":67},"ViewAction",{"@type":69,"mainEntity":70},"FAQPage",[71,77,81],{"name":72,"@type":73,"acceptedAnswer":74},"What is the focus of the survey in the paper?","Question",{"text":75,"@type":76},"The survey examines the computational and visual methods data analysts use to characterize data and investigate data quality.","Answer",{"name":78,"@type":73,"acceptedAnswer":79},"How many participants took part in the survey and interviews?",{"text":80,"@type":76},"The study surveys 53 data analysts, and 24 of them also participate in in-depth interviews.",{"name":82,"@type":73,"acceptedAnswer":83},"What contributions does the paper make?",{"text":84,"@type":76},"It provides more comprehensive lists of data profiling tasks and visualization techniques than previously published work, and it explains what “good profiling” looks like to experienced practitioners through observed diversity and recommendations.","https://schema.org",{"og:url":52,"og:type":87,"og:title":13,"og:site_name":59,"og:description":14},"article",{"robots":89,"canonical":52},"index,follow",{"doc_id":7,"site_id":24},{"code":4,"msg":5,"data":92},[93,97,101,105,110,115,120,123,128,131,135],{"id":20,"doc_module":4,"doc_module_name":46,"category_name":94,"show_sort_weight":95,"slug":96},"Story & Novel",90,"story-novel",{"id":47,"doc_module":4,"doc_module_name":46,"category_name":98,"show_sort_weight":99,"slug":100},"Literature",80,"literature",{"id":53,"doc_module":4,"doc_module_name":46,"category_name":102,"show_sort_weight":103,"slug":104},"Exam",70,"exam",{"id":106,"doc_module":4,"doc_module_name":46,"category_name":107,"show_sort_weight":108,"slug":109},5,"Comic",60,"comic",{"id":111,"doc_module":4,"doc_module_name":46,"category_name":112,"show_sort_weight":113,"slug":114},6,"Technology",50,"technology",{"id":116,"doc_module":4,"doc_module_name":46,"category_name":117,"show_sort_weight":118,"slug":119},7,"Healthcare",40,"healthcare",{"id":11,"doc_module":4,"doc_module_name":46,"category_name":12,"show_sort_weight":121,"slug":122},30,"research-report",{"id":124,"doc_module":4,"doc_module_name":46,"category_name":125,"show_sort_weight":126,"slug":127},9,"Religion & Spirituality",20,"religion-spirituality",{"id":126,"doc_module":4,"doc_module_name":46,"category_name":129,"show_sort_weight":126,"slug":130},"World Cup","world-cup",{"id":132,"doc_module":4,"doc_module_name":46,"category_name":133,"show_sort_weight":132,"slug":134},10,"Lifestyle","lifestyle",{"id":136,"doc_module":4,"doc_module_name":46,"category_name":137,"show_sort_weight":106,"slug":138},19,"General","general"]