[{"data":1,"prerenderedAt":-1},["ShallowReactive",2],{"doc-detail-123572-en":3,"doc-seo-123572-105":30,"detail-sidebar-cat-0-en-105":92},{"code":4,"msg":5,"data":6},0,"success",{"doc_id":7,"user_id":8,"nickname":9,"user_avatar":10,"doc_module":4,"category_id":11,"category_name":12,"doc_title":13,"doc_description":14,"doc_content":15,"file_id":16,"file_url":17,"file_type":18,"file_size":19,"view_count":20,"is_deleted":4,"is_public":20,"is_downloadable":20,"audit_status":20,"page_count":21,"language":22,"language_code":23,"site_id":24,"html_lang":23,"table_of_contents":25,"faqs":26,"seo_title":27,"seo_description":14,"update_tm":28,"read_time":29},123572,1099513958607,"Jiven","https://ap-avatar.wpscdn.com/avatar/100002390cf8733938c?x-image-process=image/resize,m_fixed,w_180,h_180&k=1778829742770036399",8,"Research & Report","You Are What You Click - Using Machine Learning to Model Trace Data for Psychometric Measurement","Assessment trace data such as mouse movements and timing can reflect individual differences, but testing practice underuses them. This article proposes a 10-step development procedure to improve the success of trace-data modeling, from grounding in psychometric theory and building data-collection infrastructure to developmental validation, holdout validation, feature engineering, algorithm selection, hyperparameter tuning with internal cross-validation, and diagnostic checks for overfitting or underfitting. It also frames challenges from weak trait signals, arguing that valid models can support decision-making systems.","InternatIonal Journal of testIng 2022, Vol. 22, nos. 3–4, 243–263  \n[https://doi.org/10.1080/15305058.2022.2134394](https://doi.org/10.1080/15305058.2022.2134394)  \nYou are what you click: using machine learning to model trace data for psychometric measurement  \nRichard N. Landersa , Elena M. Auera , Gabriel Mersya,b, Sebastian Marina and Jason Blaikc  \naDepartment of Psychology, university of Minnesota, Minneapolis, Mn, usa; bDepartment of Computer science, university of Chicago, Il, usa; cCappfinity, sydney, australia  \nABSTRACT  \nAssessment trace data, such as mouse positions and their timing, offer interesting and provocative reflections of individual differences yet are currently underutilized by testing professionals. In this article, we present a 10-step procedure to maximize the probability that a trace data modeling project will be successful: 1) grounding the project in psychometric theory, 2) building technical infrastructure to collect trace data, 3) designing a useful developmental validation study, 4) using a holdout validation approach with collected data, 5) using exploratory analysis to conduct meaningful feature engineering, 6) identifying useful machine learning algorithms to predict a thoughtfully chosen criterion, 7) engineering a machine learning model with meaningful internal cross-validation and hyperparameter selection, 8) conducting model diagnostics to assess if the resulting model is overfitted, underfitted, or within acceptable tolerance, and 9) testing the success of the final model in meeting conceptual, technical, and psychometric goals. If deemed successful, trace data model predictions could then be engineered into decision-making systems. We present this framework within the broader view of psychometrics, exploring the challenges of developing psychometrically valid models using such complex data with much weaker trait signals than assessment developers have typically attempted to model.  \nKEYWORDS  \nMachine learning; trace data; data science; mousetrap; psychometric  \nCONTACT richard n. landers  [rlanders@umn.edu](rlanders@umn.edu)  Department of Psychology, university of Minnesota, Minneapolis, Mn, usa.  \nCopyright © 2022 the author(s) . Published with license by taylor & francis group, llC.  \nthis is an open access article distributed under the terms of the Creative Commons attribution-nonCommercialnoDerivatives license ([http://creativecommons.org/licenses/by-nc-nd/4.0/](http://creativecommons.org/licenses/by-nc-nd/4.0/)), which permits non-commercial re-use, distribution, and reproduction in any medium, provided the original work is properly cited, and is not altered, transformed, or built upon in any way.  \n244  R. N. LANDERS ET AL.  \nAs digital assessment technologies grow more complex, so do the trace data that they produce and the potential of those trace data to be repurposed for additional valid assessment. The term, trace data, sometimes called digital traces, digital footprints, digital exhaust or behavioral surplus, refers to usually-incidental behavioral metadata created and recorded in the wake of other digital activities. Although the science of repurposing such data is in early stages, it capitalizes on two specific technological advances. First, the devices that people typically use to complete remote digital assessments, such as smartphones with mobile broadband, now have such powerful data processing capabilities and high data transfer speeds that the additional burden of collecting, preprocessing, and streaming trace data back to assessment servers has become trivial throughout the developed world. Second, although the sheer volume and variety of such data would have even ten years ago been difficult to meaningfully process, recent advances in machine learning have made the development of predictive models using such data within reach of even modestly priced personal computers. Combining an ever-growing variety of potentially useful data with advanced analytic techniques","cbCainGqR1LCTAT1","https://ap.wps.com/l/cbCainGqR1LCTAT1","pdf",1236895,1,21,"English","en",105,"# Abstract & Motivation\n## Trace data as digital traces for measurement\n## Need for combined psychometrics and data science\n# 10-step framework for successful modeling\n## Psychometric grounding and data infrastructure\n## Validation strategy and feature engineering\n## Algorithm selection, model tuning, diagnostics\n## Final evaluation against conceptual, technical, and psychometric goals","[{\"question\":\"What types of data are considered “trace data” in this work?\",\"answer\":\"Trace data refers to behavioral metadata created during digital activities, such as mouse positions and timing recorded in the course of assessment tasks.\"},{\"question\":\"What is the core contribution of the article?\",\"answer\":\"It provides a 10-step procedure to increase the likelihood that a trace-data modeling project succeeds, linking technical modeling stages to psychometric requirements.\"},{\"question\":\"Why is it difficult to build trace-data models successfully?\",\"answer\":\"Researchers must balance complex measurement concepts (e.g., reliability and validity) with data-analytic skills, because lacking either perspective can lead to models that seem adequate in development but fail in real-world use.\"}]","You Are What You Click - Using Machine Learning to Model Trace Data for Psychometric Measurement | PDF",1785817411,53,{"code":4,"msg":31,"data":32},"ok",{"site_id":24,"language":23,"slug":33,"title":13,"keywords":34,"description":14,"schema_data":35,"social_meta":87,"head_meta":89,"extra_data":91,"updated_unix":28},"you-are-what-you-click-using-machine-learning-to-model-trace-data-for-psychometric-measurement","",{"@graph":36,"@context":86},[37,54,69],{"@type":38,"itemListElement":39},"BreadcrumbList",[40,44,48,51],{"item":41,"name":42,"@type":43,"position":20},"https://docshare.wps.com","Home","ListItem",{"item":45,"name":46,"@type":43,"position":47},"https://docshare.wps.com/document/","Document",2,{"item":49,"name":12,"@type":43,"position":50},"https://docshare.wps.com/document/research-report/",3,{"item":52,"name":13,"@type":43,"position":53},"https://docshare.wps.com/document/you-are-what-you-click-using-machine-learning-to-model-trace-data-for-psychometric-measurement/123572/",4,{"url":52,"name":13,"@type":55,"author":56,"headline":13,"publisher":58,"fileFormat":61,"inLanguage":23,"description":14,"dateModified":62,"datePublished":63,"encodingFormat":61,"isAccessibleForFree":64,"interactionStatistic":65},"DigitalDocument",{"name":9,"@type":57},"Person",{"url":41,"name":59,"@type":60},"DocShare","Organization","application/pdf","2026-08-05","2026-08-04",true,{"@type":66,"interactionType":67,"userInteractionCount":20},"InteractionCounter",{"@type":68},"ViewAction",{"@type":70,"mainEntity":71},"FAQPage",[72,78,82],{"name":73,"@type":74,"acceptedAnswer":75},"What types of data are considered “trace data” in this work?","Question",{"text":76,"@type":77},"Trace data refers to behavioral metadata created during digital activities, such as mouse positions and timing recorded in the course of assessment tasks.","Answer",{"name":79,"@type":74,"acceptedAnswer":80},"What is the core contribution of the article?",{"text":81,"@type":77},"It provides a 10-step procedure to increase the likelihood that a trace-data modeling project succeeds, linking technical modeling stages to psychometric requirements.",{"name":83,"@type":74,"acceptedAnswer":84},"Why is it difficult to build trace-data models successfully?",{"text":85,"@type":77},"Researchers must balance complex measurement concepts (e.g., reliability and validity) with data-analytic skills, because lacking either perspective can lead to models that seem adequate in development but fail in real-world use.","https://schema.org",{"og:url":52,"og:type":88,"og:title":13,"og:site_name":59,"og:description":14},"article",{"robots":90,"canonical":52},"index,follow",{"doc_id":7,"site_id":24},{"code":4,"msg":5,"data":93},[94,98,102,106,111,116,121,124,129,132,136],{"id":20,"doc_module":4,"doc_module_name":46,"category_name":95,"show_sort_weight":96,"slug":97},"Story & Novel",90,"story-novel",{"id":47,"doc_module":4,"doc_module_name":46,"category_name":99,"show_sort_weight":100,"slug":101},"Literature",80,"literature",{"id":53,"doc_module":4,"doc_module_name":46,"category_name":103,"show_sort_weight":104,"slug":105},"Exam",70,"exam",{"id":107,"doc_module":4,"doc_module_name":46,"category_name":108,"show_sort_weight":109,"slug":110},5,"Comic",60,"comic",{"id":112,"doc_module":4,"doc_module_name":46,"category_name":113,"show_sort_weight":114,"slug":115},6,"Technology",50,"technology",{"id":117,"doc_module":4,"doc_module_name":46,"category_name":118,"show_sort_weight":119,"slug":120},7,"Healthcare",40,"healthcare",{"id":11,"doc_module":4,"doc_module_name":46,"category_name":12,"show_sort_weight":122,"slug":123},30,"research-report",{"id":125,"doc_module":4,"doc_module_name":46,"category_name":126,"show_sort_weight":127,"slug":128},9,"Religion & Spirituality",20,"religion-spirituality",{"id":127,"doc_module":4,"doc_module_name":46,"category_name":130,"show_sort_weight":127,"slug":131},"World Cup","world-cup",{"id":133,"doc_module":4,"doc_module_name":46,"category_name":134,"show_sort_weight":133,"slug":135},10,"Lifestyle","lifestyle",{"id":137,"doc_module":4,"doc_module_name":46,"category_name":138,"show_sort_weight":107,"slug":139},19,"General","general"]