[{"data":1,"prerenderedAt":-1},["ShallowReactive",2],{"doc-seo-293334-105":3,"detail-sidebar-cat-0-en-105":81,"doc-detail-293334-en":131},{"code":4,"msg":5,"data":6},0,"ok",{"site_id":7,"language":8,"slug":9,"title":10,"keywords":11,"description":12,"schema_data":13,"social_meta":74,"head_meta":76,"extra_data":78,"updated_unix":80},105,"en","psychogat-a-novel-psychological-measurement-paradigm-through-interactive-fiction-games-with-llm-agents","PsychoGAT - A Novel Psychological Measurement Paradigm through Interactive Fiction Games with LLM Agents","","Psychological measurement is vital for mental health, self-understanding, and personal growth, yet traditional approaches like self-report scales and clinician interviews often struggle with engagement and accessibility. Game-based and LLM-based tools improve interest or automate assessment but may trade off generalizability. PsychoGAT (Psychological Game AgenTs) offers generic gamification by using LLMs as both psychologists and game designers to personalize standardized scales. Psychometric and human evaluations show improved reliability, validity, coherence, interactivity, immersion, and satisfaction.",{"@graph":14,"@context":73},[15,34,56],{"@type":16,"itemListElement":17},"BreadcrumbList",[18,23,27,31],{"item":19,"name":20,"@type":21,"position":22},"https://docshare.wps.com","Home","ListItem",1,{"item":24,"name":25,"@type":21,"position":26},"https://docshare.wps.com/document/","Document",2,{"item":28,"name":29,"@type":21,"position":30},"https://docshare.wps.com/document/research-report/","Research & Report",3,{"item":32,"name":10,"@type":21,"position":33},"https://docshare.wps.com/document/psychogat-a-novel-psychological-measurement-paradigm-through-interactive-fiction-games-with-llm-agents/293334/",4,{"url":32,"name":10,"@type":35,"image":36,"author":41,"headline":10,"publisher":44,"fileFormat":47,"inLanguage":8,"description":12,"dateModified":48,"datePublished":49,"encodingFormat":47,"isAccessibleForFree":50,"interactionStatistic":51},"DigitalDocument",{"url":37,"@type":38,"width":39,"height":40},"https://docshare.wps.com/thumbnails/psychogat-a-novel-psychological-measurement-paradigm-through-interactive-fiction-games-with-llm-agents/293334.png","ImageObject",300,407,{"name":42,"@type":43},"Arica Lee","Person",{"url":19,"name":45,"@type":46},"DocShare","Organization","application/pdf","2026-10-26","2026-09-17",true,{"@type":52,"interactionType":53,"userInteractionCount":55},"InteractionCounter",{"@type":54},"ViewAction",16,{"@type":57,"mainEntity":58},"FAQPage",[59,65,69],{"name":60,"@type":61,"acceptedAnswer":62},"What problem does PsychoGAT aim to solve in psychological measurement?","Question",{"text":63,"@type":64},"It targets limited engagement and accessibility in traditional self-report and interview methods, and it addresses insufficient generalizability in existing game-based or LLM-based assessment tools.","Answer",{"name":66,"@type":61,"acceptedAnswer":67},"How does PsychoGAT generate interactive fiction for psychological assessment?",{"text":68,"@type":64},"PsychoGAT treats powerful LLMs as both psychologists and game designers, assigns them designated roles, and carefully manages their interactions to convert standardized scales into personalized interactive fiction games.",{"name":70,"@type":61,"acceptedAnswer":71},"What evidence supports PsychoGAT’s effectiveness?",{"text":72,"@type":64},"The document reports psychometric evaluation metrics such as reliability, convergent validity, and discriminant validity, along with human evaluations of content coherence, interactivity, interest, immersion, and satisfaction.","https://schema.org",{"og:url":32,"og:type":75,"og:title":10,"og:site_name":45,"og:description":12},"article",{"robots":77,"canonical":32},"index,follow",{"doc_id":79,"site_id":7},293334,1789662439,{"code":4,"msg":82,"data":83},"success",[84,88,92,96,101,106,111,115,120,123,127],{"id":22,"doc_module":4,"doc_module_name":25,"category_name":85,"show_sort_weight":86,"slug":87},"Story & Novel",90,"story-novel",{"id":26,"doc_module":4,"doc_module_name":25,"category_name":89,"show_sort_weight":90,"slug":91},"Literature",80,"literature",{"id":33,"doc_module":4,"doc_module_name":25,"category_name":93,"show_sort_weight":94,"slug":95},"Exam",70,"exam",{"id":97,"doc_module":4,"doc_module_name":25,"category_name":98,"show_sort_weight":99,"slug":100},5,"Comic",60,"comic",{"id":102,"doc_module":4,"doc_module_name":25,"category_name":103,"show_sort_weight":104,"slug":105},6,"Technology",50,"technology",{"id":107,"doc_module":4,"doc_module_name":25,"category_name":108,"show_sort_weight":109,"slug":110},7,"Healthcare",40,"healthcare",{"id":112,"doc_module":4,"doc_module_name":25,"category_name":29,"show_sort_weight":113,"slug":114},8,30,"research-report",{"id":116,"doc_module":4,"doc_module_name":25,"category_name":117,"show_sort_weight":118,"slug":119},9,"Religion & Spirituality",20,"religion-spirituality",{"id":118,"doc_module":4,"doc_module_name":25,"category_name":121,"show_sort_weight":118,"slug":122},"World Cup","world-cup",{"id":124,"doc_module":4,"doc_module_name":25,"category_name":125,"show_sort_weight":124,"slug":126},10,"Lifestyle","lifestyle",{"id":128,"doc_module":4,"doc_module_name":25,"category_name":129,"show_sort_weight":97,"slug":130},19,"General","general",{"code":4,"msg":82,"data":132},{"doc_id":79,"user_id":133,"nickname":42,"user_avatar":134,"doc_module":4,"category_id":112,"category_name":29,"doc_title":10,"doc_description":12,"doc_content":135,"file_id":136,"file_url":137,"file_type":138,"file_size":139,"view_count":55,"is_deleted":4,"is_public":22,"is_downloadable":22,"audit_status":22,"page_count":140,"language":141,"language_code":8,"site_id":7,"html_lang":8,"table_of_contents":142,"faqs":143,"seo_title":144,"seo_description":12,"update_tm":80,"read_time":145,"preview_page_count":4},8796096645457,"https://ap-avatar.wpscdn.com/avatar/800003749518d68ffe3?x-image-process=image/resize,m_fixed,w_180,h_180&k=1779345340919836971","PsychoGAT: A Novel Psychological Measurement Paradigm through Interactive Fiction Games with LLM Agents  \nQisen Yang 1 * , Zekun Wang2 * , Honghui Chen3 , Shenzhi Wang 1 , Yifan Pu 1 , Xin Gao4 , Wenhao Huang2 , Shiji Song 1 , Gao Huang 1†  \n1 Department of Automation, BNRist, Tsinghua University 201.AI  \n3Medical Psychological Center, The Second Xiangya Hospital, Central South University & Medical Psychological Institute, Central South University  \n& National Clinical Research Center for Mental Disorders  \n4 Carnegie Mellon University  \nAbstract  \nPsychological measurement is essential for mental health, self-understanding, and personal development. Traditional methods, such as selfreport scales and psychologist interviews, often face challenges with engagement and accessibility. While game-based and LLM-based tools have been explored to improve user interest and automate assessment, they struggle to balance engagement with generalizability. In this work, we propose PsychoGAT (Psychological Game AgenTs) to achieve a generic gamification of psychological assessment. The main insight is that powerful LLMs can function both as adept psychologists and innovative game designers. By incorporating LLM agents into designated roles and carefully managing their interactions, PsychoGAT can transform any standardized scales into personalized and engaging interactive fiction games. To validate the proposed method, we conduct psychometric evaluationsto assess its effectiveness and employ human evaluators to examine the generated content across various psychological constructs, including depression, cognitive distortions, and personality traits. Results demonstrate that PsychoGAT serves as an effective assessment tool, achieving statistically significant excellence in psychometric metrics such as reliability, convergent validity, and discriminant validity. Moreover, human evaluations confirm PsychoGAT’s enhancements in content coherence, interactivity, interest, immersion, and satisfaction.  \n1 Introduction  \nPsychological assessment plays a pivotal role in mental health and self-understanding (Meyer et al., 2001), such as depression measurement, cognitive  \n*Equal contribution, ordered alphabetically. Work was done during Zekun Wang’s internship at Tsinghua University.  \n†Corresponding author.  \nEmails: [yangqs19@mails.tsinghua.edu.cn](yangqs19@mails.tsinghua.edu.cn), noah.zenmoo[re@gmail.com](re@gmail.com), [choraschan@csu.edu.cn](choraschan@csu.edu.cn), {wsz21, puyf23}@ [mails.tsinghua.edu.cn](mails.tsinghua.edu.cn), [xing1@andrew.cmu.edu](xing1@andrew.cmu.edu), rubio8741@ [gmail.com](gmail.com), {shijis, [gaohuang}@tsinghua.edu.cn](gaohuang}@tsinghua.edu.cn).  \n Self-Report Scale  Interactive Fiction Game  \nFigure 1: We propose PsychoGAT, a novel psychological assessment paradigm in the form of an interactive game instead of a traditional self-report scale.  \ndistortion detection, and personality testing (Osipow et al., 1966 ; Hogan, 1991 ; Bohane et al., 2017 ; Sharma et al., 2020b ; Organization et al., 2022) . Traditional methods for measuring these psychological constructs have mainly relied on standardized questionnaires (i.e., self-report scales) (Urbina, 2014) and psychologist-patient dialogues (Tu et al., 2024) . However, these approaches come with inherent limitations: (1) standardized scales can be monotonous, reducing engagement, particularly among younger individuals, leading to resistance (Merry et al., 2012); (2) expert interviews require significant human resources and are scarce, often making psychological assessments inaccessible to those in need (Crisp and Chen, 2014) .  \nTo address these challenges, there has been a shift towards automated, procedural methods for psychological assessments, including Computerized Adaptive Testing (Meijer and Nering, 1999) and rule-based electronic games specifically designed for measurements (Jones, 1984 ; Song et al., 2020) . Besides, some studies have explored the use of Natural Lang","cbCaiaCU7JNzW0zG","https://ap.wps.com/l/cbCaiaCU7JNzW0zG","pdf",2179065,36,"English","# Introduction\n## Psychological assessment and limitations\n## LLM-based approaches and remaining challenges\n## Proposed paradigm: PsychoGAT\n# Abstract","[{\"question\":\"What problem does PsychoGAT aim to solve in psychological measurement?\",\"answer\":\"It targets limited engagement and accessibility in traditional self-report and interview methods, and it addresses insufficient generalizability in existing game-based or LLM-based assessment tools.\"},{\"question\":\"How does PsychoGAT generate interactive fiction for psychological assessment?\",\"answer\":\"PsychoGAT treats powerful LLMs as both psychologists and game designers, assigns them designated roles, and carefully manages their interactions to convert standardized scales into personalized interactive fiction games.\"},{\"question\":\"What evidence supports PsychoGAT’s effectiveness?\",\"answer\":\"The document reports psychometric evaluation metrics such as reliability, convergent validity, and discriminant validity, along with human evaluations of content coherence, interactivity, interest, immersion, and satisfaction.\"}]","PsychoGAT - A Novel Psychological Measurement Paradigm through Interactive Fiction Games with LLM Agents | PDF",91]