[{"data":1,"prerenderedAt":-1},["ShallowReactive",2],{"detail-sidebar-cat-0-en-105":3,"doc-seo-293066-105":59,"doc-detail-293066-en":131},{"code":4,"msg":5,"data":6},0,"success",[7,13,18,23,28,33,38,43,48,51,55],{"id":8,"doc_module":4,"doc_module_name":9,"category_name":10,"show_sort_weight":11,"slug":12},1,"Document","Story & Novel",90,"story-novel",{"id":14,"doc_module":4,"doc_module_name":9,"category_name":15,"show_sort_weight":16,"slug":17},2,"Literature",80,"literature",{"id":19,"doc_module":4,"doc_module_name":9,"category_name":20,"show_sort_weight":21,"slug":22},4,"Exam",70,"exam",{"id":24,"doc_module":4,"doc_module_name":9,"category_name":25,"show_sort_weight":26,"slug":27},5,"Comic",60,"comic",{"id":29,"doc_module":4,"doc_module_name":9,"category_name":30,"show_sort_weight":31,"slug":32},6,"Technology",50,"technology",{"id":34,"doc_module":4,"doc_module_name":9,"category_name":35,"show_sort_weight":36,"slug":37},7,"Healthcare",40,"healthcare",{"id":39,"doc_module":4,"doc_module_name":9,"category_name":40,"show_sort_weight":41,"slug":42},8,"Research & Report",30,"research-report",{"id":44,"doc_module":4,"doc_module_name":9,"category_name":45,"show_sort_weight":46,"slug":47},9,"Religion & Spirituality",20,"religion-spirituality",{"id":46,"doc_module":4,"doc_module_name":9,"category_name":49,"show_sort_weight":46,"slug":50},"World Cup","world-cup",{"id":52,"doc_module":4,"doc_module_name":9,"category_name":53,"show_sort_weight":52,"slug":54},10,"Lifestyle","lifestyle",{"id":56,"doc_module":4,"doc_module_name":9,"category_name":57,"show_sort_weight":24,"slug":58},19,"General","general",{"code":4,"msg":60,"data":61},"ok",{"site_id":62,"language":63,"slug":64,"title":65,"keywords":66,"description":67,"schema_data":68,"social_meta":124,"head_meta":126,"extra_data":128,"updated_unix":130},105,"en","can-chatgpt-assess-human-personalities-a-general-evaluation-framework","Can ChatGPT Assess Human Personalities? - A General Evaluation Framework","","Large Language Models, especially ChatGPT, deliver strong results across many tasks, yet their capacity to simulate and evaluate human-like psychology remains underexplored. This paper introduces a generic evaluation framework that measures human personality assessments using Myers–Briggs Type Indicator (MBTI) questions. The framework builds unbiased prompts through randomized option permutations, applies subject replacement for flexible queries, and rewrites instructions for correctness-oriented responses. Experiments indicate ChatGPT can assess personalities with more consistent and fairer average outcomes.",{"@graph":69,"@context":123},[70,84,106],{"@type":71,"itemListElement":72},"BreadcrumbList",[73,77,79,82],{"item":74,"name":75,"@type":76,"position":8},"https://docshare.wps.com","Home","ListItem",{"item":78,"name":9,"@type":76,"position":14},"https://docshare.wps.com/document/",{"item":80,"name":40,"@type":76,"position":81},"https://docshare.wps.com/document/research-report/",3,{"item":83,"name":65,"@type":76,"position":19},"https://docshare.wps.com/document/can-chatgpt-assess-human-personalities-a-general-evaluation-framework/293066/",{"url":83,"name":65,"@type":85,"image":86,"author":91,"headline":65,"publisher":94,"fileFormat":97,"inLanguage":63,"description":67,"dateModified":98,"datePublished":99,"encodingFormat":97,"isAccessibleForFree":100,"interactionStatistic":101},"DigitalDocument",{"url":87,"@type":88,"width":89,"height":90},"https://docshare.wps.com/thumbnails/can-chatgpt-assess-human-personalities-a-general-evaluation-framework/293066.png","ImageObject",300,407,{"name":92,"@type":93},"Rowan","Person",{"url":74,"name":95,"@type":96},"DocShare","Organization","application/pdf","2026-10-19","2026-09-17",true,{"@type":102,"interactionType":103,"userInteractionCount":105},"InteractionCounter",{"@type":104},"ViewAction",11,{"@type":107,"mainEntity":108},"FAQPage",[109,115,119],{"name":110,"@type":111,"acceptedAnswer":112},"What evaluation approach does the paper propose for assessing human personalities with LLMs?","Question",{"text":113,"@type":114},"The paper proposes a generic evaluation framework using MBTI questions, including unbiased prompts, subject-replaced queries, and correctness-evaluated instructions to elicit clearer responses.","Answer",{"name":116,"@type":111,"acceptedAnswer":117},"How does the framework reduce bias in MBTI prompt answering?",{"text":118,"@type":114},"It devises unbiased prompts by randomly permuting the answer options in MBTI questions and averaging the testing results to encourage more impartial generation.",{"name":120,"@type":111,"acceptedAnswer":121},"What do the experimental results show about ChatGPT’s personality assessment performance?",{"text":122,"@type":114},"Experiments reveal ChatGPT’s ability to assess human personalities, with average results showing more consistent and fairer assessments, even though robustness is lower against prompt biases compared with InstructGPT.","https://schema.org",{"og:url":83,"og:type":125,"og:title":65,"og:site_name":95,"og:description":67},"article",{"robots":127,"canonical":83},"index,follow",{"doc_id":129,"site_id":62},293066,1789659155,{"code":4,"msg":5,"data":132},{"doc_id":129,"user_id":133,"nickname":92,"user_avatar":134,"doc_module":4,"category_id":39,"category_name":40,"doc_title":65,"doc_description":67,"doc_content":135,"file_id":136,"file_url":137,"file_type":138,"file_size":139,"view_count":105,"is_deleted":4,"is_public":8,"is_downloadable":8,"audit_status":8,"page_count":105,"language":140,"language_code":63,"site_id":62,"html_lang":63,"table_of_contents":141,"faqs":142,"seo_title":143,"seo_description":67,"update_tm":130,"read_time":144,"preview_page_count":4},1099514067415,"https://ap-avatar.wpscdn.com/avatar/100002539d78ffe74a7?x-image-process=image/resize,m_fixed,w_180,h_180&k=1779092875211072502","Can ChatGPT Assess Human Personalities?  \nA General Evaluation Framework  \nHaocong Rao 1 ,2 Cyril Leung2 ,3 Chunyan Miao 1 ,2 ∗  \n1 School of Computer Science and Engineering, Nanyang Technological University, Singapore  \n2LILY Research Centre, Nanyang Technological University, Singapore  \n3Department of Electrical and Computer Engineering  \nThe University of British Columbia, Canada  \n{haocong001,[ascymiao}@ntu.edu.sg {cleung}@ece.ubc.ca](ascymiao}@ntu.edu.sg {cleung}@ece.ubc.ca)  \nAbstract  \nLarge Language Models (LLMs) especially ChatGPT have produced impressive results in various areas, but their potential human-like psychology is still largely unexplored. Existing works study the virtual personalities of LLMs but rarely explore the possibility of analyzing human personalities via LLMs. This paper presents a generic evaluation framework for LLMs to assess human personalities based on Myers–Briggs Type Indicator (MBTI) tests.  \nSpecifically, we first devise unbiased prompts by randomly permuting options in MBTI questions and adopt the average testing result to encourage more impartial answer generation.  \nThen, we propose to replace the subject in question statements to enable flexible queries and assessments on different subjects from LLMs. Finally, we re-formulate the question instructions in a manner of correctness evaluation to facilitate LLMs to generate clearer responses. The proposed framework enables LLMs to flexibly assess personalities of different groups of people. We further propose three evaluation metrics to measure the consistency, robustness, and fairness of assessment results from state-ofthe-art LLMs including ChatGPT and GPT-4 . Our experiments reveal ChatGPT’s ability to assess human personalities, and the average results demonstrate that it can achieve more consistent and fairer assessments in spite of lower robustness against prompt biases compared with InstructGPT†.  \n1 Introduction  \nPre-trained Large Language Models (LLMs) have been widely used in many applications including translation, storytelling, and chatbots (Devlin et al., 2019 ; Raffel et al., 2020 ; Yang et al., 2022 ; Yuan et al., 2022 ; Ouyang et al., 2022 ; Bubeck et al.,  \n* Corresponding author  \n†Our codes are available at [https://github.com/Kali](https://github.com/Kali)Hac/ChatGPT-MBTI.  \n2023) . ChatGPT (Ouyang et al., 2022) and its enhanced version GPT-4 are currently recognized as the most capable chatbots, which can perform context-aware conversations, challenge incorrect premises, and reject inappropriate requests with a vast knowledge base and human-centered finetuning. These advantages make them well-suited for a variety of real-world scenarios such as business consultation and educational services (Zhai, 2022 ; van Dis et al., 2023 ; Bubeck et al., 2023) .  \nRecent studies have revealed that LLMs may possess human-like self-improvement and reasoning characteristics (Huang et al., 2022 ; Bubeck et al., 2023) . The latest GPT series can pass over 90% of Theory of Mind (ToM) tasks with strong analysis and decision-making capabilities (Kosinski, 2023 ; Zhuo et al., 2023 ; Moghaddam and Honey, 2023) . In this context, LLMs are increasingly assumed to have virtual personalities and psychologies, which plays an essential role in guiding their responsesand interaction patterns (Jiang et al., 2022) . Based on this assumption, a few works (Li et al., 2022 ; Jiang et al., 2022 ; Karra et al., 2022 ; Caron and Srivastava, 2022 ; Miotto et al., 2022) apply psychological tests such as Big Five Factors (Digman, 1990) to evaluate their pseudo personalities (e.g. , behavior tendency), so as to detect societal and ethical risks (e.g. , racial biases) in their applications. Although existing works have investigated the personality traits of LLMs, they rarely explored whether LLMs can assess human personalities. This open problem can be the key to verifying the ability of LLMs to perform psychological (e.g. , personality psychology) analyses a","cbCaikCbJoEe6hzO","https://ap.wps.com/l/cbCaikCbJoEe6hzO","pdf",694270,"English","# Abstract\n# Introduction","[{\"question\":\"What evaluation approach does the paper propose for assessing human personalities with LLMs?\",\"answer\":\"The paper proposes a generic evaluation framework using MBTI questions, including unbiased prompts, subject-replaced queries, and correctness-evaluated instructions to elicit clearer responses.\"},{\"question\":\"How does the framework reduce bias in MBTI prompt answering?\",\"answer\":\"It devises unbiased prompts by randomly permuting the answer options in MBTI questions and averaging the testing results to encourage more impartial generation.\"},{\"question\":\"What do the experimental results show about ChatGPT’s personality assessment performance?\",\"answer\":\"Experiments reveal ChatGPT’s ability to assess human personalities, with average results showing more consistent and fairer assessments, even though robustness is lower against prompt biases compared with InstructGPT.\"}]","Can ChatGPT Assess Human Personalities? - A General Evaluation Framework | PDF",28]