[{"data":1,"prerenderedAt":-1},["ShallowReactive",2],{"doc-seo-297380-105":3,"detail-sidebar-cat-0-en-105":81,"doc-detail-297380-en":130},{"code":4,"msg":5,"data":6},0,"ok",{"site_id":7,"language":8,"slug":9,"title":10,"keywords":11,"description":12,"schema_data":13,"social_meta":74,"head_meta":76,"extra_data":78,"updated_unix":80},105,"en","thinking-skills-and-admissions-a-report-on-the-validity-and-reliability-of-the-tsa-and-mvatbmat-assessments","Thinking Skills and Admissions - A report on the Validity and Reliability - of the TSA and MVAT/BMAT Assessments","","This report documents UCLES work on Thinking Skills, evaluating the TSA and parts of the MVAT/BMAT admissions assessments developed through and beyond the late 1980s. It reviews assessment properties, focusing on validity and reliability, and examines how TSA and MVAT/BMAT scores relate to university or performance outcomes. Findings indicate the TSA and BMAT (Parts 1 and 2) are reasonably sound, with limited yet non-problematic predictive validity and a cautious outlook for future development.",{"@graph":14,"@context":73},[15,34,56],{"@type":16,"itemListElement":17},"BreadcrumbList",[18,23,27,31],{"item":19,"name":20,"@type":21,"position":22},"https://docshare.wps.com","Home","ListItem",1,{"item":24,"name":25,"@type":21,"position":26},"https://docshare.wps.com/document/","Document",2,{"item":28,"name":29,"@type":21,"position":30},"https://docshare.wps.com/document/research-report/","Research & Report",3,{"item":32,"name":10,"@type":21,"position":33},"https://docshare.wps.com/document/thinking-skills-and-admissions-a-report-on-the-validity-and-reliability-of-the-tsa-and-mvatbmat-assessments/297380/",4,{"url":32,"name":10,"@type":35,"image":36,"author":41,"headline":10,"publisher":44,"fileFormat":47,"inLanguage":8,"description":12,"dateModified":48,"datePublished":49,"encodingFormat":47,"isAccessibleForFree":50,"interactionStatistic":51},"DigitalDocument",{"url":37,"@type":38,"width":39,"height":40},"https://docshare.wps.com/thumbnails/thinking-skills-and-admissions-a-report-on-the-validity-and-reliability-of-the-tsa-and-mvatbmat-assessments/297380.png","ImageObject",300,407,{"name":42,"@type":43},"Patrick","Person",{"url":19,"name":45,"@type":46},"DocShare","Organization","application/pdf","2026-10-31","2026-09-18",true,{"@type":52,"interactionType":53,"userInteractionCount":55},"InteractionCounter",{"@type":54},"ViewAction",9,{"@type":57,"mainEntity":58},"FAQPage",[59,65,69],{"name":60,"@type":61,"acceptedAnswer":62},"What does the report evaluate regarding admissions assessments?","Question",{"text":63,"@type":64},"The report evaluates the TSA and parts of the MVAT/BMAT tests, focusing on their validity and reliability and whether scores can predict achievement or performance in relevant admissions contexts.","Answer",{"name":66,"@type":61,"acceptedAnswer":67},"How are validity and reliability discussed in the report?",{"text":68,"@type":64},"It reviews properties of an assessment, then separately considers validity and reliability, including how validity issues and reliability estimates affect interpretation of test scores.",{"name":70,"@type":61,"acceptedAnswer":71},"What conclusions does the report reach about the TSA and BMAT assessments?",{"text":72,"@type":64},"It finds the TSA and BMAT (Parts 1 and 2) to be reasonably sound, notes limited predictive validity information so far, and suggests that future developments should be approached with caution while expanding data for further analyses.","https://schema.org",{"og:url":32,"og:type":75,"og:title":10,"og:site_name":45,"og:description":12},"article",{"robots":77,"canonical":32},"index,follow",{"doc_id":79,"site_id":7},297380,1791327708,{"code":4,"msg":82,"data":83},"success",[84,88,92,96,101,106,111,115,119,122,126],{"id":22,"doc_module":4,"doc_module_name":25,"category_name":85,"show_sort_weight":86,"slug":87},"Story & Novel",90,"story-novel",{"id":26,"doc_module":4,"doc_module_name":25,"category_name":89,"show_sort_weight":90,"slug":91},"Literature",80,"literature",{"id":33,"doc_module":4,"doc_module_name":25,"category_name":93,"show_sort_weight":94,"slug":95},"Exam",70,"exam",{"id":97,"doc_module":4,"doc_module_name":25,"category_name":98,"show_sort_weight":99,"slug":100},5,"Comic",60,"comic",{"id":102,"doc_module":4,"doc_module_name":25,"category_name":103,"show_sort_weight":104,"slug":105},6,"Technology",50,"technology",{"id":107,"doc_module":4,"doc_module_name":25,"category_name":108,"show_sort_weight":109,"slug":110},7,"Healthcare",40,"healthcare",{"id":112,"doc_module":4,"doc_module_name":25,"category_name":29,"show_sort_weight":113,"slug":114},8,30,"research-report",{"id":55,"doc_module":4,"doc_module_name":25,"category_name":116,"show_sort_weight":117,"slug":118},"Religion & Spirituality",20,"religion-spirituality",{"id":117,"doc_module":4,"doc_module_name":25,"category_name":120,"show_sort_weight":117,"slug":121},"World Cup","world-cup",{"id":123,"doc_module":4,"doc_module_name":25,"category_name":124,"show_sort_weight":123,"slug":125},10,"Lifestyle","lifestyle",{"id":127,"doc_module":4,"doc_module_name":25,"category_name":128,"show_sort_weight":97,"slug":129},19,"General","general",{"code":4,"msg":82,"data":131},{"doc_id":79,"user_id":132,"nickname":42,"user_avatar":133,"doc_module":4,"category_id":112,"category_name":29,"doc_title":10,"doc_description":12,"doc_content":134,"file_id":135,"file_url":136,"file_type":137,"file_size":138,"view_count":55,"is_deleted":4,"is_public":22,"is_downloadable":22,"audit_status":22,"page_count":139,"language":140,"language_code":8,"site_id":7,"html_lang":8,"table_of_contents":141,"faqs":142,"seo_title":143,"seo_description":12,"update_tm":144,"read_time":145,"preview_page_count":4},549758146520,"https://ap-avatar.wpscdn.com/avatar/80002397d8c0411e94?_k=1775819394049821470","Thinking Skills and Admissions  \nA report on the Validity and Reliability  \nof the  \nTSA and MVAT/BMAT Assessments  \nAlan Willmott  \nSeptember 2005  \nContents  \nSection Contents Page  \nList of Tables iv  \nOverview vi  \nNote on References in this Report vii  \n1 Background 1  \n1.1 UCLES, Thinking Skills and MENO 1  \n1.2 A Growing Problem with Admissions 3  \n1.3 A Trial 3  \n1.4 A Further Development 4  \n2 The TSA Questions 5  \n2.1 The Six Skills of MENO 5  \n2.2 Other Developments 5  \n2.3 The TSA 6  \n3 Validity and Reliability 7  \n3.1 Some Properties of an Assessment 7  \n3.2 Validity 7  \n3.3 Reliability 8  \n3.4 Validity and Reliability 8  \n4 The Reliability of the TSA Tests 10  \n4.1 The Early Development of Thinking Skills 10  \n4.2 CTSC and CATS 10  \n4.3 TSA Pre-tests 11  \n4.4 TSA Tests 12  \n4.5 Other Uses of TSA 13  \n4.6 The Reliability of TSA 13  \n5 Issues of Validity 14  \n5.1 Some Early Findings 14  \n5.2 The Use of TSA 14  \n5.3 TSA Scores as Predictors of Achievement 14  \n5.4 Prediction by TSA Score Sub-scale 16  \n5.5 The Use of TSA in the Admissions Process 16  \n5.6 Some Comments from Users 18  \n5.7 Bias in TSA Questions 19  \nThinking Skills and Admissions ii  \nContents  \nSection Contents Page  \n6 Critical Thinking and Problem Solving: One Skill or Two? 20  \n6.1 The Two Sub-scales 20  \n6.2 Early Results 21  \n6.3 Results for TSA Analyses 21  \n6.4 Sub-scale Inter-Correlations 22  \n6.5 The CT and PS Sub-Scales 23  \n6.6 The Implications of the Findings 24  \n7 The MVAT and the BMAT 25  \n7.1 The Need for an Aid to Admissions in Medical Courses 25  \n7.2 The Reliability of the MVAT and BMAT Assessments 25  \n7.2.1 MVAT and BMAT Part 1 25  \n7.2.2 MVAT and BMAT Part 2 26  \n7.2.3 MVAT and BMAT Part 3 26  \n7.3 MVAT and BMAT Scores as Predictors of Performance 26  \n7.4 The Use of MVAT and BMAT in the Admissions Process 27  \n7.5 The MVAT and BMAT Sub-Scores 29  \n7.6 The Sub-Scale Inter-Correlations 30  \n7.7 The Implications of the Analyses 30  \n8 TSA and BMAT in the Future 31  \n8.1 Much Needs Doing 31  \n8.2 Some Comments and Conclusions 33  \n8.3 Suggestions for Further Work 33  \nAppendix A TSA Test Specification 34  \nAppendix B Areas for Further Work 35  \nReferences 36  \nThinking Skills and Admissions iii  \nList of Tables  \nTable Number Content Page  \n1.1 Applications and Admissions for the 3 University of Cambridge in 1973 and 2003  \n4.1 Reliability Estimates for CTSC and CATS 11 Assessments – 1996-2003  \n4.2 TSA Pre-test Reliability Estimates 11  \n4.3 TSA Reliability Estimates 12  \n4.4 Reliability Estimates for Other Uses of TSA Tests 13  \n5.1 Correlations of TSA Scores with First-Year Results – 15 2001-3 and 2002-4  \n5.2 Correlations of CT and PS Scores with First Year Results – 16 2002-4  \n5.3 TSA Score by Application Decision – 2003 Cohort 17  \n5.4 TSA Score by Application Decision: 17 Subject B Applicants – 2003 Cohort  \n5.5 Correlations between TSA Sub-scores and 18 Application Outcome  \n6.1 Estimated Reliability of TSA Sub-scores – Early Results 21  \n6.2 Summary of Sub-Scale Analyses for TSA tests 22  \n6.3 Correlations between the Sub-Scales of TSA Tests 23  \n7.1 Reliability Estimates for Part 1 of the MVAT/BMAT Tests – 26  \n1999-2004  \n7.2 Reliability Estimates for Part 2 of the MVAT/BMAT Tests 26  \n– 1999-2004  \n7.3 Predictive Validity of MVAT 2000 27  \n7.4 MVAT Scores by Application Decision – 2000 27  \n7.5 Correlations-MVAT Scores and Application 27  \nDecisions – 2000  \n7.6 MVAT Scores by Application Decision – 2001 28  \n7.7 Correlations-MVAT Scores and Application 28 Decisions – 2001  \nThinking Skills and Admissions iv  \nList of Tables  \nTable Number Content Page  \n7.8 MVAT Scores by Application Decision – 2002 28  \n7.9 Correlations-MVAT Scores and Application 28 Decisions – 2002  \n7.10 BMAT Scores by Application Decision – 2003 28  \n7.11 Correlations-BMAT Scores and Application 29 Decisions – 2003  \n7.12 Summary of Sub-Scale Analyses for Part 1 of MVAT/BMAT 29  \n7.13 Correlations between the Sub-Scales 30 of Part 1 MVAT and BMA","cbCaicH6QWwmaCuq","https://ap.wps.com/l/cbCaicH6QWwmaCuq","pdf",312759,45,"English","# Overview\n# Background\n## UCLES, Thinking Skills and MENO\n## A Growing Problem with Admissions\n## A Trial\n## A Further Development\n# The TSA Questions\n## The Six Skills of MENO\n## Other Developments\n## The TSA\n# Validity and Reliability\n## Some Properties of an Assessment\n## Validity\n## Reliability\n# The Reliability of the TSA Tests\n## Early Development of Thinking Skills\n## CTSC and CATS\n## TSA Pre-tests\n## TSA Tests\n## Other Uses of TSA\n# Issues of Validity\n## Early Findings\n## Use of TSA\n## TSA Scores as Predictors of Achievement\n# Critical Thinking and Problem Solving: One Skill or Two?\n## The Two Sub-scales\n## Early Results\n## TSA Analyses and Implications\n# The MVAT and the BMAT\n## Need for an Aid to Admissions in Medical Courses\n## Reliability of the MVAT and BMAT Assessments\n## Predictors of Performance and Use in Admissions\n# TSA and BMAT in the Future\n## Much Needs Doing\n## Comments and Conclusions\n## Suggestions for Further Work\n# Appendices\n## TSA Test Specification\n## Areas for Further Work\n# References","[{\"question\":\"What does the report evaluate regarding admissions assessments?\",\"answer\":\"The report evaluates the TSA and parts of the MVAT/BMAT tests, focusing on their validity and reliability and whether scores can predict achievement or performance in relevant admissions contexts.\"},{\"question\":\"How are validity and reliability discussed in the report?\",\"answer\":\"It reviews properties of an assessment, then separately considers validity and reliability, including how validity issues and reliability estimates affect interpretation of test scores.\"},{\"question\":\"What conclusions does the report reach about the TSA and BMAT assessments?\",\"answer\":\"It finds the TSA and BMAT (Parts 1 and 2) to be reasonably sound, notes limited predictive validity information so far, and suggests that future developments should be approached with caution while expanding data for further analyses.\"}]","Thinking Skills and Admissions - A report on the Validity and Reliability - of the TSA and MVAT/BMAT Assessments | PDF",1789744163,113]