[{"data":1,"prerenderedAt":-1},["ShallowReactive",2],{"doc-seo-620860-105":3,"detail-sidebar-cat-0-en-105":80,"doc-detail-620860-en":130},{"code":4,"msg":5,"data":6},0,"ok",{"site_id":7,"language":8,"slug":9,"title":10,"keywords":11,"description":12,"schema_data":13,"social_meta":73,"head_meta":75,"extra_data":77,"updated_unix":79},105,"en","predictive-models-of-question-difficulty-introduction","Predictive Models of Question Difficulty - Introduction","","Predictive Models of Question Difficulty examines why some examination items reliably elicit stronger or weaker candidate performance and how question difficulty can be modeled rather than handled through intuition. It motivates the need for formal, flexible, and broadly usable models across subjects, noting that existing work often remains item- and subject-specific. The text then defines question difficulty using distinctions among concept, process, intrinsic, and surface/format factors, and highlights legitimate versus illegitimate sources tied to assessment communication.",{"@graph":14,"@context":72},[15,34,55],{"@type":16,"itemListElement":17},"BreadcrumbList",[18,23,27,31],{"item":19,"name":20,"@type":21,"position":22},"https://docshare.wps.com","Home","ListItem",1,{"item":24,"name":25,"@type":21,"position":26},"https://docshare.wps.com/document/","Document",2,{"item":28,"name":29,"@type":21,"position":30},"https://docshare.wps.com/document/research-report/","Research & Report",3,{"item":32,"name":10,"@type":21,"position":33},"https://docshare.wps.com/document/predictive-models-of-question-difficulty-introduction/620860/",4,{"url":32,"name":10,"@type":35,"image":36,"author":41,"headline":10,"publisher":44,"fileFormat":47,"inLanguage":8,"description":12,"dateModified":48,"datePublished":49,"encodingFormat":47,"isAccessibleForFree":50,"interactionStatistic":51},"DigitalDocument",{"url":37,"@type":38,"width":39,"height":40},"https://docshare.wps.com/thumbnails/predictive-models-of-question-difficulty-introduction/620860.png","ImageObject",300,407,{"name":42,"@type":43},"Riley West","Person",{"url":19,"name":45,"@type":46},"DocShare","Organization","application/pdf","2026-11-03","2026-10-20",true,{"@type":52,"interactionType":53,"userInteractionCount":33},"InteractionCounter",{"@type":54},"ViewAction",{"@type":56,"mainEntity":57},"FAQPage",[58,64,68],{"name":59,"@type":60,"acceptedAnswer":61},"Why do different exam questions produce different candidate reactions and performance levels?","Question",{"text":62,"@type":63},"The text argues that question difficulty emerges from multiple factors that candidates experience differently, so superficially similar items can demand different cognitive and linguistic processes.","Answer",{"name":65,"@type":60,"acceptedAnswer":66},"What challenges prevent a single generic model of question difficulty from being fully effective across subjects?",{"text":67,"@type":63},"Assessment objectives, formats, and criteria vary across and within subject domains, so prior research often targets narrow, homogeneous item sets rather than broad item and subject types.",{"name":69,"@type":60,"acceptedAnswer":70},"How does the document define “question difficulty”?",{"text":71,"@type":63},"It distinguishes concept difficulty (inherent conceptual complexity), process difficulty (cognitive operations and cognitive resources), and question difficulty (linguistic/structural properties and use of mark schemes), then groups them into intrinsic and surface difficulty.","https://schema.org",{"og:url":32,"og:type":74,"og:title":10,"og:site_name":45,"og:description":12},"article",{"robots":76,"canonical":32},"index,follow",{"doc_id":78,"site_id":7},620860,1793110025,{"code":4,"msg":81,"data":82},"success",[83,87,91,95,100,105,110,114,119,122,126],{"id":22,"doc_module":4,"doc_module_name":25,"category_name":84,"show_sort_weight":85,"slug":86},"Story & Novel",90,"story-novel",{"id":26,"doc_module":4,"doc_module_name":25,"category_name":88,"show_sort_weight":89,"slug":90},"Literature",80,"literature",{"id":33,"doc_module":4,"doc_module_name":25,"category_name":92,"show_sort_weight":93,"slug":94},"Exam",70,"exam",{"id":96,"doc_module":4,"doc_module_name":25,"category_name":97,"show_sort_weight":98,"slug":99},5,"Comic",60,"comic",{"id":101,"doc_module":4,"doc_module_name":25,"category_name":102,"show_sort_weight":103,"slug":104},6,"Technology",50,"technology",{"id":106,"doc_module":4,"doc_module_name":25,"category_name":107,"show_sort_weight":108,"slug":109},7,"Healthcare",40,"healthcare",{"id":111,"doc_module":4,"doc_module_name":25,"category_name":29,"show_sort_weight":112,"slug":113},8,30,"research-report",{"id":115,"doc_module":4,"doc_module_name":25,"category_name":116,"show_sort_weight":117,"slug":118},9,"Religion & Spirituality",20,"religion-spirituality",{"id":117,"doc_module":4,"doc_module_name":25,"category_name":120,"show_sort_weight":117,"slug":121},"World Cup","world-cup",{"id":123,"doc_module":4,"doc_module_name":25,"category_name":124,"show_sort_weight":123,"slug":125},10,"Lifestyle","lifestyle",{"id":127,"doc_module":4,"doc_module_name":25,"category_name":128,"show_sort_weight":96,"slug":129},19,"General","general",{"code":4,"msg":81,"data":131},{"doc_id":78,"user_id":132,"nickname":42,"user_avatar":133,"doc_module":4,"category_id":111,"category_name":29,"doc_title":10,"doc_description":12,"doc_content":134,"file_id":135,"file_url":136,"file_type":137,"file_size":138,"view_count":33,"is_deleted":4,"is_public":22,"is_downloadable":22,"audit_status":22,"page_count":139,"language":140,"language_code":8,"site_id":7,"html_lang":8,"table_of_contents":141,"faqs":142,"seo_title":143,"seo_description":12,"update_tm":144,"read_time":145},1099523885074,"https://ap-avatar.wpscdn.com/davatar_9964176cb1d06d4a9deccf72a44ae3dc","PREDICTIVE MODELS OF QUESTION DIFFICULTY  \nIntroduction  \nImagine the following scenario: you are a 16-year-old student nervously waiting to begin a GCSE Mathematics examination. The invigilator signals that you may begin and you turn over the front page of the paper to discover the following question; ‘ 22 + 33 = ? ’. Now compare that to the situation where the opening question is as follows;  \n‘Given that, for n ≥ 0, In = 􀀁01xn ex d x, prove that  \nIn = e-nIn-1 n ≥ 1 .’  \n,  \nIt does not require a sophisticated imagination to predict that the two questions described above will provoke two very different reactions from candidates and may produce very different levels of performance. Formally understanding precisely why this is so is an issue that strikes at the very heart of the design and implementation of public examinations; that is, what makes an examination question difficult?  \nAlmost anyone who has ever taken a written examination in any subject will believe they intuitively know the difference between an easy question and a difficult one. Similarly, the manipulation of question difficulty is a complex task that many question-setters appear to achieve through application of tacit informal knowledge, or what we might term‘intuition,’ and although they are often successful in this endeavour it is nevertheless a somewhat inexact science. If one could formalise these implicit processes it would enable question-setters to target questions at specific levels of difficulty appropriate to particular candidate groups, thereby better assessing the full range of student abilities.  \nUnfortunately, development of a precise, flexible, and diverse model of question difficulty―one that is of equal utility across item and subject types ― is hampered by the fact that the assessment objectives, formats and assessment criteria for examination questions will vary both between and within subject domains. For this reason, much of the research to date has been both subject- and item-specific, developing and testing theories and models to account for differential levels of difficulty within very homogenous sets of item-types. Examples of these are analogy problems and other nonverbal reasoning items such as those prevalent on psychometric tests purporting to gauge general intelligence (Mulholland, Pellegrino & Glaser, 1980; Sternberg, 1977, 1979, 1982), short answer language comprehension questions such as those found on English and Modern Foreign Language papers in the United Kingdom (Pollitt & Ahmed, 1999) and an assortment of problems of the kind that are found on Graduate Record Examinations (GRE) in the United States such as (algebraic) Generating Examples (Katz, Lipps & Trafton, 2002), Sentence Completion (Sheehan & Mislevy, 2001), Analytical Reasoning (Boldt, 1998; Chalifour & Powers, 1988), Verbal Discretes (Adams, Carson & Cureton, 1993), and Reading Comprehension (Freedie & Kostin, 1992) .  \nWhile some authors have made commendable strides towards developing more generic models of question difficulty (e.g. , Pollitt & Ahmed, 1999; Pollitt, Entwistle, Hutchinson & de Luca, 1985), these have been hindered by the fact that any gains in universality have incurred inevitable costs to levels of detail. This partly explains the inadequate pool of published empirical evidence testing the efficacy, practicality, and generality of their application. Acknowledging this is less a criticism than recognition of the inevitable limitations that any generic model must, by definition, contain.  \nBefore exploring these theories in more detail, it is important to define more specifically what is meant by question difficulty. Pollitt et al. (1985) and Ahmed and Pollitt (1999), for example, draw several useful distinctions that will be partially adopted in this paper. ‘ Concept’ difficulty, they argue, is concerned with the inherent conceptual complexity of the subject matter and is determined by the degree to which the concepts involved in a question ar","cbCaiqZYNrVi4FQs","https://ap.wps.com/l/cbCaiqZYNrVi4FQs","pdf",646392,21,"English","# Introduction\n## Motivation: why difficulty matters\n## Limits of existing research\n## Defining question difficulty\n## Intrinsic (concept/process) vs surface (format/mark scheme)\n## Legitimate vs illegitimate sources","[{\"question\":\"Why do different exam questions produce different candidate reactions and performance levels?\",\"answer\":\"The text argues that question difficulty emerges from multiple factors that candidates experience differently, so superficially similar items can demand different cognitive and linguistic processes.\"},{\"question\":\"What challenges prevent a single generic model of question difficulty from being fully effective across subjects?\",\"answer\":\"Assessment objectives, formats, and criteria vary across and within subject domains, so prior research often targets narrow, homogeneous item sets rather than broad item and subject types.\"},{\"question\":\"How does the document define “question difficulty”?\",\"answer\":\"It distinguishes concept difficulty (inherent conceptual complexity), process difficulty (cognitive operations and cognitive resources), and question difficulty (linguistic/structural properties and use of mark schemes), then groups them into intrinsic and surface difficulty.\"}]","Predictive Models of Question Difficulty - Introduction | PDF",1792464691,53]