[{"data":1,"prerenderedAt":-1},["ShallowReactive",2],{"detail-sidebar-cat-0-en-105":3,"doc-seo-587459-105":59,"doc-detail-587459-en":130},{"code":4,"msg":5,"data":6},0,"success",[7,13,18,23,28,33,38,43,48,51,55],{"id":8,"doc_module":4,"doc_module_name":9,"category_name":10,"show_sort_weight":11,"slug":12},1,"Document","Story & Novel",90,"story-novel",{"id":14,"doc_module":4,"doc_module_name":9,"category_name":15,"show_sort_weight":16,"slug":17},2,"Literature",80,"literature",{"id":19,"doc_module":4,"doc_module_name":9,"category_name":20,"show_sort_weight":21,"slug":22},4,"Exam",70,"exam",{"id":24,"doc_module":4,"doc_module_name":9,"category_name":25,"show_sort_weight":26,"slug":27},5,"Comic",60,"comic",{"id":29,"doc_module":4,"doc_module_name":9,"category_name":30,"show_sort_weight":31,"slug":32},6,"Technology",50,"technology",{"id":34,"doc_module":4,"doc_module_name":9,"category_name":35,"show_sort_weight":36,"slug":37},7,"Healthcare",40,"healthcare",{"id":39,"doc_module":4,"doc_module_name":9,"category_name":40,"show_sort_weight":41,"slug":42},8,"Research & Report",30,"research-report",{"id":44,"doc_module":4,"doc_module_name":9,"category_name":45,"show_sort_weight":46,"slug":47},9,"Religion & Spirituality",20,"religion-spirituality",{"id":46,"doc_module":4,"doc_module_name":9,"category_name":49,"show_sort_weight":46,"slug":50},"World Cup","world-cup",{"id":52,"doc_module":4,"doc_module_name":9,"category_name":53,"show_sort_weight":52,"slug":54},10,"Lifestyle","lifestyle",{"id":56,"doc_module":4,"doc_module_name":9,"category_name":57,"show_sort_weight":24,"slug":58},19,"General","general",{"code":4,"msg":60,"data":61},"ok",{"site_id":62,"language":63,"slug":64,"title":65,"keywords":66,"description":67,"schema_data":68,"social_meta":123,"head_meta":125,"extra_data":127,"updated_unix":129},105,"en","judging-the-credibility-of-quantitative-student-ratings-of-instruction-research-idea-paper-80-august-2019","Judging the Credibility of Quantitative Student Ratings of Instruction Research - IDEA Paper 80 - August 2019","","Periodically, articles discuss student ratings of instruction (SRI), often challenging their validity and reliability. Before accepting media claims from quantitative studies, readers must assess both credibility and generalizability. The paper reviews criteria for evaluation based on David Krathwohl’s (2009) judgments of internal validity (linking power) and external validity (generalizing power), showing how these judgments support stronger research conclusions.",{"@graph":69,"@context":122},[70,84,105],{"@type":71,"itemListElement":72},"BreadcrumbList",[73,77,79,82],{"item":74,"name":75,"@type":76,"position":8},"https://docshare.wps.com","Home","ListItem",{"item":78,"name":9,"@type":76,"position":14},"https://docshare.wps.com/document/",{"item":80,"name":40,"@type":76,"position":81},"https://docshare.wps.com/document/research-report/",3,{"item":83,"name":65,"@type":76,"position":19},"https://docshare.wps.com/document/judging-the-credibility-of-quantitative-student-ratings-of-instruction-research-idea-paper-80-august-2019/587459/",{"url":83,"name":65,"@type":85,"image":86,"author":91,"headline":65,"publisher":94,"fileFormat":97,"inLanguage":63,"description":67,"dateModified":98,"datePublished":99,"encodingFormat":97,"isAccessibleForFree":100,"interactionStatistic":101},"DigitalDocument",{"url":87,"@type":88,"width":89,"height":90},"https://docshare.wps.com/thumbnails/judging-the-credibility-of-quantitative-student-ratings-of-instruction-research-idea-paper-80-august-2019/587459.png","ImageObject",300,407,{"name":92,"@type":93},"นรินทร์","Person",{"url":74,"name":95,"@type":96},"DocShare","Organization","application/pdf","2026-10-30","2026-10-15",true,{"@type":102,"interactionType":103,"userInteractionCount":34},"InteractionCounter",{"@type":104},"ViewAction",{"@type":106,"mainEntity":107},"FAQPage",[108,114,118],{"name":109,"@type":110,"acceptedAnswer":111},"What are the two main criteria used to judge credibility in this paper?","Question",{"text":112,"@type":113},"The paper uses David Krathwohl’s (2009) judgments of internal validity (linking power) and external validity (generalizing power). These assess whether variables are linked convincingly and whether findings generalize beyond the study.","Answer",{"name":115,"@type":110,"acceptedAnswer":116},"What does internal validity mean in this context?",{"text":117,"@type":113},"Internal validity refers to the extent to which a study demonstrates that investigated variables are linked in a relationship. It focuses on explanation credibility, translation validity, demonstrated results, and eliminating rival explanations.",{"name":119,"@type":110,"acceptedAnswer":120},"How does the paper suggest readers avoid biased takeaways from news articles?",{"text":121,"@type":113},"Readers should apply established research standards rather than rely on summaries in media. Evaluating internal and external validity helps determine whether conclusions are credible and generalizable based on the original research paper.","https://schema.org",{"og:url":83,"og:type":124,"og:title":65,"og:site_name":95,"og:description":67},"article",{"robots":126,"canonical":83},"index,follow",{"doc_id":128,"site_id":62},587459,1792189788,{"code":4,"msg":5,"data":131},{"doc_id":128,"user_id":132,"nickname":92,"user_avatar":133,"doc_module":4,"category_id":39,"category_name":40,"doc_title":65,"doc_description":67,"doc_content":134,"file_id":135,"file_url":136,"file_type":137,"file_size":138,"view_count":34,"is_deleted":4,"is_public":8,"is_downloadable":8,"audit_status":8,"page_count":139,"language":140,"language_code":63,"site_id":62,"html_lang":63,"table_of_contents":141,"faqs":142,"seo_title":143,"seo_description":67,"update_tm":144,"read_time":145,"preview_page_count":4},2336475104957,"https://ap-avatar.wpscdn.com/avatar/22000c4c6bd8a5076e1?x-image-process=image/resize,m_fixed,w_180,h_180&k=1787554080175789136","Judging the Credibility of Quantitative Student Ratings of Instruction Research  \nIDEA Paper \\#80 • August 2019  \nStephen L. Benton and Dan Li • The IDEA Center  \nAbstract  \nPeriodically, articles reporting research on student ratings of instruction (SRI), aka student evaluations of teaching, appear in the higher-education press. This literature often summarizes studies that challenge the validity and reliability of SRI. However, before drawing a conclusion about a quantitative study touted in the media, readers should evaluate both the credibility and generalizability of the primary source. In this paper, the authors review one set of criteria that aids in such evaluation—David Krathwohl’s (2009) judgments about (a) internal validity or linking power; and (b) external validity or generalizing power. Internal validity is the extent to which a study demonstrates that its investigated variables are linked in a relationship. External validity is how well a study establishes that its findings are generalizable. Applying such criteria can prevent biased takeaways created from merely reading a news article without assessing the quality of the research paper it summarizes.  \nKeywords: Internal validity, external validity, student ratings of instruction, student evaluations of teaching  \nPeriodically, articles reporting research on student ratings of instruction (SRI), aka student evaluations of teaching, appear in the higher-education press (e.g., Bunge, 2018; Falkoff, 2018; Flaherty, 2016; Lawrence, 2018) . This literature often cites studies that challenge the validity and reliability of SRI. However, before drawing a conclusion from a quantitative study touted in the media, readers should apply established research standards to evaluate both the credibility and generalizability of the primary source. In this paper, we review one set of criteria that aids in such evaluation—David Krathwohl’s judgments about internal validity, or linking power; and external validity, or generalizing power (2009) . Internal validity is the extent to which a researcher demonstrates that  \nthe investigated variables are linked in a relationship. Judgments about internal validity include explanation credibility, translation validity, demonstrated result, and the elimination of rival explanations. External validity is how well a study establishes that its findings are generalizable. Judgments about external validity focus on explanation generality, translation generality, demonstrated generality, and the elimination of restrictive explanations. We then explain how these judgments build conceptual and empirical support in the chain of reasoning that reinforces a study’s credibility and generalization. Applying such criteria can prevent biased takeaways created from merely reading a news article without assessing the quality of the research paper it summarizes.  \nKrathwohl’s Judgments About Internal Validity Internal validity concerns the linking power of a study—its ability to create a consensus that the investigated variables are interrelated. Krathwohl (2009) uses the term linking power because Campbell and Stanley’s original definition of internal validity (1963) was limited to the control of confounding variables and did not account for judgments about how well a study’s explanation and rationale were linked with the credibility of its results. Similar to Campbell and Stanley’s original definition, internal validity reduces the uncertainty that a relationship exists between the variables that are being investigated. Readers should therefore look for elements in the research design that either add to or lessen that uncertainty.  \nConceptual Evidence  \nConceptual evidence, the first element that bolsters internal validity, entails the researcher’s justification for the study: connecting it to theory and previous research. When presented well, conceptual evidence lays solid groundwork for the study and helps distinguish chance results from those that mor","cbCaiecrHntmI0yD","https://ap.wps.com/l/cbCaiecrHntmI0yD","pdf",317649,13,"English","# Abstract\n# Keywords\n# Krathwohl’s Judgments About Internal Validity\n## Internal validity: linking power\n# Conceptual Evidence\n## Explanation credibility\n## Translation validity\n# Table 1: Judgments Supporting Internal Validity and External Validity","[{\"question\":\"What are the two main criteria used to judge credibility in this paper?\",\"answer\":\"The paper uses David Krathwohl’s (2009) judgments of internal validity (linking power) and external validity (generalizing power). These assess whether variables are linked convincingly and whether findings generalize beyond the study.\"},{\"question\":\"What does internal validity mean in this context?\",\"answer\":\"Internal validity refers to the extent to which a study demonstrates that investigated variables are linked in a relationship. It focuses on explanation credibility, translation validity, demonstrated results, and eliminating rival explanations.\"},{\"question\":\"How does the paper suggest readers avoid biased takeaways from news articles?\",\"answer\":\"Readers should apply established research standards rather than rely on summaries in media. Evaluating internal and external validity helps determine whether conclusions are credible and generalizable based on the original research paper.\"}]","Judging the Credibility of Quantitative Student Ratings of Instruction Research - IDEA Paper 80 - August 2019 | PDF",1792061921,33]