[{"data":1,"prerenderedAt":-1},["ShallowReactive",2],{"doc-seo-580437-105":3,"detail-sidebar-cat-0-en-105":81,"doc-detail-580437-en":130},{"code":4,"msg":5,"data":6},0,"ok",{"site_id":7,"language":8,"slug":9,"title":10,"keywords":11,"description":12,"schema_data":13,"social_meta":74,"head_meta":76,"extra_data":78,"updated_unix":80},105,"en","standard-setting-with-artificial-neural-networks-timss-2015-mathematics-case-cut-off-score-determination-study","Standard Setting with Artificial Neural Networks: TIMSS 2015 Mathematics Case - Cut-off Score Determination Study","","This study demonstrates an optimal cut-off score determination method for interpreting total scores from an achievement test and an attitude scale using Artificial Neural Networks. Using multiple-choice responses from TIMSS 2015 Grade 8 Booklet-11 Mathematics and the Students Like Learning Mathematics Scale item responses from the TIMSS 2015 questionnaire, the data are analyzed with MATLAB R2017b. Results identify 45.5/0–100 as the best achievement-test cut-off (81% agreement) and 19.6/9–36 as the best scale cut-off (83% agreement).",{"@graph":14,"@context":73},[15,34,56],{"@type":16,"itemListElement":17},"BreadcrumbList",[18,23,27,31],{"item":19,"name":20,"@type":21,"position":22},"https://docshare.wps.com","Home","ListItem",1,{"item":24,"name":25,"@type":21,"position":26},"https://docshare.wps.com/document/","Document",2,{"item":28,"name":29,"@type":21,"position":30},"https://docshare.wps.com/document/research-report/","Research & Report",3,{"item":32,"name":10,"@type":21,"position":33},"https://docshare.wps.com/document/standard-setting-with-artificial-neural-networks-timss-2015-mathematics-case-cut-off-score-determination-study/580437/",4,{"url":32,"name":10,"@type":35,"image":36,"author":41,"headline":10,"publisher":44,"fileFormat":47,"inLanguage":8,"description":12,"dateModified":48,"datePublished":49,"encodingFormat":47,"isAccessibleForFree":50,"interactionStatistic":51},"DigitalDocument",{"url":37,"@type":38,"width":39,"height":40},"https://docshare.wps.com/thumbnails/standard-setting-with-artificial-neural-networks-timss-2015-mathematics-case-cut-off-score-determination-study/580437.png","ImageObject",300,407,{"name":42,"@type":43},"Levi","Person",{"url":19,"name":45,"@type":46},"DocShare","Organization","application/pdf","2026-11-15","2026-10-15",true,{"@type":52,"interactionType":53,"userInteractionCount":55},"InteractionCounter",{"@type":54},"ViewAction",5,{"@type":57,"mainEntity":58},"FAQPage",[59,65,69],{"name":60,"@type":61,"acceptedAnswer":62},"What is the aim of this study on standard setting?","Question",{"text":63,"@type":64},"To determine an optimal cut-off score for interpreting total scores from an achievement test and a learning-attitude scale using Artificial Neural Networks.","Answer",{"name":66,"@type":61,"acceptedAnswer":67},"Which TIMSS 2015 Grade 8 data sources are used?",{"text":68,"@type":64},"Booklet-11 Mathematics item responses from the TIMSS 2015 Turkey sample dataset and the Students Like Learning Mathematics Scale responses from the TIMSS 2015 Grade 8 Mathematics student questionnaire.",{"name":70,"@type":61,"acceptedAnswer":71},"What cut-off scores does the study recommend and how is agreement evaluated?",{"text":72,"@type":64},"It recommends 45.5/0–100 for Booklet-11 achievement scores with 81% agreement, and 19.6/9–36 for the SLLSS scale with 83% agreement using the study’s classification criteria.","https://schema.org",{"og:url":32,"og:type":75,"og:title":10,"og:site_name":45,"og:description":12},"article",{"robots":77,"canonical":32},"index,follow",{"doc_id":79,"site_id":7},580437,1792188801,{"code":4,"msg":82,"data":83},"success",[84,88,92,96,100,105,110,114,119,122,126],{"id":22,"doc_module":4,"doc_module_name":25,"category_name":85,"show_sort_weight":86,"slug":87},"Story & Novel",90,"story-novel",{"id":26,"doc_module":4,"doc_module_name":25,"category_name":89,"show_sort_weight":90,"slug":91},"Literature",80,"literature",{"id":33,"doc_module":4,"doc_module_name":25,"category_name":93,"show_sort_weight":94,"slug":95},"Exam",70,"exam",{"id":55,"doc_module":4,"doc_module_name":25,"category_name":97,"show_sort_weight":98,"slug":99},"Comic",60,"comic",{"id":101,"doc_module":4,"doc_module_name":25,"category_name":102,"show_sort_weight":103,"slug":104},6,"Technology",50,"technology",{"id":106,"doc_module":4,"doc_module_name":25,"category_name":107,"show_sort_weight":108,"slug":109},7,"Healthcare",40,"healthcare",{"id":111,"doc_module":4,"doc_module_name":25,"category_name":29,"show_sort_weight":112,"slug":113},8,30,"research-report",{"id":115,"doc_module":4,"doc_module_name":25,"category_name":116,"show_sort_weight":117,"slug":118},9,"Religion & Spirituality",20,"religion-spirituality",{"id":117,"doc_module":4,"doc_module_name":25,"category_name":120,"show_sort_weight":117,"slug":121},"World Cup","world-cup",{"id":123,"doc_module":4,"doc_module_name":25,"category_name":124,"show_sort_weight":123,"slug":125},10,"Lifestyle","lifestyle",{"id":127,"doc_module":4,"doc_module_name":25,"category_name":128,"show_sort_weight":55,"slug":129},19,"General","general",{"code":4,"msg":82,"data":131},{"doc_id":79,"user_id":132,"nickname":42,"user_avatar":133,"doc_module":4,"category_id":111,"category_name":29,"doc_title":10,"doc_description":12,"doc_content":134,"file_id":135,"file_url":136,"file_type":137,"file_size":138,"view_count":55,"is_deleted":4,"is_public":22,"is_downloadable":22,"audit_status":22,"page_count":123,"language":139,"language_code":8,"site_id":7,"html_lang":8,"table_of_contents":140,"faqs":141,"seo_title":142,"seo_description":12,"update_tm":143,"read_time":144,"preview_page_count":4},7971461740909,"https://ap-avatar.wpscdn.com/davatar_155a257f0dc6eb9ab79c44ca47cae57d","Standard Setting with Artificial Neural Networks: TIMSS 2015 Mathematics Case  \nMahmut Sami Koyuncu  \nAfyon Kocatepe University, Faculty of Education, Afyonkarahisar, TURKEY  \nReceived: 3 April 2023 ▪ Revised: 20 July 2023 ▪ Accepted: 30 July 2023  \nAbstract  \nThis study aims to demonstrate the optimal way to determine the cut-off score to be used to interpret the total scores obtained from an achievement test or scale using the Artificial Neural Networks method. To this end, the multiple-choice item responsesin the Booklet-11 Mathematics subtest at the 8th grade level in the TIMSS 2015 Turkey sample dataset were used to determine the cut-off score for the achievement test. The item responses in the “Students Like Learning Mathematics Scale” in the TIMSS 2015 8th grade Mathematics Student Questionnaire were used to determine the cut-off score for the scale. The data were accessed from the TIMSS international database and the data were analyzed in MATLAB R2017b software. As a result of the study, the most appropriate cut-off score to be used for the evaluation of the total scores obtained from the TIMSS 2015 8th grade level Booklet-11 Mathematics subtest was determined as 45.5 out of 0-100 points with the Artificial Neural Network analysis method. The overall level of agreement between the cut-off score and the pass/fail classification based on 400 points, which is the lowest level of the TIMSS International Benchmark, was determined as 81%. The most appropriate cutoff score to be used for the evaluation of the scores obtained from the Students Like Learning Mathematics Scale (SLLSS) in the TIMSS 2015 8th grade student survey was determined as 19.6 out of 9-36 points. The overall level of agreement between the cut-off score and the classification of students who like/don’t like learning mathematics using the criterion based on the expression given in the original scale description was found tobe 83%. The results concluded that the validity of the standard-setting studies conducted with the artificial neural network method was high. Asa result, researchers are recommended to use the Artificial Neural Networks method to determine the cut-off score tobe used in the interpretation of the total scores obtained from the achievement test or the total scale scores obtained from the scales.  \nKeywords: artificial neural networks, standard setting, cut-off score, TIMSS 2015.  \n1. Introduction  \nIt is essential to measure and evaluate achievement in education, recruitment, scientific research, and many other contexts. These measurements are a fundamental tool for assessing the performance of individuals or processes, making decisions, and monitoring progress. In measurement practices, the cut-off scores used to interpret the results of achievement tests or scales play a critical role. Cut-off score determination is also a standard-setting process. The literature hosts numerous standard setting methods. The current study addresses the Artificial Neural Networks (ANN) for standard setting.  \nANNs are among data mining models as statistical classification techniques based on a predictive approach. ANN is an artificial network system inspired by the neural network structure of the brain. It is a mathematical model of brain activities (Shah & Murtaza, 2000). ANN is similar to the brain in that information is acquired by passing through a learning process and using the link power among neurons to store this information (Haykin, 1999) . In this respect, the work of ANN is to gain learning, generalization, and recollection characteristics for the systems (Saraç, 2005) . ANN can be used for nonlinear, multidimensional, complex, uncertain, missing, and error-prone data, especially when no mathematical model or algorithm exists for solving problems. ANN performs functions of prediction, classification, data association, data filtering, recognition and matching, diagnosis, and interpretation (Öztemel, 2003) .  \nArtificial neural networks do not requi","cbCaiggmTyQBNe5V","https://ap.wps.com/l/cbCaiggmTyQBNe5V","pdf",826056,"English","# Introduction\n## Background and measurement role of cut-off scores\n## Artificial neural networks in education and data modeling\n## Standard-setting purpose and study contribution","[{\"question\":\"What is the aim of this study on standard setting?\",\"answer\":\"To determine an optimal cut-off score for interpreting total scores from an achievement test and a learning-attitude scale using Artificial Neural Networks.\"},{\"question\":\"Which TIMSS 2015 Grade 8 data sources are used?\",\"answer\":\"Booklet-11 Mathematics item responses from the TIMSS 2015 Turkey sample dataset and the Students Like Learning Mathematics Scale responses from the TIMSS 2015 Grade 8 Mathematics student questionnaire.\"},{\"question\":\"What cut-off scores does the study recommend and how is agreement evaluated?\",\"answer\":\"It recommends 45.5/0–100 for Booklet-11 achievement scores with 81% agreement, and 19.6/9–36 for the SLLSS scale with 83% agreement using the study’s classification criteria.\"}]","Standard Setting with Artificial Neural Networks: TIMSS 2015 Mathematics Case - Cut-off Score Determination Study | PDF",1792037620,25]