[{"data":1,"prerenderedAt":-1},["ShallowReactive",2],{"doc-detail-121223-en":3,"doc-seo-121223-105":30,"detail-sidebar-cat-0-en-105":91},{"code":4,"msg":5,"data":6},0,"success",{"doc_id":7,"user_id":8,"nickname":9,"user_avatar":10,"doc_module":4,"category_id":11,"category_name":12,"doc_title":13,"doc_description":14,"doc_content":15,"file_id":16,"file_url":17,"file_type":18,"file_size":19,"view_count":4,"is_deleted":4,"is_public":20,"is_downloadable":20,"audit_status":20,"page_count":21,"language":22,"language_code":23,"site_id":24,"html_lang":23,"table_of_contents":25,"faqs":26,"seo_title":27,"seo_description":14,"update_tm":28,"read_time":29},121223,7971461740909,"Levi","https://ap-avatar.wpscdn.com/davatar_155a257f0dc6eb9ab79c44ca47cae57d",8,"Research & Report","Classification of reflective writing - A comparative analysis with shallow machine learning and pre-trained language models","Reflective practice is crucial in higher education and teacher education, but developing students’ reflective skills remains difficult. Building on sentence-level classification, this study targets document-level understanding of reflective writing by applying shallow machine learning and pre-trained language models, including BERT, RoBERTa, BigBird, and Longformer. A dataset of 1,043 reflective writings from a German teacher education program was used. Results show BigBird and Longformer outperform BERT and RoBERTa, and shallow models remain below 60% accuracy. Findings support improved automated feedback for teacher education.","Classification of reflective writing: A comparative analysis with shallow machine learning and pre-trained language models  \nChengming Zhang1 · Florian Hofmann1 · Lea Plößl1 · Michaela Gläser‑Zikuda1  \nReceived: 15 November 2023 / Accepted: 14 April 2024 / Published online: 2 May 2024 © The Author(s) 2024  \nAbstract  \nReflective practice holds critical importance, for example, in higher education and teacher education, yet promoting students’ reflective skills has been a persistent challenge. The emergence of revolutionary artificial intelligence technologies, notably in machine learning and large language models, heralds potential breakthroughsin this domain. The current research on analyzing reflective writing hinges on sentence-level classification. Such an approach, however, may fall short of providing a holistic grasp of written reflection. Therefore, this study employs shallow machine learning algorithms and pre-trained language models, namely BERT, RoBERTa, BigBird, and Longformer, with the intention of enhancing the document-level classification accuracy of reflective writings. A dataset of 1,043 reflective writings was collected in a teacher education program at a German university (M = 251.38 words, SD = 143.08 words) . Our findings indicated that BigBird and Longformer models significantly outperformed BERT and RoBERTa, achieving classification accuracies of 76.26% and 77.22%, respectively, with less than 60% accuracy observed in shallow machine learning models. The outcomes of this study contribute to refining document-level classification of reflective writings and have implications for augmenting automated feedback mechanisms in teacher education.  \nKeywords Reflective writing · Pre-trained language model · Shallow machine learning · AI feedback · Teacher education  \n1 Introduction  \nThe dawn of the Artificial Intelligence (AI) era has brought about transformative educational changes. From profiling and prediction to automated assessment and personalized learning, the increasing use of AI applications is evidence of its burgeoning influence (Zawacki-Richter et al., 2019 ; Zhai et al., 2021) . One particularly  \nExtended author information available on the last page of the article  \nimpactful instance of AI’s utility is the deployment of Large Language Models (LLMs) like ChatGPT. This powerful tool can support students in problem-solving, personalized guidance, feedback provision, and other areas. Interestingly, the benefits of AI feedback have been empirically quantified. For instance, a meta-analysis by Cai et al. (2023) revealed a moderate positive impact of feedback on academic achievement in technology-rich learning environments compared to traditional feedback-absent environments. These findings hint at AI’s potential to address longstanding educational challenges, especially those related to providing timely, personalized feedback (Russell & Korthagen, 2013) . In light of these developments, the fusion of machine learning (ML) and natural language processing (NLP) technologies may present an efficient way to meet students’ diverse learning needs.  \nIn the rapidly evolving educational technology landscape, a significant breakthrough has occurred in using AI for assessment, particularly concerning reflective writing. Reflection forms an essential bridge between theoretical knowledge and practical application (Korthagen & Vasalos, 2005) . Despite the deployment of various approaches aiming to bolster reflective practice, the endeavor has encountered constraints, primarily due to the multifaceted nature of reflective writing, which poses a challenge for evaluation (Körkkö et al., 2016 ; Poldner et al., 2014 ; Ullmann, 2019) . Recent researches indicate that shallow ML and pre-trained language models are particularly effective in assessing reflective writing, marking a significant advancement in this field (Nehyba & Štefánik, 2023 ; Solopova et al., 2023 ; Wulff et al., 2023) . Moreover, AI’s role in assessing s","cbCairduIl5qbeM2","https://ap.wps.com/l/cbCairduIl5qbeM2","pdf",1011248,1,27,"English","en",105,"# Abstract\n# Introduction\n## Motivation for AI-assisted feedback\n## Challenges in dataset quality and sentence-level modeling\n## Study aims and document-level methodology\n## Models and data overview","[{\"question\":\"Why is reflective writing difficult to assess automatically?\",\"answer\":\"Reflective writing contains intrinsic narrative coherence, so sentence-level classification can miss context and important information in the broader text.\"},{\"question\":\"What models are used to classify reflective writing in this study?\",\"answer\":\"The study applies shallow machine learning algorithms and pre-trained language models including BERT, RoBERTa, BigBird, and Longformer, using a document-level classification approach.\"},{\"question\":\"Which models performed best and what accuracy ranges were observed?\",\"answer\":\"BigBird and Longformer significantly outperformed BERT and RoBERTa, achieving about 76.26% and 77.22% accuracy respectively, while shallow machine learning models stayed below 60% accuracy.\"}]","Classification of reflective writing - A comparative analysis with shallow machine learning and pre-trained language models | PDF",1785734428,68,{"code":4,"msg":31,"data":32},"ok",{"site_id":24,"language":23,"slug":33,"title":13,"keywords":34,"description":14,"schema_data":35,"social_meta":86,"head_meta":88,"extra_data":90,"updated_unix":28},"classification-of-reflective-writing-a-comparative-analysis-with-shallow-machine-learning-and-pre-trained-language-models","",{"@graph":36,"@context":85},[37,54,68],{"@type":38,"itemListElement":39},"BreadcrumbList",[40,44,48,51],{"item":41,"name":42,"@type":43,"position":20},"https://docshare.wps.com","Home","ListItem",{"item":45,"name":46,"@type":43,"position":47},"https://docshare.wps.com/document/","Document",2,{"item":49,"name":12,"@type":43,"position":50},"https://docshare.wps.com/document/research-report/",3,{"item":52,"name":13,"@type":43,"position":53},"https://docshare.wps.com/document/classification-of-reflective-writing-a-comparative-analysis-with-shallow-machine-learning-and-pre-trained-language-models/121223/",4,{"url":52,"name":13,"@type":55,"author":56,"headline":13,"publisher":58,"fileFormat":61,"inLanguage":23,"description":14,"dateModified":62,"datePublished":62,"encodingFormat":61,"isAccessibleForFree":63,"interactionStatistic":64},"DigitalDocument",{"name":9,"@type":57},"Person",{"url":41,"name":59,"@type":60},"DocShare","Organization","application/pdf","2026-08-03",true,{"@type":65,"interactionType":66,"userInteractionCount":4},"InteractionCounter",{"@type":67},"ViewAction",{"@type":69,"mainEntity":70},"FAQPage",[71,77,81],{"name":72,"@type":73,"acceptedAnswer":74},"Why is reflective writing difficult to assess automatically?","Question",{"text":75,"@type":76},"Reflective writing contains intrinsic narrative coherence, so sentence-level classification can miss context and important information in the broader text.","Answer",{"name":78,"@type":73,"acceptedAnswer":79},"What models are used to classify reflective writing in this study?",{"text":80,"@type":76},"The study applies shallow machine learning algorithms and pre-trained language models including BERT, RoBERTa, BigBird, and Longformer, using a document-level classification approach.",{"name":82,"@type":73,"acceptedAnswer":83},"Which models performed best and what accuracy ranges were observed?",{"text":84,"@type":76},"BigBird and Longformer significantly outperformed BERT and RoBERTa, achieving about 76.26% and 77.22% accuracy respectively, while shallow machine learning models stayed below 60% accuracy.","https://schema.org",{"og:url":52,"og:type":87,"og:title":13,"og:site_name":59,"og:description":14},"article",{"robots":89,"canonical":52},"index,follow",{"doc_id":7,"site_id":24},{"code":4,"msg":5,"data":92},[93,97,101,105,110,115,120,123,128,131,135],{"id":20,"doc_module":4,"doc_module_name":46,"category_name":94,"show_sort_weight":95,"slug":96},"Story & Novel",90,"story-novel",{"id":47,"doc_module":4,"doc_module_name":46,"category_name":98,"show_sort_weight":99,"slug":100},"Literature",80,"literature",{"id":53,"doc_module":4,"doc_module_name":46,"category_name":102,"show_sort_weight":103,"slug":104},"Exam",70,"exam",{"id":106,"doc_module":4,"doc_module_name":46,"category_name":107,"show_sort_weight":108,"slug":109},5,"Comic",60,"comic",{"id":111,"doc_module":4,"doc_module_name":46,"category_name":112,"show_sort_weight":113,"slug":114},6,"Technology",50,"technology",{"id":116,"doc_module":4,"doc_module_name":46,"category_name":117,"show_sort_weight":118,"slug":119},7,"Healthcare",40,"healthcare",{"id":11,"doc_module":4,"doc_module_name":46,"category_name":12,"show_sort_weight":121,"slug":122},30,"research-report",{"id":124,"doc_module":4,"doc_module_name":46,"category_name":125,"show_sort_weight":126,"slug":127},9,"Religion & Spirituality",20,"religion-spirituality",{"id":126,"doc_module":4,"doc_module_name":46,"category_name":129,"show_sort_weight":126,"slug":130},"World Cup","world-cup",{"id":132,"doc_module":4,"doc_module_name":46,"category_name":133,"show_sort_weight":132,"slug":134},10,"Lifestyle","lifestyle",{"id":136,"doc_module":4,"doc_module_name":46,"category_name":137,"show_sort_weight":106,"slug":138},19,"General","general"]