[{"data":1,"prerenderedAt":-1},["ShallowReactive",2],{"doc-seo-589673-105":3,"detail-sidebar-cat-0-en-105":81,"doc-detail-589673-en":130},{"code":4,"msg":5,"data":6},0,"ok",{"site_id":7,"language":8,"slug":9,"title":10,"keywords":11,"description":12,"schema_data":13,"social_meta":74,"head_meta":76,"extra_data":78,"updated_unix":80},105,"en","materials-for-assessing-the-writing-skill-authoring-and-developing-valid-esl-writing-scales","Materials for Assessing the Writing Skill - Authoring and Developing Valid ESL Writing Scales","","Reviews issues in developing writing-scale instruments for English as a Second Language (ESL) settings, aiming to guide researchers and writing teachers in creating valid, reliable, and efficient scales for specific assessment contexts. Explains the rationale for writing scales and structures scale development into three phases: design, operationalization, and administration. Discusses sample analysis, scale type selection, criteria setting, definition operationalization, numerical value assignment, trait weighting, and guidance on proper scale use while addressing validity and reliability concerns.",{"@graph":14,"@context":73},[15,34,56],{"@type":16,"itemListElement":17},"BreadcrumbList",[18,23,27,31],{"item":19,"name":20,"@type":21,"position":22},"https://docshare.wps.com","Home","ListItem",1,{"item":24,"name":25,"@type":21,"position":26},"https://docshare.wps.com/document/","Document",2,{"item":28,"name":29,"@type":21,"position":30},"https://docshare.wps.com/document/exam/","Exam",3,{"item":32,"name":10,"@type":21,"position":33},"https://docshare.wps.com/document/materials-for-assessing-the-writing-skill-authoring-and-developing-valid-esl-writing-scales/589673/",4,{"url":32,"name":10,"@type":35,"image":36,"author":41,"headline":10,"publisher":44,"fileFormat":47,"inLanguage":8,"description":12,"dateModified":48,"datePublished":49,"encodingFormat":47,"isAccessibleForFree":50,"interactionStatistic":51},"DigitalDocument",{"url":37,"@type":38,"width":39,"height":40},"https://docshare.wps.com/thumbnails/materials-for-assessing-the-writing-skill-authoring-and-developing-valid-esl-writing-scales/589673.png","ImageObject",300,407,{"name":42,"@type":43},"Cipher","Person",{"url":19,"name":45,"@type":46},"DocShare","Organization","application/pdf","2026-10-30","2026-10-15",true,{"@type":52,"interactionType":53,"userInteractionCount":55},"InteractionCounter",{"@type":54},"ViewAction",5,{"@type":57,"mainEntity":58},"FAQPage",[59,65,69],{"name":60,"@type":61,"acceptedAnswer":62},"What are the three phases of writing scale development discussed in the paper?","Question",{"text":63,"@type":64},"The paper divides development into three phases: design, operationalization, and administration, following a test-development framework.","Answer",{"name":66,"@type":61,"acceptedAnswer":67},"How does the paper suggest choosing the type of writing scale?",{"text":68,"@type":64},"It discusses classification into generic, task-specific, and genre-specific scales, and also notes that scales may be holistic or analytic depending on how scoring dimensions are handled.",{"name":70,"@type":61,"acceptedAnswer":71},"Why does the paper caution against designing writing scales in an ad hoc manner?",{"text":72,"@type":64},"It argues that ad hoc design and application can undermine reliability, validity, and/or efficiency, producing inconsistent and unfair assessment outcomes.","https://schema.org",{"og:url":32,"og:type":75,"og:title":10,"og:site_name":45,"og:description":12},"article",{"robots":77,"canonical":32},"index,follow",{"doc_id":79,"site_id":7},589673,1792458332,{"code":4,"msg":82,"data":83},"success",[84,88,92,95,99,104,109,114,119,122,126],{"id":22,"doc_module":4,"doc_module_name":25,"category_name":85,"show_sort_weight":86,"slug":87},"Story & Novel",90,"story-novel",{"id":26,"doc_module":4,"doc_module_name":25,"category_name":89,"show_sort_weight":90,"slug":91},"Literature",80,"literature",{"id":33,"doc_module":4,"doc_module_name":25,"category_name":29,"show_sort_weight":93,"slug":94},70,"exam",{"id":55,"doc_module":4,"doc_module_name":25,"category_name":96,"show_sort_weight":97,"slug":98},"Comic",60,"comic",{"id":100,"doc_module":4,"doc_module_name":25,"category_name":101,"show_sort_weight":102,"slug":103},6,"Technology",50,"technology",{"id":105,"doc_module":4,"doc_module_name":25,"category_name":106,"show_sort_weight":107,"slug":108},7,"Healthcare",40,"healthcare",{"id":110,"doc_module":4,"doc_module_name":25,"category_name":111,"show_sort_weight":112,"slug":113},8,"Research & Report",30,"research-report",{"id":115,"doc_module":4,"doc_module_name":25,"category_name":116,"show_sort_weight":117,"slug":118},9,"Religion & Spirituality",20,"religion-spirituality",{"id":117,"doc_module":4,"doc_module_name":25,"category_name":120,"show_sort_weight":117,"slug":121},"World Cup","world-cup",{"id":123,"doc_module":4,"doc_module_name":25,"category_name":124,"show_sort_weight":123,"slug":125},10,"Lifestyle","lifestyle",{"id":127,"doc_module":4,"doc_module_name":25,"category_name":128,"show_sort_weight":55,"slug":129},19,"General","general",{"code":4,"msg":82,"data":131},{"doc_id":79,"user_id":132,"nickname":42,"user_avatar":133,"doc_module":4,"category_id":33,"category_name":29,"doc_title":10,"doc_description":12,"doc_content":134,"file_id":135,"file_url":136,"file_type":137,"file_size":138,"view_count":55,"is_deleted":4,"is_public":22,"is_downloadable":22,"audit_status":22,"page_count":139,"language":140,"language_code":8,"site_id":7,"html_lang":8,"table_of_contents":141,"faqs":142,"seo_title":143,"seo_description":12,"update_tm":144,"read_time":145,"preview_page_count":4},687208528416,"https://ap-avatar.wpscdn.com/davatar_9964176cb1d06d4a9deccf72a44ae3dc","Materials for Assessing the Writing Skill  \nVahid Nimehchisalem  \ndoi:10.7575/aiac.alls.v.1n.2p.233  \nAbstract  \nThis paper reviews the issues of concern in writing scale development in English as Second Language (ESL) settings with an intention to provide a useful guide for researchers or writing teachers who wish to develop or adapt valid, reliable and efficient writing scales considering their present assessment situations. With a brief discussion on the rationale behind writing scales, the author considers the process of scale development by breaking it into three phases of design, operationalization and administration. The issues discussed in the first phase include analyzing the samples, deciding on the type of scale and ensuring the validity of its design. Phase two encompasses setting the scale criteria, operationalization of definitions, setting a numerical value, assigning an appropriate weight for each trait, accounting for validity and reliability. The final phase comprises recommendations on how a writing scale should be used.  \nIntroduction  \nMaterials developed for assessing writing have undergone a good deal of change. During the dominance of product-based approach timed compositions were common. These direct writing tests were often scored impressionistically which  \nresulting scores (Cooper & Odell, 1999) . Giving the primary emphasis to speaking, Audio-lingual method, on the other hand, generated indirect multiplechoice items which were more reliable and objective (Crusan, 2002), and yet neglected global writing skills (Attali & Powers, 2008), leading to validity and authenticity problems (Hamp-Lyons, 2001 ; Bachman & Palmer, 1996 ; White, 1994) and efficiency problems (Williamson, 1994) . Therefore, once again interest revived in a type of essay tests in which the problem of subjective assessment of the written samples could to be solved. These materials with their explicit evaluative criteria, also known as rubrics or range-finders, would allow the rater to avoid implicit or impressionistic rating methods which often lack consistency and lead to unfair results. Writing scales, however, should not be designed and applied in an ad hoc manner; otherwise, they will lack reliability, validity and/or efficiency.  \nThis paper considers the areas of concern in writing scale development. Following the framework of test development (Bachman & Palmer, 1996), it divides the process into three phases of design, operationalization and administration. Then, it discusses the issues that may rise in each of these phases and the important points that developers should regard in developing writing scales.  \nPhase One: Design  \nThe area of writing evaluation is heavily researched making it easy to experience a good deal of confusion after one has reviewed the literature. Therefore, it is necessary that one avoid certain starting points that can turn to tar pits. For instance, setting off to design a scale by mapping the dimensions of the writing  \nconstruct through a review of the literature and the available scales may result in a  \nassessment situation even though its criteria that are considered essential parts of writing construct but that may be. For example, consider how variations in the age group or level of proficiency of the student writers can lead to very different written products that without any doubt will call for scales that ought to emphasize or eliminate certain aspects of writing. This section discusses the preliminary issues in scale development.  \nAnalyzing the target samples  \nThe primary issue about which any developer ought to be concerned is what sort of written works of what group of learners are going to be assessed using the designed scale. As it is the common practice among scale designers, the best dell (1981, p.  \nthat seem most important for the students we  \nDeveloping a scale by an analysis of the target samples may result in a list of descriptions that eventually can be used as the descript","cbCaiqIzeCSma9Fv","https://ap.wps.com/l/cbCaiqIzeCSma9Fv","pdf",920143,23,"English","# Abstract\n# Introduction\n# Phase One: Design\n## Analyzing the target samples\n## Determining the type of scale","[{\"question\":\"What are the three phases of writing scale development discussed in the paper?\",\"answer\":\"The paper divides development into three phases: design, operationalization, and administration, following a test-development framework.\"},{\"question\":\"How does the paper suggest choosing the type of writing scale?\",\"answer\":\"It discusses classification into generic, task-specific, and genre-specific scales, and also notes that scales may be holistic or analytic depending on how scoring dimensions are handled.\"},{\"question\":\"Why does the paper caution against designing writing scales in an ad hoc manner?\",\"answer\":\"It argues that ad hoc design and application can undermine reliability, validity, and/or efficiency, producing inconsistent and unfair assessment outcomes.\"}]","Materials for Assessing the Writing Skill - Authoring and Developing Valid ESL Writing Scales | PDF",1792067896,58]