Development of a Scoring Key to Evaluate Creative Story Writing Levels of Seventh Grade Students

Q: What is the main purpose of the study?

The study aims to develop a scoring rubric to evaluate seventh grade students’ creative story writing skill levels.

Q: How was the scoring rubric developed?

The researchers conducted a literature review, consulted academicians, teachers, and graduate students to build an item pool, obtained field expert feedback, and applied a draft scale to the sample group.

Q: How did the study assess reliability and consistency among raters?

Reliability was supported using Cronbach’s Alpha for scale items across sub-dimensions, and rater consistency was examined using Cohen’s Kappa with a reported significant level of agreement.

Oct 15, 2026

Uploaded by MrHarris58

This study develops a rubric and scoring key to evaluate the creative story writing skill levels of seventh grade secondary school students. Using a quantitative research design with a survey model, it applies convenience sampling with 270 seventh graders. An item pool is created through literature review and expert consultation, then assessed via expert review and a draft application. Results show high inter-rater consistency, appropriate content and criterion validity, and reliability supported by Cronbach’s Alpha and Cohen’s Kappa. The final rubric includes 6 dimensions and 24 items with five agreement levels.

LanguageEnglish

CategoryExam

FormatPDF

Pages16

Reading Time40 min

AccessFree to download

Abstract

Introduction

Rationale for creative and productive thinking

21st century skills and expectations

Creativity and its role in education

Definitions of creative thinking

Language education and writing skill

Development of a Scoring Key to Evaluate the Creative Story Writing Levels of Secondary School Seventh Grade Students1 Ebru ÖZTÜRK2 Usak University Erol DURAN3 Usak University Abstract In this study, it was aimed to develop a rubric to evaluate the creative story writing skill levels of seventh grade secondary school students. The research was designed in quantitative research method and survey model. In the research, convenience sampling technique was used and 270 students studying at the seventh grade level of secondary school were studied. In the process of creating the item pool of the research, 11 academicians, 8 teachers and 7 graduate students were consulted. In order to create an item pool, firstly, a literature review was conducted. The prepared item pool was presented to the field experts and the draft scale was applied to the sample group. As a result of the findings obtained, it was concluded that there was a high level of consistency between the evaluations made by different raters. The validity studies of the scale were conducted and it was determined that the content and criterion validity were appropriate. In order to determine the reliability of the scale items, Cronbach's Alpha value was determined. It was determined that the Cronbach's Alpha value of the scale with all sub-dimensions was above 0.7. Cohen's Kappa statistic (κ) was used to ensure internal consistency between raters (p<.05) . As a result of the analyses, it was determined that there was almost perfect agreement in the items in the scale. Finally, Cohen's Kappa coefficient was determined to determine whether there was agreement between the raters, and a significant level of agreement was found between the raters of the scale. In addition, as a result of the results obtained from the expert opinions, it was decided that the rubric should consist of 6 dimensions and 24 items in total, namely "imagination", "originality", "different perspective", "content", "language and expression", "form", and five levels, namely "strongly agree","agree", "partially agree", "disagree" and "strongly disagree". Keywords: Writing, creative writing, rubric DOI: 10.29329/epasr.2024.655.1 Submitted:27 December 2023 Accepted: 26 February 2024 Published: 31 March 2024 1 It was produced from the doctoral dissertation titled "The Use of Orff-Schulwerk Approach in Developing Creative Story Writing Skills of Seventh Grade Secondary School Students". 2 PhD Student, Institute of Graduate Studies, [ebruozturkk43@gmail.com](ebruozturkk43@gmail.com), ORCID ID: 0000-0002-4995-9496 3 Prof. Dr., Uşak University Faculty of Education, [erol.duran@usak.edu.tr](erol.duran@usak.edu.tr), ORCID ID: 0000-0001-7581-3821 Introduction Today, the most problematic situation in interpersonal social relations, in the daily routines of family members, and in educational activities carried out with students in educational environments is the desire of individuals to achieve success without being productive, without labouring, without spending time and effort. Technological developments and rapid change in the information world feed this desire. Individuals can now access the information they want with a single "click" and solve many problems in seconds without spending time. This situation pushes individuals towards simplicity and makes information worthless. The fact that today's children, who are moulded with ready-made knowledge and quickly get bored with actions that require a long process, have this point of view will cause them to be defined as"unqualified". In order for children to become individuals in accordance with the requirements of the age and to carry the qualities of the changing world on them, creative and productive thinking skills of individuals should be developed and it should be ensured that they use these skills effectively in the widest area. Changes in every field have changed the meanings attributed to skill areas. The information about 21st

FAQs

What is the main purpose of the study?

The study aims to develop a scoring rubric to evaluate seventh grade students’ creative story writing skill levels.

How was the scoring rubric developed?

The researchers conducted a literature review, consulted academicians, teachers, and graduate students to build an item pool, obtained field expert feedback, and applied a draft scale to the sample group.

How did the study assess reliability and consistency among raters?

Reliability was supported using Cronbach’s Alpha for scale items across sub-dimensions, and rater consistency was examined using Cohen’s Kappa with a reported significant level of agreement.

Oct 15, 2026

Uploaded by MrHarris58