Implementation and Evaluation of a ChatGPT-Assisted Special Topics Writing Assignment in Biochemistry

Sep 21, 2026

Uploaded by Callum

The effective and responsible educational use of ChatGPT and other generative artificial intelligence tools is an active research focus. This study implements and evaluates a structured GenAI-assisted scientific essay writing assignment in nucleic acid biochemistry. Students created, assessed, and iteratively refined ChatGPT essays using feedback and independent literature research, revealing strengths and weaknesses in LLM writing and citation practices. Most students reported improved understanding of GenAI functionality, prompt engineering, and willingness to use additional GenAI applications; however, AI-produced citations were frequently inaccurate, with 26% of references found nonexistent.

LanguageEnglish

CategoryResearch & Report

FormatPDF

Pages9

Reading Time23 min

AccessFree to download

Introduction

Background and motivation for GenAI in education

Abstract and study description

Structured GenAI-assisted scientific essay assignment

Student workflow, evaluation, and iterative refinement

Findings and implications

Strengths and shortcomings of LLM writing

Citation reliability concerns

Potential for adaptation to other scientific contexts

. [pubs.acs.org/jchemeduc](pubs.acs.org/jchemeduc) Article Implementation and Evaluation of a ChatGPT-Assisted Special Topics Writing Assignment in Biochemistry Published as part of Journal of Chemical Education virtual special issue “Investigating the Uses and Impacts of Generative Artificial Intelligence in Chemistry Education”. Manik R. Reddy, Nils G. Walter, * and Yulia V. Sevryugina * Cite This: J. Chem. Educ. 2024, 101, 2740−2748 Read Online Downloaded via UNIV OF MICHIGAN ANN ARBOR on August 27, 2024 at 17:55:38 (UTC) . See [https://pubs.acs.org/sharingguidelines](https://pubs.acs.org/sharingguidelines) for options on how to legitimately share published articles ACCESS Metrics & More Article Recommendations *sı Supporting Information ABSTRACT: The effective and responsible educational application of ChatGPT and other generative artificial intelligence (GenAI) tools constitutes an active area of exploration. This study describes and assesses the implementation of a structured, GenAI-assisted scientific essay writing assignment in nucleic acid biochemistry. Briefly, students created, evaluated, and iteratively refined ChatGPT essays in response to feedback and independent literature research, identifying several strengths and shortcomings of large language model writing and citation practices. The scaffolded assignment structure aimed to prepare students for GenAIassisted writing, and the majority of the class cohort ultimately indicated an improved understanding of GenAI functionality and prompt engineering, as well as interest in additional GenAI usage and applications. Moreover, students valued the instructional guidance on engagement with GenAI tools and the prompt engineering opportunities afforded by this exercise. However, discontentment with AI-produced citations was common, and 26% of supporting references were found to be nonexistent. The content evaluation and prompt generation strategies uncovered here may facilitate successful ChatGPT-guided writing assignmentsin other scientific contexts. KEYWORDS: General Public, Upper-Division Undergraduate, Graduate Education/Research, Communication/Writing, Computer-Based Learning, Biochemistry, Nucleic Acids/DNA/RNA ■ INTRODUCTION Chat Generative Pretrained Transformer (ChatGPT) is a generative artificial intelligence (GenAI) chatbot1 that has received widespread attention due to its versatility and humanlike responses.2,3 The chatbot illustrates the capabilities of recently developed large language models (LLMs), which utilize deep neural networks to transform user prompts into predicted natural language word sequences.4,5 Several technology companies have responded to the emergence of ChatGPT by launching analogous chatbots,6,7 while ChatGPT functionality has continued to evolve rapidly.4,5,8 Consequently, GenAI chatbots are increasingly utilized in academia as writing, editing, and coding assistants, as well as to generate ideas and summarize literature.9−11 The potential applications of GenAI tools in education have attracted considerable interest and concern. 12−14 GenAI chatbots are being employed to construct tutoring environments customized for individual students, 15, 16 facilitate group activities, enhance language-learning, and assist visually impaired students.17 Educators have suggested that readily obtainable GenAI output may reduce instructor workload and help students create innovative projects, 15 but may also deter learners from pursuing original research. 16 Furthermore, educators have expressed concern that ChatGPT will render traditional assessment strategies obsolete and hinder accurate evaluation of student performance. 12−18 Additionally, some students may be reluctant to utilize GenAI tools if interactions with chatbots are recorded and utilized by LLM developers.15 More broadly, LLMs are optimized for probabilistic natural language generation rather than informational accuracy, and may therefore yield e

FAQs

What educational assignment does the study implement in nucleic acid biochemistry?

The study implements a structured GenAI-assisted scientific essay writing assignment where students create, evaluate, and iteratively refine ChatGPT essays using feedback and independent literature research.

What did students report about their learning from the GenAI-assisted writing experience?

Most students indicated improved understanding of GenAI functionality and prompt engineering, along with interest in additional GenAI usage and the value of instructional guidance and prompt engineering opportunities.

What problem did the study identify regarding AI-generated citations?

Discontentment with AI-produced citations was common, and 26% of supporting references were found to be nonexistent.

Sep 21, 2026

Uploaded by Callum