A Randomized Controlled Trial on the Impact of Using Generative Artificial Intelligence on Analytical Writing Performance and Cognitive Abilities
试验速览
- 阶段
- 不适用
- 状态
- 已完成
- 入组人数
- 160
- 试验地点
- 1
- 主要终点
- Writing Performance
研究概览
简要总结
The goal of this randomized controlled lab experiment is to examine if using generated artificial intelligence (AI) technology will affect people's academic performance and cognitive abilities in the context of analytical writing among college students. The main questions it aims to answer are:
- Does using the technology affect students' writing performance?
- Does using the technology affect students' cognitive effort during the writing process?
Participants will be randomly assigned to either a control group, which is writing without AI assistance, or an experimental group, which is writing with the assistance of ChatGPT. Researchers will compare the two groups to see if ChatGPT affects students' writing performance and cognitive effort.
For each participant, the lab experiment will last for no more than 1.5 hours. An eye-tracker will monitor the participant's gaze activities and pupil size. A functional near-infrared spectroscopy (fNIRS) will monitor the participant's brain activities in the frontal lobe. During the experiment, participants will be asked to:
- Read learning materials on analytical writing techniques.
- Based on the previously provided materials, complete an analytical writing assignment that will take approximately 30 minutes either with or without the aid of ChatGPT.
- Answer survey questions about their experience with the writing assignment, attitudes on using ChatGPT, and demographic backgrounds.
研究设计
- 研究类型
- Interventional
- 分配方式
- Randomized
- 干预模型
- Parallel
- 主要目的
- Other
- 盲法
- Single (Participant)
入排标准
- 年龄范围
- 18 Years 至 35 Years（Adult）
- 性别
- All
- 接受健康志愿者
- 是
入选标准
- •Full-time university student.
- •Able to read and write in English.
- •Use the computer most days of the week.
- •Have not taken, nor currently preparing for, the Graduate Record Examinations (GRE).
- •Do not wear glasses (contact lenses are allowed).
- •Have no eye impairment.
- •Not currently taking any opioids, epinephrine, or anti-hypertensive drugs.
- •During the experiment, not wearing any makeup around the eyes.
排除标准
- 未提供
结局指标
主要结局
Writing Performance
时间窗: 1.5 hours
The essay writing task is derived from the Analytical Writing section in the Graduate Record Examinations (GRE), which is a worldwide and standardized computer-based exam developed by the Educational Testing Service (ETS). The participants' essays will be scored on a scale from 0 to 6 by an automatic and validated third-party scoring tool that is also developed by ETS.
Cognitive Effort Measured by Pupil Size
时间窗: 1.5 hours
Cognitive effort is quantified by monitoring changes in pupil size. To achieve this, pupil diameters are recorded throughout the writing task using a near-infrared eye tracker, specifically the Tobii Pro Fusion model. At the start of the experiment, individual baseline pupil diameters are measured during a 30-second relaxation task.
次要结局
- Cognitive Effort Measured by Cortical Hemodynamic Activity in the Frontal Lobe(1.5 hours)
- Self-Perception of Writing Performance(1.5 hours)
- Self-Perception of Stress(1.5 hours)
- Self-Perception of Challenge(1.5 hours)
- Self-Perception of Cognitive Effort(1.5 hours)
- Self-Efficacy in Writing(1.5 hours)
- Situational Interest in Analytical Writing(1.5 hours)
- Behavioral Intention in Using ChatGPT(1.5 hours)
研究者
Simiao Chen
Professor
University Hospital Heidelberg