From Helping Hand to Stumbling Block: The ChatGPT Paradox in Competency Experiment
CESifo, Munich, 2024
CESifo Working Paper No. 11002
We ran a controlled laboratory experiment to examine whether ChatGPT’s aid can increase the participants’ performance in three different—reading and writing, mathematical problem-solving, and computational thinking—tasks. We find that the math score significantly decreases with ChatGPT’s assistance. This result is mainly because the low-ability subjects couldn’t discern the hallucinated answers with the correct ones, and it contests the general idea that ChatGPT can complement the workers with less expertise.
Behavioural Economics
Economics of Digitization