按年被提到
20232023 · 2 次2026
大模型与语言模型›对话式大模型·arXiv:2304.14276 · cs.CL

AI, write an essay for me: A large-scale comparison of human-written versus ChatGPT-generated essays

Steffen Herbold, Annette Hautli-Janisz, Ute Heuer, Zlata Kikteva, Alexander Trautsch · 2023
开始阅读 ↗PDFalphaXiv 讨论
被提及 · 2 人首次 2023-05-31 · 最近 2023-07-12
2不同的人
2活跃月份
2讨论串
18被引(OpenAlex)
arXiv 摘要(候选层不写导读)

Background: Recently, ChatGPT and similar generative AI models have attracted hundreds of millions of users and become part of the public discourse. Many believe that such models will disrupt society and will result in a significant change in the education system and information generation in the future. So far, this belief is based on either colloquial evidence or benchmarks from the owners of the models -- both lack scientific rigour. Objective: Through a large-scale study comparing human-written versus ChatGPT-generated argumentative student essays, we systematically assess the quality of the AI-generated content. Methods: A large corpus of essays was rated using standard criteria by a large number of human experts (teachers). We augment the analysis with a consideration of the linguistic characteristics of the generated essays. Results: Our results demonstrate that ChatGPT generates essays that are rated higher for quality than human-written essays. The writing style of the AI models exhibits linguistic characteristics that are different from those of the human-written essays, e.g., it is characterized by fewer discourse and epistemic markers, but more nominalizations and greater lexical diversity. Conclusions: Our results clearly demonstrate that models like ChatGPT outperform humans in generating argumentative essays. Since the technology is readily available for anyone to use, educators must act immediately. We must re-invent homework and develop teaching concepts that utilize these AI models in the same way as math utilized the calculator: teach the general concepts first and then use AI tools to free up time for other learning objectives.

候选层:至少 2 个不同的人、在 2 个不同月份提到过,还没到主书架的 3 人 3 个月。没有做立场标注,所以只写“被提及”。

HN 书评

没有评论直接链到它;下面是它被提交的讨论串里回复最多的评论(不计入统计)
讨论串评论jruohonen · 2023-05

“Yes but: "Our data also shows that hallucinations are not a problem in the setting of argumentative essay writing: the essay topics are not really about factual correctness, but rather about argumentation and critical reflection on general concepts which seem to be contained within the knowledge of the AI model." Seems like a time to revise the concept …”

AI, write an essay for me: A comparison of human vs. ChatGPT-generated essays原评论 ↗
讨论串评论romanichm12 · 2023-07

“The paper linked is a large-scale study comparing human-written versus AI-generated argumentative student essays. The researchers used a large corpus of essays and had them rated by human experts (teachers) using standard criteria. They also analyzed the linguistic characteristics of the generated essays https://www.linkedin.com/pulse/top-5-best-ai-essay-…”

AI's Essays Outperform Humans (Research)原评论 ↗
讨论串评论mintaka5 · 2023-07

“but is quality of an essay a artificially derived standard? i mean we can talk about how great the material is that is produced, but seriously, folks, aren't we chasing our tails here? is an AI good at wirting essays because of its own standard of quality or is it being measured against our own already established low bar? i mean if we're saying the compu…”

AI's Essays Outperform Humans (Research)原评论 ↗
被提交为 story · 2 次