“Yes but: "Our data also shows that hallucinations are not a problem in the setting of argumentative essay writing: the essay topics are not really about factual correctness, but rather about argumentation and critical reflection on general concepts which seem to be contained within the knowledge of the AI model." Seems like a time to revise the concept …”
AI, write an essay for me: A large-scale comparison of human-written versus ChatGPT-generated essays
Background: Recently, ChatGPT and similar generative AI models have attracted hundreds of millions of users and become part of the public discourse. Many believe that such models will disrupt society and will result in a significant change in the education system and information generation in the future. So far, this belief is based on either colloquial evidence or benchmarks from the owners of the models -- both lack scientific rigour. Objective: Through a large-scale study comparing human-written versus ChatGPT-generated argumentative student essays, we systematically assess the quality of the AI-generated content. Methods: A large corpus of essays was rated using standard criteria by a large number of human experts (teachers). We augment the analysis with a consideration of the linguistic characteristics of the generated essays. Results: Our results demonstrate that ChatGPT generates essays that are rated higher for quality than human-written essays. The writing style of the AI models exhibits linguistic characteristics that are different from those of the human-written essays, e.g., it is characterized by fewer discourse and epistemic markers, but more nominalizations and greater lexical diversity. Conclusions: Our results clearly demonstrate that models like ChatGPT outperform humans in generating argumentative essays. Since the technology is readily available for anyone to use, educators must act immediately. We must re-invent homework and develop teaching concepts that utilize these AI models in the same way as math utilized the calculator: teach the general concepts first and then use AI tools to free up time for other learning objectives.
候选层:至少 2 个不同的人、在 2 个不同月份提到过,还没到主书架的 3 人 3 个月。没有做立场标注,所以只写“被提及”。
HN 书评
没有评论直接链到它;下面是它被提交的讨论串里回复最多的评论(不计入统计)“The paper linked is a large-scale study comparing human-written versus AI-generated argumentative student essays. The researchers used a large corpus of essays and had them rated by human experts (teachers) using standard criteria. They also analyzed the linguistic characteristics of the generated essays https://www.linkedin.com/pulse/top-5-best-ai-essay-…”
“but is quality of an essay a artificially derived standard? i mean we can talk about how great the material is that is produced, but seriously, folks, aren't we chasing our tails here? is an AI good at wirting essays because of its own standard of quality or is it being measured against our own already established low bar? i mean if we're saying the compu…”
- AI, write an essay for me: A comparison of human vs. ChatGPT-generated essays ↗gwintrob · 2023-05-31 · 1 分
- AI's Essays Outperform Humans (Research) ↗romanichm12 · 2023-07-12 · 1 分