按年被提到
20242025 · 2 次2026
AI 安全、伦理与社会影响›AI 风险与对齐·arXiv:2411.00986 · cs.CY

Taking AI Welfare Seriously

Robert Long, Jeff Sebo, Patrick Butlin, Kathleen Finlinson, Kyle Fish, Jacqueline Harding, Jacob Pfau, Toni Sims, Jonathan Birch, David Chalmers · 2024
开始阅读 ↗PDFalphaXiv 讨论
被提及 · 2 人首次 2025-06-12 · 最近 2025-08-15
2不同的人
2活跃月份
2讨论串
107被引(OpenAlex)
arXiv 摘要(候选层不写导读)

In this report, we argue that there is a realistic possibility that some AI systems will be conscious and/or robustly agentic in the near future. That means that the prospect of AI welfare and moral patienthood, i.e. of AI systems with their own interests and moral significance, is no longer an issue only for sci-fi or the distant future. It is an issue for the near future, and AI companies and other actors have a responsibility to start taking it seriously. We also recommend three early steps that AI companies and other actors can take: They can (1) acknowledge that AI welfare is an important and difficult issue (and ensure that language model outputs do the same), (2) start assessing AI systems for evidence of consciousness and robust agency, and (3) prepare policies and procedures for treating AI systems with an appropriate level of moral concern. To be clear, our argument in this report is not that AI systems definitely are, or will be, conscious, robustly agentic, or otherwise morally significant. Instead, our argument is that there is substantial uncertainty about these possibilities, and so we need to improve our understanding of AI welfare and our ability to make wise decisions about this issue. Otherwise there is a significant risk that we will mishandle decisions about AI welfare, mistakenly harming AI systems that matter morally and/or mistakenly caring for AI systems that do not.

候选层:至少 2 个不同的人、在 2 个不同月份提到过,还没到主书架的 3 人 3 个月。没有做立场标注,所以只写“被提及”。

HN 书评

推荐在前,同类按时间 · 每篇最多保留 20 条,统计用全部提及
评论bbor · 2025-06

“They're not ascribing consciousness, they're investigating the possibility. We all agreed with Turing 75 years ago that deciding whether a machine is "truly thinking" or not is a meaningless, unscientific question -- what changed? It doesn't help that this critique is badly researched: The Anthropic researchers do not really define their terms or explai…”

The Problem with AI Welfare原评论 ↗
评论anonu · 2025-08

“Anthropic hired their first AI Welfare person in late 2024. Here's an article about a paper that came out around the same time https://www.transformernews.ai/p/ai-welfare-paper Here's the paper: https://arxiv.org/abs/2411.00986 > In this report, we argue that there is a realistic possibility that some AI systems will be conscious and/or robustly agenti…”

Claude Opus 4 and 4.1 can now end a rare subset of conversations原评论 ↗