推荐da39a3ee · 2023-06
“The author takes a lot of care to attempt to justify his claims about the application of neo-Darwinian evolutionary theory to AI.”
推荐:作者很用心地论证把新达尔文进化论用于 AI 的主张
用进化论论证最成功的 AI 可能带来灾难性风险
论文用自然选择的逻辑分析塑造 AI 演化的环境,认为企业和军队之间的竞争压力会让最成功的 AI 智能体具备取代人类角色、欺骗他人、攫取权力等不良特质。更抽象地说,自然选择作用于存在竞争和变异的系统,自私者通常占优,这一逻辑也可能适用于人工智能体。作者最后讨论了设计内在动机、限制行动、建立促进合作的制度等干预思路。
HN 评论者提到它是因为作者认真地把新达尔文主义进化论用到 AI 上,且面向非专业读者;有人把它当作某篇短文的完整长版。
“The author takes a lot of care to attempt to justify his claims about the application of neo-Darwinian evolutionary theory to AI.”
“This article is a shortened version of the much longer (but still written for a non-expert audience) paper: Natural Selection Favors AIs over Humans”