“Had most of even that small effect disappear on reproduction, which increases the evidence against a large effect: On the Impact of Programming Languages on Code Quality”
On the Impact of Programming Languages on Code Quality
复现 GitHub 研究:编程语言与缺陷的关联微乎其微
这是对 Ray 等人研究的复现,原研究声称在 GitHub 项目中,11 种编程语言与软件缺陷之间存在统计显著的关联。作者先做实验重复,只部分成功,但验证了原研究关于十种语言与缺陷相关的一个关键结论;随后对数据和统计建模步骤做了完整、独立的重新分析,发现多处缺陷,使原结论站不住:只有四种语言与缺陷的关联统计显著,且效应量极小。文章最后列出可能的其他偏差来源和类似研究的若干最佳实践建议。
评论者在争论哪种语言更不易出 bug 时引用它:复现表明原研究的语言与缺陷关联大多站不住,只有少数语言显著且效应极小;也有人拿其他研究来反驳。
HN 书评
推荐在前,同类按时间 · 每篇最多保留 20 条,统计用全部提及“a recent failed attempt to find evidence: On the Impact of Programming Languages on Code Quality”
“The main finding is that language choice hardly matters at all.”
“On the Impact of Programming Languages on Code Quality contradicts the paper I cited above”
“that was successfully reproduced [0], which finds that there is a real but small negative correlation between FP and bug counts”
“See: On the Impact of Programming Languages on Code Quality (a reproduction of an earlier result, that invalidates many of the conclusions)”
看全部 9 条 →
“There have been some studies, and while all methodologies have tradeoff's go and clojure sit near the bottom of this list in bugs/committ: On the Impact of Programming Languages on Code Quality”
“You have linked a study which, if you read the abstract, effectively claims”
“What studies clearly show, is that both in terms of productivity [2] and bug reduction [3], expressivity reigns supreme.”
- On the Impact of Programming Languages on Code Quality ↗matt_d · 2019-01-31 · 4 分
- On the Impact of Programming Languages on Code Quality ↗lelf · 2019-06-05 · 264 分
- On the Impact of Programming Languages on Code Quality ↗one2three4 · 2021-03-29 · 2 分
- Impact of Programming Languages on Code Quality (2019) ↗tosh · 2026-02-23 · 1 分