按年被提到
20212021 · 2 次2026
机器学习与深度学习›机器学习实践与反思·arXiv:2106.15590 · cs.LG

The Values Encoded in Machine Learning Research

Abeba Birhane, Pratyusha Kalluri, Dallas Card, William Agnew, Ravit Dotan, Michelle Bao · 2021
开始阅读 ↗PDFalphaXiv 讨论
被提及 · 2 人首次 2021-08-20 · 最近 2021-12-15
2不同的人
2活跃月份
2讨论串
360被引(OpenAlex)
arXiv 摘要(候选层不写导读)

Machine learning currently exerts an outsized influence on the world, increasingly affecting institutional practices and impacted communities. It is therefore critical that we question vague conceptions of the field as value-neutral or universally beneficial, and investigate what specific values the field is advancing. In this paper, we first introduce a method and annotation scheme for studying the values encoded in documents such as research papers. Applying the scheme, we analyze 100 highly cited machine learning papers published at premier machine learning conferences, ICML and NeurIPS. We annotate key features of papers which reveal their values: their justification for their choice of project, which attributes of their project they uplift, their consideration of potential negative consequences, and their institutional affiliations and funding sources. We find that few of the papers justify how their project connects to a societal need (15\%) and far fewer discuss negative potential (1\%). Through line-by-line content analysis, we identify 59 values that are uplifted in ML research, and, of these, we find that the papers most frequently justify and assess themselves based on Performance, Generalization, Quantitative evidence, Efficiency, Building on past work, and Novelty. We present extensive textual evidence and identify key themes in the definitions and operationalization of these values. Notably, we find systematic textual evidence that these top values are being defined and applied with assumptions and implications generally supporting the centralization of power.Finally, we find increasingly close ties between these highly cited papers and tech companies and elite universities.

候选层:至少 2 个不同的人、在 2 个不同月份提到过,还没到主书架的 3 人 3 个月。没有做立场标注,所以只写“被提及”。

HN 书评

推荐在前,同类按时间 · 每篇最多保留 20 条,统计用全部提及
评论nickvincent · 2021-08

“It just isn't true that "The point of ethics is to shame people or practices" or that ethics has "no value production". In general, a primary factor reviewers in computing conferences are asked to consider is the degree to which a submission make a "substantial contribution" to the community. What is or isn't a substantial contribution is subjective and …”

Moving beyond “algorithmic bias is a data problem”原评论 ↗
被提交为 story · 1 次