按年被提到
20142016 · 3 次2026
社会、经济与科学研究›科研评价与算法公平·arXiv:1412.3756 · stat.ML

Certifying and removing disparate impact

Michael Feldman, Sorelle Friedler, John Moeller, Carlos Scheidegger, Suresh Venkatasubramanian · 2014
开始阅读 ↗PDFalphaXiv 讨论
被提及 · 2 人首次 2016-03-24 · 最近 2016-07-19
2不同的人
2活跃月份
2讨论串
21被引(OpenAlex)
arXiv 摘要(候选层不写导读)

What does it mean for an algorithm to be biased? In U.S. law, unintentional bias is encoded via disparate impact, which occurs when a selection process has widely different outcomes for different groups, even as it appears to be neutral. This legal determination hinges on a definition of a protected class (ethnicity, gender, religious practice) and an explicit description of the process. When the process is implemented using computers, determining disparate impact (and hence bias) is harder. It might not be possible to disclose the process. In addition, even if the process is open, it might be hard to elucidate in a legal setting how the algorithm makes its decisions. Instead of requiring access to the algorithm, we propose making inferences based on the data the algorithm uses. We make four contributions to this problem. First, we link the legal notion of disparate impact to a measure of classification accuracy that while known, has received relatively little attention. Second, we propose a test for disparate impact based on analyzing the information leakage of the protected class from the other data attributes. Third, we describe methods by which data might be made unbiased. Finally, we present empirical evidence supporting the effectiveness of our test for disparate impact and our approach for both masking bias and preserving relevant information in the data. Interestingly, our approach resembles some actual selection practices that have recently received legal scrutiny.

候选层:至少 2 个不同的人、在 2 个不同月份提到过,还没到主书架的 3 人 3 个月。没有做立场标注,所以只写“被提及”。

HN 书评

推荐在前,同类按时间 · 每篇最多保留 20 条,统计用全部提及
评论mizzao · 2016-03

“Sendhil Mullainathan (econ prof at Harvard) is doing some work on using machine learning to predict whether people should be granted bail. The machine discrimination (no pun intended) issues here could be quite terrifying. Not published yet, but example abstract: http://inequality.hks.harvard.edu/event/sendhil-mullainathan-title-tba On the other hand, th…”

Microsoft chatbot is taught to swear on Twitter原评论 ↗
评论Smerity · 2016-07

“The issue is not whether justice can be codified. Let us assume that you can and it's outlined on page 3 of your document. Providing examples to an ML model don't guarantee it will codify anything similar to that. This is a fundamental issue. Most machine learning models aren't highly interpretable and can also act in unexpected ways. Re: (a) variables w…”

Training Computers to Find Future Criminals原评论 ↗
评论Smerity · 2016-07

“The European Union are likely to accelerate much of this type of research. They recently introduced regulations specifically targeting algorithmic decision-making and a "right to explanation" for automated decisions. There's a Wired article[1] on the general scene and a paper that investigates the impact it may have on the industry[2]. Regarding differe…”

Training Computers to Find Future Criminals原评论 ↗