按年被提到
20182018 · 3 次2026
AI 安全、伦理与社会影响›对抗样本与后门·arXiv:1805.12152 · stat.ML

Robustness May Be at Odds with Accuracy

Dimitris Tsipras, Shibani Santurkar, Logan Engstrom, Alexander Turner, Aleksander Madry · 2018
开始阅读 ↗PDFalphaXiv 讨论
被提及 · 2 人首次 2018-06-03 · 最近 2018-07-03
2不同的人
2活跃月份
3讨论串
1,068被引(OpenAlex)
arXiv 摘要(候选层不写导读)

We show that there may exist an inherent tension between the goal of adversarial robustness and that of standard generalization. Specifically, training robust models may not only be more resource-consuming, but also lead to a reduction of standard accuracy. We demonstrate that this trade-off between the standard accuracy of a model and its robustness to adversarial perturbations provably exists in a fairly simple and natural setting. These findings also corroborate a similar phenomenon observed empirically in more complex settings. Further, we argue that this phenomenon is a consequence of robust classifiers learning fundamentally different feature representations than standard classifiers. These differences, in particular, seem to result in unexpected benefits: the representations learned by robust models tend to align better with salient data characteristics and human perception.

候选层:至少 2 个不同的人、在 2 个不同月份提到过,还没到主书架的 3 人 3 个月。没有做立场标注,所以只写“被提及”。

HN 书评

推荐在前,同类按时间 · 每篇最多保留 20 条,统计用全部提及
评论red75prime · 2018-06

“Adversarially robust classifiers have interpretable gradients and feature representations [0]. The problem seems to be that the standard networks capture all the statistics there is, including surface statistical regularities and noise. It can be mitigated, though. [0]: https://arxiv.org/abs/1805.12152”

Deep learning: a critical appraisal原评论 ↗
评论logane · 2018-07

“We took a look at adversarial examples for linear classifiers (and in general, we looked at properties that adversarial training induces) here: https://arxiv.org/abs/1805.12152 For $\ell_\infty$ adversarial examples on linear classifiers we found that adversarial training forces a tradeoff between the $\ell_1$ norm of the weights (which is directly associ…”

A New Angle on L2 Regularization原评论 ↗
评论red75prime · 2018-07

“In the light of [0], it seems that standard (not adversarially trained) NNs learn each and every feature which happens to correlate with a class label in a training set (including noise). So moving along adversarial gradient looks like noise. Take my interpretation with a (huge) grain of salt. [0] https://arxiv.org/abs/1805.12152”

Adversarial Reprogramming of Neural Networks原评论 ↗