按年被提到
20162017 · 2 次2026
AI 安全、伦理与社会影响›对抗样本与后门·arXiv:1605.07277 · cs.CR

Transferability in Machine Learning: from Phenomena to Black-Box Attacks using Adversarial Samples

Nicolas Papernot, Patrick McDaniel, Ian Goodfellow · 2016
开始阅读 ↗PDFalphaXiv 讨论
被提及 · 3 人首次 2017-11-02 · 最近 2018-01-30
3不同的人
2活跃月份
2讨论串
1,325被引(OpenAlex)
arXiv 摘要(候选层不写导读)

Many machine learning models are vulnerable to adversarial examples: inputs that are specially crafted to cause a machine learning model to produce an incorrect output. Adversarial examples that affect one model often affect another model, even if the two models have different architectures or were trained on different training sets, so long as both models were trained to perform the same task. An attacker may therefore train their own substitute model, craft adversarial examples against the substitute, and transfer them to a victim model, with very little information about the victim. Recent work has further developed a technique that uses the victim model as an oracle to label a synthetic training set for the substitute, so the attacker need not even collect a training set to mount the attack. We extend these recent techniques using reservoir sampling to greatly enhance the efficiency of the training procedure for the substitute model. We introduce new transferability attacks between previously unexplored (substitute, victim) pairs of machine learning model classes, most notably SVMs and decision trees. We demonstrate our attacks on two commercial machine learning classification systems from Amazon (96.19% misclassification rate) and Google (88.94%) using only 800 queries of the victim model, thereby showing that existing machine learning approaches are in general vulnerable to systematic black-box attacks regardless of their structure.

候选层:至少 2 个不同的人、在 2 个不同月份提到过,还没到主书架的 3 人 3 个月。没有做立场标注,所以只写“被提及”。

HN 书评

推荐在前,同类按时间 · 每篇最多保留 20 条,统计用全部提及
评论obastani · 2017-11

“I think they might be referring [1], which shows that adversarial examples transfer to models such as decision trees and SVMs. [1] https://arxiv.org/abs/1605.07277”

How Adversarial Attacks Work原评论 ↗
评论shmel · 2017-11

“Really? I believe they meant exactly what they said. Read https://arxiv.org/abs/1605.07277 Adversarial examples can be easily crafted for linear regression, SVM, decision trees and k-NN at very least. I can't think about any ML technique that is proven to be secure against them. There is also an old blogpost from Karpathy describing that the only reason…”

How Adversarial Attacks Work原评论 ↗
评论evjrob · 2018-01

“I wouldn't be surprised if these speech to text models are susceptible to black box attacks in the same way that image classifiers are: https://arxiv.org/abs/1605.07277”

Audio Adversarial Examples原评论 ↗