按年被提到
20132013 · 2 次2026
视觉、语音与图像生成›卷积网络与图像识别·arXiv:1306.0239 · cs.LG

Deep Learning using Linear Support Vector Machines

Yichuan Tang · 2013
开始阅读 ↗PDFalphaXiv 讨论
被提及 · 2 人首次 2013-06-05 · 最近 2013-07-13
2不同的人
2活跃月份
2讨论串
735被引(OpenAlex)
arXiv 摘要(候选层不写导读)

Recently, fully-connected and convolutional neural networks have been trained to achieve state-of-the-art performance on a wide variety of tasks such as speech recognition, image classification, natural language processing, and bioinformatics. For classification tasks, most of these "deep learning" models employ the softmax activation function for prediction and minimize cross-entropy loss. In this paper, we demonstrate a small but consistent advantage of replacing the softmax layer with a linear support vector machine. Learning minimizes a margin-based loss instead of the cross-entropy loss. While there have been various combinations of neural nets and SVMs in prior art, our results using L2-SVMs show that by simply replacing softmax with linear SVMs gives significant gains on popular deep learning datasets MNIST, CIFAR-10, and the ICML 2013 Representation Learning Workshop's face expression recognition challenge.

候选层:至少 2 个不同的人、在 2 个不同月份提到过,还没到主书架的 3 人 3 个月。没有做立场标注,所以只写“被提及”。

HN 书评

推荐在前,同类按时间 · 每篇最多保留 20 条,统计用全部提及
评论bun-neh · 2013-07

“There was a paper not too far back that used SVMs in deep learning and leaped over the then state-of-the-art performance. http://arxiv.org/abs/1306.0239”

Introduction to Support Vector Machines原评论 ↗
被提交为 story · 1 次