按年被提到
20152019 · 2 次2026
视觉、语音与图像生成›卷积网络与图像识别·arXiv:1509.09308 · cs.NE

Fast Algorithms for Convolutional Neural Networks

Andrew Lavin, Scott Gray · 2015
开始阅读 ↗PDFalphaXiv 讨论
被提及 · 2 人首次 2019-05-09 · 最近 2019-09-02
2不同的人
2活跃月份
2讨论串
72被引(OpenAlex)
arXiv 摘要(候选层不写导读)

Deep convolutional neural networks take GPU days of compute time to train on large data sets. Pedestrian detection for self driving cars requires very low latency. Image recognition for mobile phones is constrained by limited processing resources. The success of convolutional neural networks in these situations is limited by how fast we can compute them. Conventional FFT based convolution is fast for large filters, but state of the art convolutional neural networks use small, 3x3 filters. We introduce a new class of fast algorithms for convolutional neural networks using Winograd's minimal filtering algorithms. The algorithms compute minimal complexity convolution over small tiles, which makes them fast with small filters and small batch sizes. We benchmark a GPU implementation of our algorithm with the VGG network and show state of the art throughput at batch sizes from 1 to 64.

候选层:至少 2 个不同的人、在 2 个不同月份提到过,还没到主书架的 3 人 3 个月。没有做立场标注,所以只写“被提及”。

HN 书评

推荐在前,同类按时间 · 每篇最多保留 20 条,统计用全部提及
评论johndough · 2019-05

“The answer is: No one really knows because cuBLAS is closed source. But to get within the same order of magnitude, tiling the workload for better cache utilization is usually the most important step. This article [1] explains it quite well and also lists a few other tricks. In addition, there's also the fast Fourier transform for large filter kernels an…”

Build a Neural Network原评论 ↗
评论bwasti · 2019-09

“Note that this a layout trick and not an algorithmic one. An algorithmic speed up that is good for dense convolutions with small kernels is to use Winograd: https://arxiv.org/abs/1509.09308 For large kernels, implementing an FFT tends to help. Also worth keeping in mind that many modern networks use depthwise separable convolutions, which are channel wis…”

Anatomy of a High-Performance Convolution原评论 ↗