按年被提到
20172017 · 2 次2026
机器学习与深度学习›训练加速与低精度计算·arXiv:1701.02291 · cs.LG

QuickNet: Maximizing Efficiency and Efficacy in Deep Architectures

Tapabrata Ghosh · 2017
开始阅读 ↗PDFalphaXiv 讨论
被提及 · 2 人首次 2017-01-10 · 最近 2017-04-27
2不同的人
2活跃月份
2讨论串
5被引(OpenAlex)
arXiv 摘要(候选层不写导读)

We present QuickNet, a fast and accurate network architecture that is both faster and significantly more accurate than other fast deep architectures like SqueezeNet. Furthermore, it uses less parameters than previous networks, making it more memory efficient. We do this by making two major modifications to the reference Darknet model (Redmon et al, 2015): 1) The use of depthwise separable convolutions and 2) The use of parametric rectified linear units. We make the observation that parametric rectified linear units are computationally equivalent to leaky rectified linear units at test time and the observation that separable convolutions can be interpreted as a compressed Inception network (Chollet, 2016). Using these observations, we derive a network architecture, which we call QuickNet, that is both faster and more accurate than previous models. Our architecture provides at least four major advantages: (1) A smaller model size, which is more tenable on memory constrained systems; (2) A significantly faster network which is more tenable on computationally constrained systems; (3) A high accuracy of 95.7 percent on the CIFAR-10 Dataset which outperforms all but one result published so far, although we note that our works are orthogonal approaches and can be combined (4) Orthogonality to previous model compression approaches allowing for further speed gains to be realized.

候选层:至少 2 个不同的人、在 2 个不同月份提到过,还没到主书架的 3 人 3 个月。没有做立场标注,所以只写“被提及”。

HN 书评

推荐在前,同类按时间 · 每篇最多保留 20 条,统计用全部提及
评论deepnotderp · 2017-04

“If you're interested in fast inference models, be sure to check out QuickNet: https://arxiv.org/abs/1701.02291 Disclaimer: I'm the author on this paper. It shares many similarities with Google's production MobileNets albeit MobileNets is a family and QuickNet uses PReLU which has helped a lot in terms of parametric efficiency. Also there's a slight diff…”

Machine learning on mobile: on the device or in the cloud?原评论 ↗
被提交为 story · 1 次