按年被提到
20232023 · 2 次2026
机器学习与深度学习›训练加速与低精度计算·arXiv:2311.12224 · cs.AR

Fast Inner-Product Algorithms and Architectures for Deep Neural Network Accelerators

Trevor E. Pogue, Nicola Nicolici · 2023
开始阅读 ↗PDFalphaXiv 讨论
被提及 · 2 人首次 2023-11-24 · 最近 2024-03-15
2不同的人
2活跃月份
3讨论串
7被引(OpenAlex)
arXiv 摘要(候选层不写导读)

We introduce a new algorithm called the Free-pipeline Fast Inner Product (FFIP) and its hardware architecture that improve an under-explored fast inner-product algorithm (FIP) proposed by Winograd in 1968. Unlike the unrelated Winograd minimal filtering algorithms for convolutional layers, FIP is applicable to all machine learning (ML) model layers that can mainly decompose to matrix multiplication, including fully-connected, convolutional, recurrent, and attention/transformer layers. We implement FIP for the first time in an ML accelerator then present our FFIP algorithm and generalized architecture which inherently improve FIP's clock frequency and, as a consequence, throughput for a similar hardware cost. Finally, we contribute ML-specific optimizations for the FIP and FFIP algorithms and architectures. We show that FFIP can be seamlessly incorporated into traditional fixed-point systolic array ML accelerators to achieve the same throughput with half the number of multiply-accumulate (MAC) units, or it can double the maximum systolic array size that can fit onto devices with a fixed hardware budget. Our FFIP implementation for non-sparse ML models with 8 to 16-bit fixed-point inputs achieves higher throughput and compute efficiency than the best-in-class prior solutions on the same type of compute platform.

候选层:至少 2 个不同的人、在 2 个不同月份提到过,还没到主书架的 3 人 3 个月。没有做立场标注,所以只写“被提及”。

HN 书评

推荐在前,同类按时间 · 每篇最多保留 20 条,统计用全部提及
评论Someone · 2024-03

“> What is the Big O run time on this? The claim is they’re dropping half the multiplications, so it isn’t doing anything for Big O. > If you want to improve the project credibility please consider being honest and open about what is actually going on and giving some clear explanations and illustrations, The math explaining how to halve the number of mu…”

Show HN: Matrix Multiplication with Half the Multiplications原评论 ↗
被提交为 story · 2 次