按年被提到
20162017 · 2 次2026
机器学习与深度学习›训练加速与低精度计算·arXiv:1608.07249 · cs.DC

Benchmarking State-of-the-Art Deep Learning Software Tools

Shaohuai Shi, Qiang Wang, Pengfei Xu, Xiaowen Chu · 2016
开始阅读 ↗PDFalphaXiv 讨论
被提及 · 2 人首次 2016-08-27 · 最近 2017-06-02
2不同的人
2活跃月份
3讨论串
338被引(OpenAlex)
arXiv 摘要(候选层不写导读)

Deep learning has been shown as a successful machine learning method for a variety of tasks, and its popularity results in numerous open-source deep learning software tools. Training a deep network is usually a very time-consuming process. To address the computational challenge in deep learning, many tools exploit hardware features such as multi-core CPUs and many-core GPUs to shorten the training time. However, different tools exhibit different features and running performance when training different types of deep networks on different hardware platforms, which makes it difficult for end users to select an appropriate pair of software and hardware. In this paper, we aim to make a comparative study of the state-of-the-art GPU-accelerated deep learning software tools, including Caffe, CNTK, MXNet, TensorFlow, and Torch. We first benchmark the running performance of these tools with three popular types of neural networks on two CPU platforms and three GPU platforms. We then benchmark some distributed versions on multiple GPUs. Our contribution is two-fold. First, for end users of deep learning tools, our benchmarking results can serve as a guide to selecting appropriate hardware platforms and software tools. Second, for software developers of deep learning tools, our in-depth analysis points out possible future directions to further optimize the running performance.

候选层:至少 2 个不同的人、在 2 个不同月份提到过,还没到主书架的 3 人 3 个月。没有做立场标注,所以只写“被提及”。

HN 书评

推荐在前,同类按时间 · 每篇最多保留 20 条,统计用全部提及
评论minimaxir · 2017-06

“The important feature is Keras compatability: https://docs.microsoft.com/en-us/cognitive-toolkit/Using-CNTK-with-Keras (although it doesn't seem to be in the official repo yet: https://github.com/fchollet/keras/pull/6800) In terms of "how is CNTK better than TensorFlow," CNTK performs 6x better at minimum on old LSTM benchmarks, which is big. (https://ar…”

Microsoft releases version 2.0 of its deep learning toolkit原评论 ↗
评论minimaxir · 2017-06

“The important feature is Keras compatability (although it doesn't seem to be in the official repo yet: https://github.com/fchollet/keras/pull/6800) In terms of "how is CNTK better than TensorFlow," CNTK trains 5-10x faster at minimum on pre-2.0 LSTM benchmarks, which is big since LSTMs are used for a lot nowadays. (https://arxiv.org/abs/1608.07249)”

Microsoft Cognitive Toolkit 2.0原评论 ↗
被提交为 story · 1 次