“the long awaited paper from Geoffrey Hinton (although Sara Sabour is principal author, Hinton has been hinting at this for a while now) on an alternative to back-propagation”
Dynamic Routing Between Capsules
Hinton 的胶囊网络:以一致性路由取代池化
胶囊是一组神经元,其活动向量的长度表示某类实体存在的概率,方向表示实例化参数;低层胶囊通过变换矩阵为高层胶囊的实例化参数做预测,多个预测一致时高层胶囊才被激活。作者用迭代的「一致性路由」机制训练多层胶囊系统,在 MNIST 上达到当时最优,在识别高度重叠的数字时明显优于卷积网络。
2017 年评论者把它视为 Hinton 期待已久的新架构,同时讨论它在 CIFAR-10 等数据集上较弱、只在玩具数据集上验证,之后多被当作胶囊网络的出处引用。
HN 书评
推荐在前,同类按时间 · 每篇最多保留 20 条,统计用全部提及“Capsule networks[1] have literally not been used on anything larger than what is considered a toy dataset for computer vision yet.”
“(where they finally got Hinton's capsules to work)”
“The paper however details their experiments on Cifar-10 and other datasets in the discussion section.”
“Geff Hinton created an entire new architecture to get 0.25% error, which is far better than the baseline 0.39% error [1].”
“What, for instance, is your opinion about Hinton's recently published capsules idea?”
看全部 13 条 →
“Is the mechanism of 'Arc' gene related to the dynamic routing process of Capsule networks [1, 2]?”
“Link to the capsule network paper, for those who haven't heard of it:”
“the idea of Capsule Networks (Hinton et al)[1, 2] seems to tackle some of these issues”
“The main example the authors use to illustrate these issues is capsule networks, first proposed two years ago.[a]”
“As an example, they use capsule networks[c]”
“In certain new capsule-routing algorithms -- e.g., EM routing[a], Heinsen routing[b], dynamic routing[c]”
“I posted a list of papers on twitter, and will be posting a summary for each of them as well.”
- Dynamic Routing Between Capsules [pdf] ↗stablemap · 2017-10-27 · 1 分
- Dynamic Routing Between Capsules ↗kercker · 2017-10-27 · 1 分
- Dynamic Routing Between Capsules ↗fewfregregeqgqe · 2017-10-29 · 2 分
- Dynamic Routing Between Capsules by Sabour, Frosst, Geoffrey E Hinton (CapsNet)) ↗nabla9 · 2017-11-01 · 2 分
- Dynamic Routing Between Capsules ↗edwin0cheng · 2017-11-02 · 2 分