“I want to see more work combining them. Here’s an example I saw in one of the links in this thread: https://arxiv.org/abs/1806.06988 It combines NN’s with decision trees.”
Deep Neural Decision Trees
Deep neural networks have been proven powerful at processing perceptual data, such as images and audio. However for tabular data, tree-based models are more popular. A nice property of tree-based models is their natural interpretability. In this work, we present Deep Neural Decision Trees (DNDT) -- tree models realised by neural networks. A DNDT is intrinsically interpretable, as it is a tree. Yet as it is also a neural network (NN), it can be easily implemented in NN toolkits, and trained with gradient descent rather than greedy splitting. We evaluate DNDT on several tabular datasets, verify its efficacy, and investigate similarities and differences between DNDT and vanilla decision trees. Interestingly, DNDT self-prunes at both split and feature-level.
候选层:至少 2 个不同的人、在 2 个不同月份提到过,还没到主书架的 3 人 3 个月。没有做立场标注,所以只写“被提及”。
HN 书评
推荐在前,同类按时间 · 每篇最多保留 20 条,统计用全部提及“That assumes it can even be done. It's worth looking into. There have been some projects in those areas. Mixing probabilistic logic with deep learning: https://arxiv.org/abs/1808.08485 https://github.com/ML-KULeuven/deepproblog Combining decision trees with neural nets for interpretability: https://arxiv.org/abs/2011.07553 https://arxiv.org/pdf/2106…”
- Deep Neural Decision Trees ↗jonbaer · 2018-08-15 · 2 分