按年被提到
20172020 · 1 次2026
机器学习与深度学习›神经网络架构探索·arXiv:1710.02971 · cs.SI

Network Embedding as Matrix Factorization: Unifying DeepWalk, LINE, PTE, and node2vec

Jiezhong Qiu, Yuxiao Dong, Hao Ma, Jian Li, Kuansan Wang, Jie Tang · 2017
开始阅读 ↗PDFalphaXiv 讨论
被提及 · 2 人首次 2020-08-25 · 最近 2025-02-18
2不同的人
3活跃月份
3讨论串
726被引(OpenAlex)
arXiv 摘要(候选层不写导读)

Since the invention of word2vec, the skip-gram model has significantly advanced the research of network embedding, such as the recent emergence of the DeepWalk, LINE, PTE, and node2vec approaches. In this work, we show that all of the aforementioned models with negative sampling can be unified into the matrix factorization framework with closed forms. Our analysis and proofs reveal that: (1) DeepWalk empirically produces a low-rank transformation of a network's normalized Laplacian matrix; (2) LINE, in theory, is a special case of DeepWalk when the size of vertices' context is set to one; (3) As an extension of LINE, PTE can be viewed as the joint factorization of multiple networks' Laplacians; (4) node2vec is factorizing a matrix related to the stationary distribution and transition probability tensor of a 2nd-order random walk. We further provide the theoretical connections between skip-gram based network embedding algorithms and the theory of graph Laplacian. Finally, we present the NetMF method as well as its approximation algorithm for computing network embedding. Our method offers significant improvements over DeepWalk and LINE for conventional network mining tasks. This work lays the theoretical foundation for skip-gram based network embedding methods, leading to a better understanding of latent network representation learning.

候选层:至少 2 个不同的人、在 2 个不同月份提到过,还没到主书架的 3 人 3 个月。没有做立场标注,所以只写“被提及”。

HN 书评

推荐在前,同类按时间 · 每篇最多保留 20 条,统计用全部提及
评论Khelavaster · 2024-05

“More accurately, vector databases are Softmax'd eigendecompositions of the matrix representation of the graph of their connected members.. "Network Embedding as Matrix Factorization: Unifying DeepWalk, LINE, PTE, and node2vec" https://arxiv.org/abs/1710.02971”

Decades-Old Technology and a Paper from Meta Created an AI Industry Standard原评论 ↗
评论khelavastr · 2025-02

“Have you seen, "Network Embedding as Matrix Factorization: Unifying DeepWalk, LINE, PTE, and node2vec"..? You can node2vec any symmetric graph to approximate transforms of its eigendecomposition. https://arxiv.org/abs/1710.02971”

The secret ingredients of word2vec (2016)原评论 ↗
被提交为 story · 1 次