按年被提到
20232023 · 4 次2026
大模型与语言模型›检索增强与知识库·arXiv:2306.08302 · cs.CL

Unifying Large Language Models and Knowledge Graphs: A Roadmap

Shirui Pan, Linhao Luo, Yufei Wang, Chen Chen, Jiapu Wang, Xindong Wu · 2023
开始阅读 ↗PDFalphaXiv 讨论
被提及 · 4 人首次 2023-06-17 · 最近 2023-11-30
4不同的人
2活跃月份
4讨论串
1,537被引(OpenAlex)
arXiv 摘要(候选层不写导读)

Large language models (LLMs), such as ChatGPT and GPT4, are making new waves in the field of natural language processing and artificial intelligence, due to their emergent ability and generalizability. However, LLMs are black-box models, which often fall short of capturing and accessing factual knowledge. In contrast, Knowledge Graphs (KGs), Wikipedia and Huapu for example, are structured knowledge models that explicitly store rich factual knowledge. KGs can enhance LLMs by providing external knowledge for inference and interpretability. Meanwhile, KGs are difficult to construct and evolving by nature, which challenges the existing methods in KGs to generate new facts and represent unseen knowledge. Therefore, it is complementary to unify LLMs and KGs together and simultaneously leverage their advantages. In this article, we present a forward-looking roadmap for the unification of LLMs and KGs. Our roadmap consists of three general frameworks, namely, 1) KG-enhanced LLMs, which incorporate KGs during the pre-training and inference phases of LLMs, or for the purpose of enhancing understanding of the knowledge learned by LLMs; 2) LLM-augmented KGs, that leverage LLMs for different KG tasks such as embedding, completion, construction, graph-to-text generation, and question answering; and 3) Synergized LLMs + KGs, in which LLMs and KGs play equal roles and work in a mutually beneficial way to enhance both LLMs and KGs for bidirectional reasoning driven by both data and knowledge. We review and summarize existing efforts within these three frameworks in our roadmap and pinpoint their future research directions.

候选层:至少 2 个不同的人、在 2 个不同月份提到过,还没到主书架的 3 人 3 个月。没有做立场标注,所以只写“被提及”。

HN 书评

推荐在前,同类按时间 · 每篇最多保留 20 条,统计用全部提及
评论ignoramous · 2023-06

“Found a couple: - Augmenting LLMs with Knowledge: https://www.arxiv-vanity.com/papers/2306.08302/ - Grounding LLMs with Retrieval-Augmented Generation: https://techcommunity.microsoft.com/t5/fasttrack-for-azure/grounding-llms/ba-p/3843857”

LLM Fine Tuning Guide for Enterprises in 2023原评论 ↗
评论filterfiber · 2023-11

“Yeah that's a fairly well studied one. Most of these techniques are rather "lossy" compared to extending the context window. The most likely "real solution" is going to be using various tricks and finetuning on higher context lengths to just extend the context window. Here's a bunch of other related methods, Summarizing context - https://arxiv.org/abs/2…”

Is anyone using self hosted LLM day to day and training it like a new employee原评论 ↗
被提交为 story · 2 次