按年被提到
20252025 · 1 次2026
大模型与语言模型›长上下文与测试时计算·arXiv:2510.03215 · cs.CL

Cache-to-Cache: Direct Semantic Communication Between Large Language Models

Tianyu Fu, Zihan Min, Hanling Zhang, Jichao Yan, Guohao Dai, Wanli Ouyang, Yu Wang · 2025
开始阅读 ↗PDFalphaXiv 讨论
被提及 · 2 人首次 2025-11-04 · 最近 2026-09-18
2不同的人
2活跃月份
2讨论串
7被引(OpenAlex)
arXiv 摘要(候选层不写导读)

Multi-LLM systems harness the complementary strengths of diverse Large Language Models, achieving performance and efficiency gains that are not attainable by a single model. In existing designs, LLMs communicate through text, forcing internal representations to be transformed into output token sequences. This process both loses rich semantic information and incurs token-by-token generation latency. Motivated by these limitations, we ask: Can LLMs communicate beyond text? Oracle experiments show that enriching the KV-Cache semantics can improve response quality without increasing cache size, supporting KV-Cache as an effective medium for inter-model communication. Thus, we propose Cache-to-Cache (C2C), a new paradigm for direct semantic communication between LLMs. C2C uses a neural network to project and fuse the source model's KV-cache with that of the target model to enable direct semantic transfer. A learnable gating mechanism selects the target layers that benefit from cache communication. Compared with text communication, C2C utilizes the deep, specialized semantics from both models, while avoiding explicit intermediate text generation. Experiments show that C2C achieves 6.4-14.2% higher average accuracy than individual models. It further outperforms the text communication paradigm by approximately 3.1-5.4%, while delivering an average 2.5x speedup in latency. Our code is available at https://github.com/thu-nics/C2C.

候选层:至少 2 个不同的人、在 2 个不同月份提到过,还没到主书架的 3 人 3 个月。没有做立场标注,所以只写“被提及”。

HN 书评

没有评论直接链到它;下面是它被提交的讨论串里回复最多的评论(不计入统计)
讨论串评论cubefox · 2026-09

“So the models will not only be using more and more Neuralese in their CoT (like GPT-6), but different agents will also be able to communicate with each other in Neuralese. It's not looking good for monitorability.”

Cache-to-Cache: Direct Semantic Communication Between LLMs (2025)原评论 ↗
讨论串评论gavinray · 2026-09

“A few months ago I asked why semantic representation rather than text wasn't used, since natural language seems quite a lossy representation for semantic concepts: https://news.ycombinator.com/item?id=47195212 I wouldn't have thought to use it for LLM-to-LLM communication, though”

Cache-to-Cache: Direct Semantic Communication Between LLMs (2025)原评论 ↗
讨论串评论ACCount39 · 2026-09

“It's an old paper (from 2025, so, a decade ago in AI years), but the concept is still fascinating. And I'm yet to see it show up in any production models. If multiple models can use cache representations for this kind of enrichment, the KV cache representations of different models must be somewhat compatible. What stops us then from going a step further…”

Cache-to-Cache: Direct Semantic Communication Between LLMs (2025)原评论 ↗
被提交为 story · 2 次