按年被提到
20252025 · 1 次2026
AI 安全、伦理与社会影响›大模型与人类行为·arXiv:2507.21509 · cs.CL

Persona Vectors: Monitoring and Controlling Character Traits in Language Models

Runjin Chen, Andy Arditi, Henry Sleight, Owain Evans, Jack Lindsey · 2025
开始阅读 ↗PDFalphaXiv 讨论
被提及 · 2 人首次 2025-11-01 · 最近 2026-03-08
2不同的人
2活跃月份
2讨论串
—被引(OpenAlex)
arXiv 摘要(候选层不写导读)

Large language models interact with users through a simulated 'Assistant' persona. While the Assistant is typically trained to be helpful, harmless, and honest, it sometimes deviates from these ideals. In this paper, we identify directions in the model's activation space-persona vectors-underlying several traits, such as evil, sycophancy, and propensity to hallucinate. We confirm that these vectors can be used to monitor fluctuations in the Assistant's personality at deployment time. We then apply persona vectors to predict and control personality shifts that occur during training. We find that both intended and unintended personality changes after finetuning are strongly correlated with shifts along the relevant persona vectors. These shifts can be mitigated through post-hoc intervention, or avoided in the first place with a new preventative steering method. Moreover, persona vectors can be used to flag training data that will produce undesirable personality changes, both at the dataset level and the individual sample level. Our method for extracting persona vectors is automated and can be applied to any personality trait of interest, given only a natural-language description.

候选层:至少 2 个不同的人、在 2 个不同月份提到过,还没到主书架的 3 人 3 个月。没有做立场标注,所以只写“被提及”。

HN 书评

推荐在前,同类按时间 · 每篇最多保留 20 条,统计用全部提及
评论acmiyaguchi · 2025-11

“This does exist to some degree, as far as I understand, along the lines of style-transfer and ControlNet in visual domains. Anthropic has some research called "persona vectors" which effectively push generative behaviors toward or away from particular traits. [0] https://www.anthropic.com/research/persona-vectors [1] https://arxiv.org/abs/2507.21509”

Word2vec-style vector arithmetic on docs embeddings原评论 ↗
评论vessenes · 2026-03

“I asked Gemini for a literature search and it came back with this: References Chen, R., Arditi, A., Sleight, H., Evans, O., & Lindsey, J. (2025). Persona Vectors: Monitoring and Controlling Character Traits in Language Models. arXiv. https://doi.org/10.48550/arxiv.2507.21509 Cited by: 97 Greenblatt, R., Denison, C., Wright, B., Roger, F., MacDiarmid, M.…”

Sarvam 105B, the first competitive Indian open source LLM原评论 ↗