按年被提到
20192019 · 1 次2026
大模型与语言模型›大模型预训练与缩放·arXiv:1909.05858 · cs.CL

CTRL: A Conditional Transformer Language Model for Controllable Generation

Nitish Shirish Keskar, Bryan McCann, Lav R. Varshney, Caiming Xiong, Richard Socher · 2019
开始阅读 ↗PDFalphaXiv 讨论
被提及 · 2 人首次 2019-09-17 · 最近 2023-03-12
2不同的人
2活跃月份
2讨论串
1,018被引(OpenAlex)
arXiv 摘要(候选层不写导读)

Large-scale language models show promising text generation capabilities, but users cannot easily control particular aspects of the generated text. We release CTRL, a 1.63 billion-parameter conditional transformer language model, trained to condition on control codes that govern style, content, and task-specific behavior. Control codes were derived from structure that naturally co-occurs with raw text, preserving the advantages of unsupervised learning while providing more explicit control over text generation. These codes also allow CTRL to predict which parts of the training data are most likely given a sequence. This provides a potential method for analyzing large amounts of data via model-based source attribution. We have released multiple full-sized, pretrained versions of CTRL at https://github.com/salesforce/ctrl.

候选层:至少 2 个不同的人、在 2 个不同月份提到过,还没到主书架的 3 人 3 个月。没有做立场标注,所以只写“被提及”。

HN 书评

推荐在前,同类按时间 · 每篇最多保留 20 条,统计用全部提及
评论enjoylife · 2023-03

“It’s essentially a question of did you take a look the code? There is comments in the codebase directly where the config values in question are being used. Eg. > # repetition penalty from CTRL paper (https://arxiv.org/abs/1909.05858) Now I’m assuming a base rate of knowledge for this to help, but in general I find diving into the code paths of open sou…”

Large language models are having their Stable Diffusion moment原评论 ↗
被提交为 story · 1 次