按年被提到
20212022 · 1 次2026
大模型与语言模型›对话式大模型·arXiv:2112.09332 · cs.CL

WebGPT: Browser-assisted question-answering with human feedback

Reiichiro Nakano, Jacob Hilton, Suchir Balaji, Jeff Wu, Long Ouyang, Christina Kim, Christopher Hesse, Shantanu Jain, Vineet Kosaraju, William Saunders, Xu Jiang, Karl Cobbe 等 18 人 · 2021
开始阅读 ↗PDFalphaXiv 讨论
被提及 · 2 人首次 2022-01-23 · 最近 2023-02-07
2不同的人
2活跃月份
2讨论串
805被引(OpenAlex)
arXiv 摘要(候选层不写导读)

We fine-tune GPT-3 to answer long-form questions using a text-based web-browsing environment, which allows the model to search and navigate the web. By setting up the task so that it can be performed by humans, we are able to train models on the task using imitation learning, and then optimize answer quality with human feedback. To make human evaluation of factual accuracy easier, models must collect references while browsing in support of their answers. We train and evaluate our models on ELI5, a dataset of questions asked by Reddit users. Our best model is obtained by fine-tuning GPT-3 using behavior cloning, and then performing rejection sampling against a reward model trained to predict human preferences. This model's answers are preferred by humans 56% of the time to those of our human demonstrators, and 69% of the time to the highest-voted answer from Reddit.

候选层:至少 2 个不同的人、在 2 个不同月份提到过,还没到主书架的 3 人 3 个月。没有做立场标注,所以只写“被提及”。

HN 书评

推荐在前,同类按时间 · 每篇最多保留 20 条,统计用全部提及
评论benob · 2023-02

“People have been grounding LLMs with internet searches for a few months: WebGPT: Browser-assisted question-answering with human feedback https://arxiv.org/abs/2112.09332”

The New Bing with ChatGPT原评论 ↗
被提交为 story · 1 次