“This is a nice concise format to display model cards”
Model Cards for Model Reporting
提出模型卡:随模型发布的标准化评估说明文档
论文建议已发布的模型应附带说明其性能特征的文档,并提出「模型卡」框架:它是随训练好的模型一起提供的简短文档,给出模型在不同文化、人口统计、表型及其交叉群体等条件下的基准评估结果,披露预期使用场景和评估流程等信息,以促进透明报告、减少模型在不适用场景中的使用。作者还给出两个监督模型的示例卡:检测微笑人脸的图像模型和检测有害评论的文本模型。
评论者把它当作「模型卡」概念的出处,用来解释这种标准化的模型文档(预期用途、指标、训练数据、局限)从哪里来,以及它出自大语言模型之前谷歌的这项工作。
HN 书评
推荐在前,同类按时间 · 每篇最多保留 20 条,统计用全部提及“Model documentation frameworks[2]”
“the model card they added is a direct result of research Timnit was involved with: Model Cards for Model Reporting”
“Having a more standardized description, something like model cards [1] (CV example [2]) would be hugely beneficial IMO.”
“2018: Model cards paper was put on arXiv Model Cards for Model Reporting”
“It's an instance of a "model card", some broad headings to be filled in.[1]”
看全部 10 条 →
“To my knowledge, this is the origin of model cards:”
“terminology originated: Model Cards for Model Reporting”
“concept actually comes from a pre-LLM Google paper”
“The idea of a model card originated in 2018 (see Model Cards for Model Reporting) as a summary of important facts about a model.”