按年被提到
20242025 · 2 次2026
大模型与语言模型›提示工程与输出稳定性·arXiv:2411.10541 · cs.CL

Does Prompt Formatting Have Any Impact on LLM Performance?

Jia He, Mukund Rungta, David Koleczek, Arshdeep Sekhon, Franklin X Wang, Sadid Hasan · 2024
开始阅读 ↗PDFalphaXiv 讨论
被提及 · 2 人首次 2025-07-06 · 最近 2025-08-10
2不同的人
2活跃月份
2讨论串
103被引(OpenAlex)
arXiv 摘要(候选层不写导读)

In the realm of Large Language Models (LLMs), prompt optimization is crucial for model performance. Although previous research has explored aspects like rephrasing prompt contexts, using various prompting techniques (like in-context learning and chain-of-thought), and ordering few-shot examples, our understanding of LLM sensitivity to prompt templates remains limited. Therefore, this paper examines the impact of different prompt templates on LLM performance. We formatted the same contexts into various human-readable templates, including plain text, Markdown, JSON, and YAML, and evaluated their impact across tasks like natural language reasoning, code generation, and translation using OpenAI's GPT models. Experiments show that GPT-3.5-turbo's performance varies by up to 40\% in a code translation task depending on the prompt template, while larger models like GPT-4 are more robust to these variations. Our analysis highlights the need to reconsider the use of fixed prompt templates, as different formats can significantly affect model performance.

候选层:至少 2 个不同的人、在 2 个不同月份提到过,还没到主书架的 3 人 3 个月。没有做立场标注,所以只写“被提及”。

HN 书评

推荐在前,同类按时间 · 每篇最多保留 20 条,统计用全部提及
评论kinduff · 2025-07

“I found some papers [n] about this. And I think the answer is yes, the format matters asnd hence the representation. I wonder if the author would be willing to try with another representation. [1]: Does Prompt Formatting Have Any Impact on LLM Performance? https://arxiv.org/html/2411.10541v1 [2]: Large Language Models(LLMs) on Tabular Data: Prediction,…”

Baba Is Eval原评论 ↗
被提交为 story · 1 次