按年被提到
20252025 · 4 次2026
大模型与语言模型›大模型预训练与缩放·arXiv:2501.16673 · cs.CL

LLM-AutoDiff: Auto-Differentiate Any LLM Workflow

Li Yin, Zhangyang Wang · 2025
开始阅读 ↗PDFalphaXiv 讨论
被提及 · 2 人首次 2025-01-29 · 最近 2025-07-20
2不同的人
4活跃月份
4讨论串
3被引(OpenAlex)
arXiv 摘要(候选层不写导读)

Large Language Models (LLMs) have reshaped natural language processing, powering applications from multi-hop retrieval and question answering to autonomous agent workflows. Yet, prompt engineering -- the task of crafting textual inputs to effectively direct LLMs -- remains difficult and labor-intensive, particularly for complex pipelines that combine multiple LLM calls with functional operations like retrieval and data formatting. We introduce LLM-AutoDiff: a novel framework for Automatic Prompt Engineering (APE) that extends textual gradient-based methods (such as Text-Grad) to multi-component, potentially cyclic LLM architectures. Implemented within the AdalFlow library, LLM-AutoDiff treats each textual input as a trainable parameter and uses a frozen backward engine LLM to generate feedback-akin to textual gradients -- that guide iterative prompt updates. Unlike prior single-node approaches, LLM-AutoDiff inherently accommodates functional nodes, preserves time-sequential behavior in repeated calls (e.g., multi-hop loops), and combats the "lost-in-the-middle" problem by isolating distinct sub-prompts (instructions, formats, or few-shot examples). It further boosts training efficiency by focusing on error-prone samples through selective gradient computation. Across diverse tasks, including single-step classification, multi-hop retrieval-based QA, and agent-driven pipelines, LLM-AutoDiff consistently outperforms existing textual gradient baselines in both accuracy and training cost. By unifying prompt optimization through a graph-centric lens, LLM-AutoDiff offers a powerful new paradigm for scaling and automating LLM workflows - mirroring the transformative role that automatic differentiation libraries have long played in neural network research.

候选层:至少 2 个不同的人、在 2 个不同月份提到过,还没到主书架的 3 人 3 个月。没有做立场标注,所以只写“被提及”。

HN 书评

推荐在前,同类按时间 · 每篇最多保留 20 条,统计用全部提及
评论Xmd5a · 2025-04

“Stumbled upon this in another thread: https://ai-analytics.wharton.upenn.edu/generative-ai-labs/research-and-technical-reports/tech-report-prompt-engineering-is-complicated-and-contingent/ My point still holds that it is optimizable though (https://github.com/zou-group/textgrad, https://arxiv.org/abs/2501.16673) >Subjects develop elaborate "rain dances…”

The AI skeptic's guide to AI collaboration原评论 ↗
评论Xmd5a · 2025-06

“This is exactly what I'm doing. Some papers I'm studying: TextGrad: Automatic "Differentiation" via Text: https://arxiv.org/abs/2406.07496 LLM-AutoDiff: Auto-Differentiate Any LLM Workflow: https://arxiv.org/abs/2501.16673 Trace is the Next AutoDiff: Generative Optimization with Rich Feedback, Execution Traces, and LLMs: https://arxiv.org/abs/2406.162…”

A deep dive into self-improving AI and the Darwin-Gödel Machine原评论 ↗
评论Xmd5a · 2025-07

“>A database query might return 10,000 rows, but the agent only needs to know "query succeeded, 10k results, here are the first 5." Designing these abstractions is an art. It seems the author never used prompt/workflow optimization techniques. LLM-AutoDiff: Auto-Differentiate Any LLM Workflow https://arxiv.org/pdf/2501.16673”

The current hype around autonomous agents, and what actually works in production原评论 ↗
被提交为 story · 1 次