按年被提到
20232024 · 1 次2026
软件工程与 AI 编程›代码生成与程序合成·arXiv:2310.16937 · cs.CL

Cross-lingual Transfer in Programming Languages: An Extensive Empirical Study

Razan Baltaji, Saurabh Pujar, Louis Mandel, Martin Hirzel, Luca Buratti, Lav Varshney · 2023
开始阅读 ↗PDFalphaXiv 讨论
被提及 · 2 人首次 2024-10-29 · 最近 2025-04-07
2不同的人
2活跃月份
2讨论串
7被引(OpenAlex)
arXiv 摘要(候选层不写导读)

Large language models (LLMs) have achieved state-of-the-art performance in various software engineering tasks, including error detection, clone detection, and code translation, primarily leveraging high-resource programming languages like Python and Java. However, many critical languages, such as COBOL, as well as emerging languages, such as Rust and Swift, remain low-resource due to limited openly available code. This scarcity hampers the training and effectiveness of LLMs for these languages, increasing software maintenance costs and stifling innovation. Addressing this gap, we investigate the potential of transfer learning to enhance LLM performance on low-resource programming languages by leveraging data from high-resource counterparts. Our extensive empirical study evaluates transferability across 10 to 41 programming languages and five key tasks: code generation, clone detection, code repair, solution domain classification, and error detection. Additionally, we develop a performance prediction model to guess the best source languages for a given target and task, and analyze the features that influence transfer performance. We further replicate a representative subset of experiments with a larger model to test the generalizability of our conclusions to contemporary large-scale LLMs. Our findings demonstrate that cross-lingual transfer significantly outperforms zero-shot learning, with effectiveness varying based on both source and target languages. Furthermore, our model reliably predicts successful transfer sources by considering linguistic and dataset-specific features, offering practical guidance for data acquisition and model training. This work contributes to the development of LLM-driven tools for low-resource programming languages and provides insights into the characteristics that facilitate transfer across language pairs.

候选层:至少 2 个不同的人、在 2 个不同月份提到过,还没到主书架的 3 人 3 个月。没有做立场标注,所以只写“被提及”。

HN 书评

推荐在前,同类按时间 · 每篇最多保留 20 条,统计用全部提及
评论a_wild_dandan · 2024-10

“Evaluating cross-lingual transfer learning approaches in multilingual conversational agent models[1] Cross-lingual transfer learning for multilingual voice agents[2] Large Language Models Are Cross-Lingual Knowledge-Free Reasoners[3] An Empirical Study of Cross-Lingual Transfer Learning in Programming Languages[4] That should get you started on transf…”

GitHub cuts AI deals with Google, Anthropic原评论 ↗
评论AstroBen · 2025-04

“It seems to be fairly nuanced in how abilities transfer: https://arxiv.org/html/2310.16937v2 Very hard for me to wrap my head around the idea that an LLM being able to discuss, even perhaps teach high level chess strategy wouldn't transfer at all to its playing performance”

Recent AI model progress feels mostly like bullshit原评论 ↗