按年被提到
20202023 · 1 次2026
机器学习与深度学习›时间序列与天气预报·arXiv:2009.13807 · cs.LG

Current Time Series Anomaly Detection Benchmarks are Flawed and are Creating the Illusion of Progress

Renjie Wu, Eamonn J. Keogh · 2020
开始阅读 ↗PDFalphaXiv 讨论
被提及 · 2 人首次 2023-11-29 · 最近 2025-08-02
2不同的人
3活跃月份
3讨论串
245被引(OpenAlex)
arXiv 摘要(候选层不写导读)

Time series anomaly detection has been a perennially important topic in data science, with papers dating back to the 1950s. However, in recent years there has been an explosion of interest in this topic, much of it driven by the success of deep learning in other domains and for other time series tasks. Most of these papers test on one or more of a handful of popular benchmark datasets, created by Yahoo, Numenta, NASA, etc. In this work we make a surprising claim. The majority of the individual exemplars in these datasets suffer from one or more of four flaws. Because of these four flaws, we believe that many published comparisons of anomaly detection algorithms may be unreliable, and more importantly, much of the apparent progress in recent years may be illusionary. In addition to demonstrating these claims, with this paper we introduce the UCR Time Series Anomaly Archive. We believe that this resource will perform a similar role as the UCR Time Series Classification Archive, by providing the community with a benchmark that allows meaningful comparisons between approaches and a meaningful gauge of overall progress.

候选层:至少 2 个不同的人、在 2 个不同月份提到过,还没到主书架的 3 人 3 个月。没有做立场标注,所以只写“被提及”。

HN 书评

推荐在前,同类按时间 · 每篇最多保留 20 条,统计用全部提及
评论beryilma · 2024-08

“Obligatory link from a sceptic: https://arxiv.org/pdf/2009.13807 > However, they wanted to develop a technique that avoids fine-tuning, a process in which engineers retrain a general-purpose LLM on a small amount of task-specific data to make it an expert at one task. This method does not avoid fine tuning. It just offloads the task to somebody else (i.…”

MIT researchers use large language models to flag problems in complex systems原评论 ↗
评论bsoles · 2025-08

“There are also extremely misleading research articles out there promising good results with deep networks in the area of anomaly detection, without adequate comparison with more classical techniques. This well-known critical paper shows examples of AI articles/techniques applied to popular datasets with good-looking results. But, it also demonstrates tha…”

Does the Bitter Lesson Have Limits?原评论 ↗
被提交为 story · 1 次