“Waymo just published a paper yesterday titled MotionLM [1], where they’re representing motion prediction as a language modeling task. I’m curious to see how much traction LLM-like techniques get in safety critical environments like autonomous driving. I don’t know if Waymo has already deployed it, but they’re in the best position to evaluate it. [1] htt…”
MotionLM: Multi-Agent Motion Forecasting as Language Modeling
Reliable forecasting of the future behavior of road agents is a critical component to safe planning in autonomous vehicles. Here, we represent continuous trajectories as sequences of discrete motion tokens and cast multi-agent motion prediction as a language modeling task over this domain. Our model, MotionLM, provides several advantages: First, it does not require anchors or explicit latent variable optimization to learn multimodal distributions. Instead, we leverage a single standard language modeling objective, maximizing the average log probability over sequence tokens. Second, our approach bypasses post-hoc interaction heuristics where individual agent trajectory generation is conducted prior to interactive scoring. Instead, MotionLM produces joint distributions over interactive agent futures in a single autoregressive decoding process. In addition, the model's sequential factorization enables temporally causal conditional rollouts. The proposed approach establishes new state-of-the-art performance for multi-agent motion prediction on the Waymo Open Motion Dataset, ranking 1st on the interactive challenge leaderboard.
候选层:至少 2 个不同的人、在 2 个不同月份提到过,还没到主书架的 3 人 3 个月。没有做立场标注,所以只写“被提及”。
HN 书评
推荐在前,同类按时间 · 每篇最多保留 20 条,统计用全部提及- MotionLM: Multi-Agent Motion Forecasting as Language Modeling ↗ra7 · 2023-09-29 · 1 分
- MotionLM: Multi-Agent Motion Forecasting as Language Modeling ↗bpierre · 2023-10-02 · 1 分