按年被提到
20182018 · 1 次2026
强化学习与智能体›深度强化学习与世界模型·arXiv:1804.10332 · cs.RO

Sim-to-Real: Learning Agile Locomotion For Quadruped Robots

Jie Tan, Tingnan Zhang, Erwin Coumans, Atil Iscen, Yunfei Bai, Danijar Hafner, Steven Bohez, Vincent Vanhoucke · 2018
开始阅读 ↗PDFalphaXiv 讨论
被提及 · 2 人首次 2018-11-16 · 最近 2020-01-27
2不同的人
2活跃月份
2讨论串
752被引(OpenAlex)
arXiv 摘要(候选层不写导读)

Designing agile locomotion for quadruped robots often requires extensive expertise and tedious manual tuning. In this paper, we present a system to automate this process by leveraging deep reinforcement learning techniques. Our system can learn quadruped locomotion from scratch using simple reward signals. In addition, users can provide an open loop reference to guide the learning process when more control over the learned gait is needed. The control policies are learned in a physics simulator and then deployed on real robots. In robotics, policies trained in simulation often do not transfer to the real world. We narrow this reality gap by improving the physics simulator and learning robust policies. We improve the simulation using system identification, developing an accurate actuator model and simulating latency. We learn robust controllers by randomizing the physical environments, adding perturbations and designing a compact observation space. We evaluate our system on two agile locomotion gaits: trotting and galloping. After learning in simulation, a quadruped robot can successfully perform both gaits in the real world.

候选层:至少 2 个不同的人、在 2 个不同月份提到过,还没到主书架的 3 人 3 个月。没有做立场标注,所以只写“被提及”。

HN 书评

推荐在前,同类按时间 · 每篇最多保留 20 条,统计用全部提及
评论candiodari · 2018-11

“There have been quite a few papers on this probem. If you don't get your simulator AND your cost function right... fun things happen. Things you probably didn't intend. Last year someone made a compilation paper about a series of fun techniques algorithms have used to satisfy the demands of their creators... while not solving the problem. It was feature…”

Evolved antenna原评论 ↗
评论nicrusso7 · 2020-01

“Well the very first attempt this guys made (https://arxiv.org/pdf/1804.10332.pdf#subsection.6.1) was let the model learn from scratch (open loop, large bounds feedback). An agile galloping gait emerged automatically also in my simulation (https://github.com/nicrusso7/rex-gym#galloping-gait---from-scratch), even if the gait was 'noisy'”

Using OpenAI Gym to train an open-source 3D printed robot原评论 ↗