SYLOQ

Robotics · 5 min read

How humanoid robots are learning to move

Balance stopped being programmed and started being learned.

How humanoid robots are learning to move

From equations to experience

For decades walking robots followed hand-written models of their own dynamics. Today most impressive demonstrations come from policies trained in simulation across millions of falls, then transferred to hardware.

millions

Simulated falls behind a single stable gait

Why the transfer works at all

Randomising friction, mass and latency during training forces the policy to be robust rather than precise. A controller that survives a thousand imaginary floors tends to survive a real one.

The machines are not being taught to walk. They are being allowed to fail until walking is what remains.

What remains hard

Hands. Manipulation demands force control and contact reasoning that locomotion largely avoids, and it is where most humanoid programmes now spend their time.

Sources & further reading