A handattached to the end of an arm is a given for most humans, but what if robots didn’t have to play by the same rules as we do? Researchers fromETH Zurichhave turned an off-the-shelf robotic hand intoa completely self-contained robotthat walks on its fingertips while using those same fingers to manipulate its environment.

Besides making the perfect Halloween accessory for anyone planning to dress up as a member of The Addams Family – who were famously accompanied by a disembodied walking handcalled Thing– the researchers say the approach could make it possible to operate controls and handle objects in places a traditionalrobot armcan’t reach.

Soft Robotics Lab, ETH Zurich/YouTube

Amirhossein Kazemipour, a Ph.D. candidate in theSoft Robotics Lab at ETH ZurichinSwitzerlandwho led the project, believes this hand could prove useful in contexts like fiddly maintenance tasks in industrial settings, or insearch and rescue, where a robot could detach its hand to explore confined spaces too tight for the rest of its body. More broadly, he says, the work is a step toward a new approach toroboticsin which body parts are not confined to a single role.

“I wanted to see how much a robotic hand could do without the rest of the robot,” Kazemipour toldIEEE Spectrum. “Instead of having this traditional view of robotic parts, what if we could use those parts to do other tasks that they are not designed to do.”

This isnot the first attempttoget a robot hand to walk, but previous work has typically relied on specially designed hands. TheETHteam instead decided to use off-the-shelf hardware fromWuji Technology, augmented with an 80-gram backpack containing a battery, an inertial measurement unit (IMU), and aRaspberry PiZero. Kazemipour says they decided to go with a commercialrobot handbecause they didn’t want to compromise on the hand’s manipulation capabilities. This introduced significant challenges, he adds, because a hand’s shape is optimized for grasping rather than crawling.

How to Walk With Fingers

To teach the hand to walk, the researchers trained a model in simulation usingreinforcement learning– an approach in which models learn skills through many rounds of trial and error, receiving rewards for getting closer to the desired behavior along with penalties when they diverge from it. But Kazemipour says the unusual geometry of a hand meant they couldn’t just reuse approaches used to train other kinds oflegged robots. Standard quadrupeds or bipeds tend to be symmetrical on their left and right sides, which simplifies walking and balance, he says. Hands, in contrast, are not at all symmetrical, with fingers of different lengths and an opposable thumb.

In addition to rewards for moving at the right speed and in the right direction and penalties for things like wobbling or jerky movement, the team introduced a novel way to keep the hand in a crawling stance during the simulated training. To account for unequal digit length, they gave each finger its own target position relative to the palm, based on where it naturally sits when in the crawling posture. They then penalized the fingers for straying too far from that reference point, creating what they describe as “virtual springs” that pull the fingers back to the crawling stance. Crucially, the penalties for fingers moving forward and backward are significantly less than those for moving side-to-side, so taking steps in that way costs the hand very little compared with the rewards it receives for moving.

The team also trained separate models for skills like righting the hand when it falls over, pressing keys on a keyboard, and pushing objects to a target. All four models fit on the onboard computer, says Kazemipour, and the controller can switch between them as necessary. In real-world tests, the hand crawled across 14 different surfaces including smooth floors, metal grates, grass, and gravel. Other experiments confirmed that it could make both right and left turns, and hit an average speed of 9 centimeters per second. The hand was able to right itself in 21 of 25 trials. When given a video feed from an overhead camera, it even managed to autonomously push a 41-gram cube to targets up to 40 cm away 15 times in a row.

“What interests me most about this work is that the same fingers can move the hand, support its weight, and interact with its surroundings,” saysMasahiko Inami, a professor at The University of Tokyo whose group has developedhand-shaped walking robots. He agrees that a mobile hand could be useful for reaching confined spaces and operating controls that an entire arm could not easily access, though he says practical deployment would require on-board perception and more robust navigation.Hideki Shimobayashi, a Ph.D. student in Inami’s lab, also points out that walking puts very different loads on a hand compared to grasping, so durability may be a challenge.

However,Matei Ciocarlie, an associate professor of mechanical engineering atColumbia University, says it’s a “cool result” that suggestsrobot handsdon’t have to be restricted to the same capabilities as their human counterparts. “One can imagine an entirely new class ofmobile manipulatorsthat are simultaneously dexterous, able to traverse complex terrain, and able to manipulate payloads comparable in size to themselves,” he says.

Kazemipour sees his work as part of a longer-term vision for robots made up of parts that are not tied to a single job or even a single body plan, something he calls “autonomous modular embodiments.” “Robotic body parts should not be permanently assigned to a single function,” he says. “They can dynamically transition between roles, between being components of one embodiment system and autonomous agents, according to the task.”

From Your Site Articles

Related Articles Around the Web