Robot Hand 'Sees' Around Corners Like Human Fingers

A new robotic hand can wrap around fragile objects and still "see" what it's touching, solving one of robotics' biggest challenges.

Researchers at Zhejiang University developed FlexiRay, a flexible robotic gripper that mimics how human hands combine soft skin with precise sensing. Unlike stiff robotic hands that struggle with delicate or oddly shaped objects, this one bends naturally like a fish fin while maintaining full awareness of what it touches.

The secret lies in a clever mirror system inside each finger. When the finger wraps around an object, the mirrors redirect the internal camera's view to see around the bend. What used to be a problem (blocking the camera when bending) became the solution.

"We transform the structural obstruction from a hindrance into a functional mechanism," explained senior researcher Huixu Dong. The finger's special skin changes color with heat and reflects light to capture multiple types of information at once.

With just one camera per finger, FlexiRay detects pressure, shape, texture, and temperature simultaneously. In tests, it achieved over 90% sensing coverage even during major deformations. The system can tell exactly where it's touching an object and how much force it's applying.

The team demonstrated the hand making tea remotely, showing how it could handle a long sequence of delicate tasks. The robot safely gripped cups, felt temperatures, and manipulated objects without crushing them.

Why This Inspires

This breakthrough moves us closer to helpful robots in everyday life. Future robots could assist elderly people at home, work alongside humans in factories, or help with household chores without breaking dishes or damaging belongings.

The research flips traditional robotics thinking on its head. Instead of fighting against flexibility to get good sensing, the team embraced it. Their approach proves that robots can be both gentle and aware, opening doors for safer human-robot collaboration.

The technology could make robots more accessible and useful in settings where rigid grippers fail. From carefully handling fragile medical equipment to sorting delicate produce, the applications span countless industries.

The findings appeared in Nature Communications, marking a major step forward in creating robots that work naturally alongside people in real-world environments.