The ability of robots to grasp different objects, recognize human gestures, and even guide surgical tools is increasing at a fast pace. A new combination of sensors, actuators, and software will give them a sense of touch for identifying textures that's even more finely tuned than a human's.
In what could be a major advance for both industrial robots and prosthetic hands, researchers at the USC Viterbi School of Engineering have developed a specially designed robot that can outperform humans in identifying a wide range of natural materials by sensing their textures. The robot has a new type of tactile sensor built to mimic the human fingertip. It uses algorithms imitating human strategies to identify textures by touch.
The BioTac tactile robotic sensor is built to mimic the human fingertip and uses algorithms imitating human strategies to identify textures by touch. (Source: SynTouch)
Built by Gerald Loeb, professor of biomedical engineering and director of the USC Medical Device Development Facility, and biomedical engineering doctoral candidate Jeremy Fishel, the multimodal BioTac fingertip-shaped sensor is filled with conductive fluid. Fingerprint-like ridges on its flexible elastomeric "skin" have a biomimetic size of 0.4mm spacing. When the BioTac slides over textured surfaces, vibrations are induced that propagate through the fluid, changing its impedance, which is sensed by electrodes. That data is conveyed to a pressure sensor.
The testbed apparatus consists of a stepper motor attached to a lever that raises or lowers the BioTac on or off of textured surfaces. Contact force is controlled by adjusting the stepper motor's vertical position. A special vibration-free linear stage is used to slide textures past the BioTac to emulate lateral motion. The textured surfaces are attached to flat, square magnets that can be quickly mounted and dismounted on a steel plate attached to the linear stage (watch a video below).
The BioTac sensor selects from a database of 117 different textures derived from common materials. The database serves as the equivalent of previous experiences the robot can use for distinguishing new textures it encounters. After selecting and making an average of five exploratory movements, the robot could correctly identify novel materials 95 percent of the time. Compared to human subjects who could not distinguish between two very similar textures, the robot was successful 99.6 percent of the time.
To differentiate the new texture from a set of plausible candidates, the discrimination algorithm uses a method when exploring a texture to adaptively select the best movement to make and the correct property to measure, based on its previous experience. Loeb and Fishel call this process "Bayesian exploration" in an article describing BioTac published in Frontiers in Neurorobotics.
"Extending this algorithm to a complete robotic system working in unstructured environments is expected to degrade the quality of measured signals, which was enhanced by the careful design of a custom-built experimental apparatus," they wrote.
"In particular, the actuators in humanoid robots are likely to be considerably noisier than our apparatus, introducing both variability into the exploratory movements and noise into the sensor signals. Additional training to better understand the characteristics of noise and variability is one way to compensate for this. We expect the Bayesian exploration method to be robust to this and evolve to make the most of available information."
The authors are also equity partners in SynTouch LLC, which develops and manufactures tactile sensors for mechatronic systems that mimic the human hand, including the BioTac.
One more example of how technology is making robots much more human-like. But what's the business benefit of having a robot develop a sense of touch? Are there specific applications where this kind of added capability would be useful?
Beth, I can think of one right off the bat from some groups I have been talking to. The application is automated product inspection. This is done now with vision systems. Adding a tactile sensor to the inspection system would be useful in a lot of situations. Presently, we use vision systems to evaluate texture of surfaces. This could be tuned to be more accurate.
The main applications mentioned by the researchers are giving industrial robots a finer sense of touch for distinguishing more easily and quickly among objects they handle, as well as prosthetic hands for people.
naperlou thanks, those are good examples of how this technology could supplement existing inspection technology. Same goes for various robotic handling and sorting functions, some of which also already use machine vision and could be supplemented by robots with a sense of touch.
Nice article and video, Ann. As the narrator notes, ultimately, the data from the robotic touch has to get between the ears of the user. I would think there is a wide range of uses for this technology.
Those applications make sense, Ann. I would imagine there are tons of other applications as well. This technology would probably be useful in search and rescue as well as military applications.
Future generations of this sensor, combined with sensors for temperature and pressure will give a very close approximation of human sensorium. Whatever sort of actuators available at that time (Festo does have some interesting ones now) will provide movement. Detxerous, sensing fingers are the result. Sensors and actuators will likely be connected to a local network router in order to simplify the trunks feeding back to the central core of the robot.
Human-like manipulators will make for very, very useful general-purpose robots, ones that don't need custom tooling to perform a job.
Ann, a few years ago, doctors at the Rehabilitation Institute of Chicago were talking about adding touch to prosthetic limbs. I wonder if this would make it easier to do that, or if it would even be possible to send the signals from this finger to the human brain.
This looks like an intersting development in sensors, but, beyond the $15000 cost of the development kit, you're going to have to invest a lot of time towards developing algorithms to interpret the sensor signals.
From an automated grapsing perspective, I can imagine a system that uses the BioTac signals to detect slippage of a grasped object and automatically tighten the gripping force to compensate. This would allow lower grasping forces in mobile robot manipulation tasks where overly tight grasping is the norm.
We looked at a number of sources to determine this year's greenest cars, from KBB to automotive trade magazines to environmental organizations. These 14 cars emerged as being great at either stretching fuel or reducing carbon footprint.
Researchers at MIT and Sandia National Labs have observed a reaction in lithium-air batteries that could help improve the design of these cells for electric vehicles and other applications.
From Dell / Intel® New Paradigms in Design Work Scott Hamilton, vertical market strategist for Dell Precision workstations, 5/2/2013 3
Early in my career, I worked as a draftsman and remember the days of drawing on vellum with numbered pencils and Mylar with plastic lead. This was a fun experience in the sense that I ...
I've been using workstations for more than 10 years and love finding ways to get more performance from my system. With demanding professional applications that require more power each ...
A lasting memory from my first job as an engineer in an auto assembly plant is standing on hard concrete at six in the morning, vending-machine coffee clutched in hand, listening to ...
A quick look into the merger of two powerhouse 3D printing OEMs and the new leader in rapid prototyping solutions, Stratasys. The industrial revolution is now led by 3D printing and engineers are given the opportunity to fully maximize their design capabilities, reduce their time-to-market and functionally test prototypes cheaper, faster and easier. Bruce Bradshaw, Director of Marketing in North America, will explore the large product offering and variety of materials that will help CAD designers articulate their product design with actual, physical prototypes. This broadcast will dive deep into technical information including application specific stories from real world customers and their experiences with 3D printing. 3D Printing is
To save this item to your list of favorite Design News content so you can find it later in your Profile page, click the "Save It" button next to the item.
If you found this interesting or useful, please use the links to the services below to share it with other readers. You will need a free account with each service to share an item via that service.