In September we wrote about researchers using functional magnetic resonance imaging (fMRI) to enable thought control of a robot thousands of miles away, in a scenario reminiscent of the movie Avatar. The news was exciting, but the accompanying video from the Japanese AIST (National Institute of Advanced Industrial Science and Technology) was a bit disappointing. A larger, clearer video, showing the control of a bigger, more sophisticated nearby robot, is now available from the joint robotics laboratory (JRL) of the AIST and the French CNRS (Centre National de la Recherche Scientifique).
According to Abderrahmane Kheddar, director of the CNRS-AIST JRL, in a video interview conducted by DigiInfo TV, the idea behind the research is to let people feel as if they are truly embodied in the robot. This is especially important for the paraplegics and tetraplegics who are one group of targets for the technology, using it to navigate. For example, "a paraplegic patient in Rome would be able to pilot a humanoid robot for sightseeing in Japan," said Kheddar.
By focusing their attention on patterns created by flickering lights on a PC screen, which are associated with specific actions, users can control which actions they want a robot to perform, where the robot moves, and how it interacts with its environment. (Source: CNRS-AIST Joint Robotics Laboratory)
In the video, a researcher wears a cap peppered with electrodes, and watches a PC screen. Flashing symbols control where the robot moves and how it interacts with its environment, while another researcher helps keep it upright. One pattern on the screen associates flickering lights with specific actions. By focusing their attention, users can induce which actions they want the robot to perform.
"We read the electric activities of the brain that are transferred to this PC, and then there is a signal processing unit which is trying to classify what the user is thinking," said Kheddar. "As you see here there are several icons that can be associated with tasks, or you can recognize an object that will flicker automatically. With different frequencies we can recognize which frequency the user is focusing his attention to and then we can select this object. Since the object is associated with a task, it's easy to instruct the robot which task it has to perform."
In related work taking place at the AIST's Intelligent Systems Research Institute in Tsukuba, Japan, researchers from both countries are pursuing means to increase a humanoid robot's functional autonomy. Specific research topics include task and motion planning and control, control of reactive behaviors, and cooperation between human and robot via a multimodal interface that integrates a brain-computer interface (BCI), vision, and haptics. The joint project includes multiple collaborative research projects with other research institutes in both Europe and Japan.
In the US, a Brown University study earlier this year resulted in the control of a robotic arm by a paralyzed woman who has been unable to move her arms and legs for 15 years. For the first time since her paralysis, tetraplegic Cathy Hutchinson controlled the arm to pick up a bottle, and steer it toward her to take a drink.
Jim_E, thanks for the link to that Wired article (and I agree about print editions: Rolling Stone in the hand is very different from Rolling Stone on line, e.g.). But trying to control the incredibly complex movements of a hand and its fingers has got to be a few orders of magnitude more complicated than controlling legs enough to make them walk. So I'm not surprised there's been little progress in that area.
Chuck, I wish we had more info on the project's engineering details, which are still under development. Considering how much work has already been done aimed at similar goals, such as various methods of motion capture, I suspect it won't take all that long to write the algorithms. Battar, thanks for the response on this subject, too. FWIW, Fujitsu started working on turning the electrical impulses from a person's thoughts into electronically controlled actions back in the late 80s to early 90s.
Interesting link, Jim_E. Thanks for posting. I would think that the "bionic limb" idea would actually be easier since they are trying the use the biological processes already in place to do essentially what they were designed to do - think about moving your hand that used to be at the end of your arm and the new hand at the end of your arm moves as the original once did. The process of separate robots seems like a whole other ballgame.
I was just reading this article in Wired ( the real paper magazine, which I prefer ) about the difficulties of controlling prosthectics via mind control.
Thanks, Battar. What you say makes sense. I still have to admit, though, I find it stunning that a software algorithm can read the electrical activities of the brain and translate it into anything.
Greg, the elderly could certainly benefit if they're among either target group, such as people confined to bed or wheelchairs. Since the technology is still being developed, most of the current learning curve is occurring among experimenters as they learn what thoughts produce what actions. Ideally, there won't be much for users.
The algorithms are far simpler than you think because you have a "man-in-the-loop" who can unconciously compensate for fairly large errors. For example, given 2 systems which react with a 30 degree difference in angular movement for the same input - well with one you'll just push a little harder until you get the desired result. You wouldn't even notice it. With fully automated autonomous systems, output must match input exactly or there will be trouble.
This technology could take prosthetics to a new level for users. While it may be awkward now, I would guess this technology will be refined in coming years.
By refining topologies and using new fluid technology, Moog's new peak sine drive controller increases available power without increasing controller volume.
Lantronix Inc. has expanded its line of controllers for sensor networks with the release of a rugged controller that improves management of automation systems used in a number of industries, including manufacturing, oil and gas, and chemicals.
Inspired by the hooks a parasitic worm uses to penetrate its host's intestines, the Karp Lab has invented a flexible adhesive patch covered with microneedles that adheres well to wet, soft tissues, but doesn't cause damage when removed.
From Dell / Intel® New Paradigms in Design Work Scott Hamilton, vertical market strategist for Dell Precision workstations, 5/2/2013 3
Early in my career, I worked as a draftsman and remember the days of drawing on vellum with numbered pencils and Mylar with plastic lead. This was a fun experience in the sense that I ...
I've been using workstations for more than 10 years and love finding ways to get more performance from my system. With demanding professional applications that require more power each ...
A lasting memory from my first job as an engineer in an auto assembly plant is standing on hard concrete at six in the morning, vending-machine coffee clutched in hand, listening to ...
A quick look into the merger of two powerhouse 3D printing OEMs and the new leader in rapid prototyping solutions, Stratasys. The industrial revolution is now led by 3D printing and engineers are given the opportunity to fully maximize their design capabilities, reduce their time-to-market and functionally test prototypes cheaper, faster and easier. Bruce Bradshaw, Director of Marketing in North America, will explore the large product offering and variety of materials that will help CAD designers articulate their product design with actual, physical prototypes. This broadcast will dive deep into technical information including application specific stories from real world customers and their experiences with 3D printing. 3D Printing is
To save this item to your list of favorite Design News content so you can find it later in your Profile page, click the "Save It" button next to the item.
If you found this interesting or useful, please use the links to the services below to share it with other readers. You will need a free account with each service to share an item via that service.
Tweet This
7 
