Software that will let people and robots communicate and plan difficult, complex tasks, such as dismantling a nuclear power plant, is under development at the University of Aberdeen, Scotland. It will translate symbols of mathematical logic into text and vice versa, so humans and robots can share two-way communication in their own respective language.
Human-robot communication has been the subject of a lot of research for robotic tasks as widely varied as assisting in brain surgery, to helping humans assemble products on the factory floor.
Researchers at the university's School of Natural and Computing Sciences expect their technology to be used in several industries. These include unmanned exploration of hostile environments, such as the deep sea or the Martian surface; as well as more mundane tasks, such as maintaining and repairing railway lines.
Software that will let people and robots communicate to plan difficult and complex tasks, such as dismantling a nuclear power plant, is being developed at a Scottish university. (Source: Wikimedia Commons/Stefan Kühn)
In these situations, robots could become more autonomous if they could operate for long periods without continuous guidance from humans, as well as make their own decisions after processing data. The problem is, as it stands now, robots can make mistakes that aren't apparent to humans or to themselves, or do things that humans don't understand. In an operation as dangerous and complex as decommissioning a nuclear power plant, the results could be disastrous.
"Evidence shows there may be mistrust when there are no provisions to help a human to understand why an autonomous system has decided to perform a specific task, at a particular time, and in a certain way," said Dr. Wamberto Vasconcelos, senior lecturer in the Department of Computing Science, in a press release. "What we are creating is a new generation of autonomous systems, which are able to carry out a two-way communication with humans. The ability to converse with such systems will provide us with a novel tool to quickly understand, and if necessary correct, the actions of an automated system, increasing our confidence in, and the usefulness of, such systems."
To develop the autonomous robotics systems, the project will use Natural Language Generation (NLG), which translates complex information and data into simple text summaries. The university's School of Natural and Computing Sciences staff includes several NLG researchers.
In NLG, the information and data begin as symbols of mathematical logic. (Some representative logic symbols are shown in this article's headline, in no particular order.) They are automatically transformed into simple text, so that humans and robots can discuss and plan a set of tasks before the robot carries them out.
Later, when the robot is engaged in a task, the human can communicate with it using a keyboard. Humans can ask the robot questions about why it's taking certain actions or making specific decisions, and request justifications for them. Humans can also provide the robot with additional information it can integrate into its plans, suggest alternatives, and point out problems with the robot's chosen course of action.
Vasconcelos said his team hopes the systems they are developing will be applicable not only to robots, but also to mobile phones, "which can interact with a human in useful ways, which up until now haven't been explored."
The research is funded by a £1.1 million (US$1.7 million) grant from the UK's Engineering and Physical Sciences Research Council, a government agency that funds research and training.
Teknochip, you mean to shut down all the operating systems and software before dismantling the entire system. In that case you can control only the machinery part, nothing to deal with the dangerous nuclear fission/fusion parts.
What it sounds like is that the robot will be deciding what it will do, or what it wants to do, and telling the human. That will take a whole lot more brains than robots presently have. The problem seems to be that the humans in the situation would not have enough understanding of the situation to make correct judgements. The condition of inadequate operator understanding and insight is tracable to not having an adequate operator, usually because of not respecting the skills needed for the task.
The concept of robots communicating to do some task is quite interesting, but here is a need for caution, since the understanding of separation between robots may also lead to robot self-awareness. So we need to be aware of what is being done in the field of autonomous robotics, to avoid creating the situations that have been the subject of science fiction for many years. It does have the potential to be far worse than those stories ever predicted.
Lou, I get it--thanks for the C3PO reference. I can hear his voice in my head right now, and see him chasing after R2D2, sounding like a worried nanny.
I've read the same statistic you mention, Chuck, but I'd like to know more about the specific situations. Driving a car mostly consists of understandable, easily repeatable motions. Making decisions about what to do if a truck suddenly turns around in your lane and comes back at you is a very different set of problems and decision-making. I'm giving that example because it's something completely unexpected (something similar happened to me once at 60 mph in the fast lane). In any case, something completely unexpected that the remote human can't see very well--i.e., inside a Fukushima reactor--and that needs to be done right the first time requires complex, highly sophisticated decision-making skills, and very good communication between robot and remote human. The researchers think that the ability to communicate thoroughly before and during complex, dangerous tasks, like two people would, is a good idea.
I don't really get the point of this either. If I am understanding the article, it sounds like they expect the robot to do things that the observers would have trouble figuring out. If the algorithms are that complex, it looks like the programmers would implement logging, or some trail of breadcrumbs to discern why the robot is doing what it is doing.
I'm a little surpised to hear that the robot's creators would be anticipating so much difficulty and confusion. The robotic driving systems developed by Google have been nearly flawless, despite the fact they have to deal with unpredictable humans. I recently read that Google cars have had only one accident after logging 250,000 miles, and that happened when a human driver decided to take the wheel.
Beth, this is text to logic symbols and back: no audio. As we mentioned, humans communicate with the robot via a keyboard (at least during the remote operation). Although the sources didn't specify, my guess is the humans see the robot's translated symbols-to-text on a screen. The big deal is being able to communicate in detail to a remote robot at a much more sophisticated level than was possible before. So instead of just being the humans' eyes and perhaps hands--or bomb zappers--like many of the military and rescue robots we've covered, this can let the humans stay at a distance. At Fukushima, all they could do was check and report back. Humans still had to go in to the high-rad area and decommission it. With this, they won't have to.
Mydesign, the software is not used to dismantle the power plant. The software is used to help humans and robots communicate ahead of time and during such a delicate operation, to make sure everything goes right. What other kinds of developments did you have in mind?
I agree with Tekochip; it seems like another way of translating machine algorthims into human-friendly text so data regarding the environment or instructional information can be passed back and forth. There's no spoken component to these systems, is there?? Not to say this isn't valuable or interesting, BTW.
Ann, you know what this reminds me of? C-3PO from Star Wars. That was a robot that communicated between robots and humans. It spoke millions of languages, including many machine languages.
We looked at a number of sources to determine this year's greenest cars, from KBB to automotive trade magazines to environmental organizations. These 14 cars emerged as being great at either stretching fuel or reducing carbon footprint.
Researchers at MIT and Sandia National Labs have observed a reaction in lithium-air batteries that could help improve the design of these cells for electric vehicles and other applications.
From Dell / Intel® New Paradigms in Design Work Scott Hamilton, vertical market strategist for Dell Precision workstations, 5/2/2013 3
Early in my career, I worked as a draftsman and remember the days of drawing on vellum with numbered pencils and Mylar with plastic lead. This was a fun experience in the sense that I ...
I've been using workstations for more than 10 years and love finding ways to get more performance from my system. With demanding professional applications that require more power each ...
A lasting memory from my first job as an engineer in an auto assembly plant is standing on hard concrete at six in the morning, vending-machine coffee clutched in hand, listening to ...
A quick look into the merger of two powerhouse 3D printing OEMs and the new leader in rapid prototyping solutions, Stratasys. The industrial revolution is now led by 3D printing and engineers are given the opportunity to fully maximize their design capabilities, reduce their time-to-market and functionally test prototypes cheaper, faster and easier. Bruce Bradshaw, Director of Marketing in North America, will explore the large product offering and variety of materials that will help CAD designers articulate their product design with actual, physical prototypes. This broadcast will dive deep into technical information including application specific stories from real world customers and their experiences with 3D printing. 3D Printing is
To save this item to your list of favorite Design News content so you can find it later in your Profile page, click the "Save It" button next to the item.
If you found this interesting or useful, please use the links to the services below to share it with other readers. You will need a free account with each service to share an item via that service.
Tweet This
8 
