Software that will let people and robots communicate and plan difficult, complex tasks, such as dismantling a nuclear power plant, is under development at the University of Aberdeen, Scotland. It will translate symbols of mathematical logic into text and vice versa, so humans and robots can share two-way communication in their own respective language.
Human-robot communication has been the subject of a lot of research for robotic tasks as widely varied as assisting in brain surgery, to helping humans assemble products on the factory floor.
Researchers at the university's School of Natural and Computing Sciences expect their technology to be used in several industries. These include unmanned exploration of hostile environments, such as the deep sea or the Martian surface; as well as more mundane tasks, such as maintaining and repairing railway lines.
Software that will let people and robots communicate to plan difficult and complex tasks, such as dismantling a nuclear power plant, is being developed at a Scottish university. (Source: Wikimedia Commons/Stefan Kühn)
In these situations, robots could become more autonomous if they could operate for long periods without continuous guidance from humans, as well as make their own decisions after processing data. The problem is, as it stands now, robots can make mistakes that aren't apparent to humans or to themselves, or do things that humans don't understand. In an operation as dangerous and complex as decommissioning a nuclear power plant, the results could be disastrous.
"Evidence shows there may be mistrust when there are no provisions to help a human to understand why an autonomous system has decided to perform a specific task, at a particular time, and in a certain way," said Dr. Wamberto Vasconcelos, senior lecturer in the Department of Computing Science, in a press release. "What we are creating is a new generation of autonomous systems, which are able to carry out a two-way communication with humans. The ability to converse with such systems will provide us with a novel tool to quickly understand, and if necessary correct, the actions of an automated system, increasing our confidence in, and the usefulness of, such systems."
To develop the autonomous robotics systems, the project will use Natural Language Generation (NLG), which translates complex information and data into simple text summaries. The university's School of Natural and Computing Sciences staff includes several NLG researchers.
In NLG, the information and data begin as symbols of mathematical logic. (Some representative logic symbols are shown in this article's headline, in no particular order.) They are automatically transformed into simple text, so that humans and robots can discuss and plan a set of tasks before the robot carries them out.
Later, when the robot is engaged in a task, the human can communicate with it using a keyboard. Humans can ask the robot questions about why it's taking certain actions or making specific decisions, and request justifications for them. Humans can also provide the robot with additional information it can integrate into its plans, suggest alternatives, and point out problems with the robot's chosen course of action.
Vasconcelos said his team hopes the systems they are developing will be applicable not only to robots, but also to mobile phones, "which can interact with a human in useful ways, which up until now haven't been explored."
The research is funded by a £1.1 million (US$1.7 million) grant from the UK's Engineering and Physical Sciences Research Council, a government agency that funds research and training.
Lou, I get it--thanks for the C3PO reference. I can hear his voice in my head right now, and see him chasing after R2D2, sounding like a worried nanny.
What it sounds like is that the robot will be deciding what it will do, or what it wants to do, and telling the human. That will take a whole lot more brains than robots presently have. The problem seems to be that the humans in the situation would not have enough understanding of the situation to make correct judgements. The condition of inadequate operator understanding and insight is tracable to not having an adequate operator, usually because of not respecting the skills needed for the task.
The concept of robots communicating to do some task is quite interesting, but here is a need for caution, since the understanding of separation between robots may also lead to robot self-awareness. So we need to be aware of what is being done in the field of autonomous robotics, to avoid creating the situations that have been the subject of science fiction for many years. It does have the potential to be far worse than those stories ever predicted.
Teknochip, you mean to shut down all the operating systems and software before dismantling the entire system. In that case you can control only the machinery part, nothing to deal with the dangerous nuclear fission/fusion parts.
Naperlou, that's for the clarification. You mean a remote program to control the entire operations, which can help to avoid the usage of robots in case of disaster.
Ann, I have some other idea for disaster management, where humans can interact with robots via wifi or any other communication channel. This will help for a remote control operation from a master facility to control each and every wing of the nuclear station and safe shut down, in case of disaster.
Thanks, William, I think you captured the point of this research in your comments about autonomy. It is aimed at more autonomy in robots, which is why communication has to be much more detailed, and accurate, than it has to date. But inadequacy of the human operator is not the issue: inadequacy and incompleteness of information about why the robot makes the decisions it makes was one of the main spurs to this research. The two-way logic-to-text and text-to-logic communication will also let the human make informed suggestions and provide more data once it understands the situation as reported by the robot.
Mydesign, wireless communication with remote-controlled robots is already used in military, nautical and rescue robots, among many other types, as we've mentioned before: http://www.designnews.com/author.asp?section_id=1386&doc_id=247687 http://www.designnews.com/author.asp?section_id=1386&doc_id=242527 http://www.designnews.com/author.asp?section_id=1386&doc_id=246206 But that does not solve the communication problem. Most robots can only report back very limited types of data. And communication is one way in one direction and then one way in the other direction. It does not allow for full-duplex two-way conversations. Plus, the robots are not intelligent enough, or autonomous enough, to perform the delicate operations of decommissioning a nuclear power plant.
Yes, Ann, the robots have only their sensor information to base decisions on, and that is often not enough to make the very best choice. That was part of the basis for my comments about the value of experienced humans in the loop. Robots lack insight and understanding, they can only make the decisions that they are programmed to make, which may well be safe, but probably not optimum.
Giving the robots more data by allowing accurate communication will certainly offer the potential for better choices, and the concept of communicating that basis for the choices to a human is a good idea that should have been put into practice about 25 years ago.
William, thanks for clarifying. I agree, when I read the initial report, I thought why the heck hadn't somebody already figured this out and implemented it ages ago? OTOH, I don't think the state of hardware--sensors and processors--and comms tech were available for robots that could take advantage of this "translation" program.
The robot is following some program that some human loaded into it. The robot can only do what the programmer told it to do.
So, the human tells the robot what to do (via the program), and then the human says "why are you doing that?". The answer is always the same - "because you told me to".
I would think the obvious solution to this supposed problem is to send all sensor data to a computer that is running the same decision making software as the robot, and watch what the program is doing. (It will be doing what you told it to do - which may or may not be what you thought you told it to do.)
This article somehow makes it sound like the robot has a mind of its own. It doesn't. It can only do what some human told it to do, so why ask it why? The answer is, I'm doing what you told me to do given these sensor values.
Gigabit and PoE are two networking technologies moving ahead in tandem as industrial users power remote Ethernet devices such as IP security cameras at 1,000 Mbps over existing CAT5 cable.
New disc magnet motors fit into the design trend of stepping up to closed loop performance while maintaining the cost advantage of stepper motor technology.
At the Design News webinar on June 27, learn all about aluminum extrusion: designing the right shape so it costs the least, is simplest to manufacture, and best fits the application's structural requirements.
A new battery design, which replaces lithium with abundant and low-cost elemental sulfur, is still in its nascent stages but shows real promise for giving batteries more energy potential.
From Dell / Intel® New Paradigms in Design Work Scott Hamilton, vertical market strategist for Dell Precision workstations, 5/2/2013 5
Early in my career, I worked as a draftsman and remember the days of drawing on vellum with numbered pencils and Mylar with plastic lead. This was a fun experience in the sense that I ...
I've been using workstations for more than 10 years and love finding ways to get more performance from my system. With demanding professional applications that require more power each ...
A lasting memory from my first job as an engineer in an auto assembly plant is standing on hard concrete at six in the morning, vending-machine coffee clutched in hand, listening to ...
For industrial control applications, or even a simple assembly line, that machine can go almost 24/7 without a break. But what happens when the task is a little more complex? That’s where the “smart” machine would come in. The smart machine is one that has some simple (or complex in some cases) processing capability to be able to adapt to changing conditions. Such machines are suited for a host of applications, including automotive, aerospace, defense, medical, computers and electronics, telecommunications, consumer goods, and so on. This radio show will show what’s possible with smart machines, and what tradeoffs need to be made to implement such a solution.
To save this item to your list of favorite Design News content so you can find it later in your Profile page, click the "Save It" button next to the item.
If you found this interesting or useful, please use the links to the services below to share it with other readers. You will need a free account with each service to share an item via that service.
Tweet This
2 
