HOME  |  NEWS  |  BLOGS  |  MESSAGES  |  FEATURES  |  VIDEOS  |  WEBINARS  |  RESOURCE CENTER  |  INDUSTRIES
REGISTER   |   LOGIN   |   HELP
Blogs
Blog
Video: Robots Recognize Human Gestures
6/20/2012

A*Star Institute for Infocomm Research has created gesture recognition software  that lets robots recognize human gestures.  (Source: Measureand Inc.)
A*Star Institute for Infocomm Research has created gesture recognition software
that lets robots recognize human gestures.
(Source: Measureand Inc.)

Return to Article

View Comments: Threaded|Newest First|Oldest First
Beth Stackpole
User Rank
Blogger
Taking a page from gamers
Beth Stackpole   6/20/2012 7:44:26 AM
Very cool project. It's really interesting how widespread an impact gaming technology is having on so-called "serious" development, from robotics to CAD software. Kinect-like interfaces are popping up in a variety of different platforms and will push the envelope in terms of helping people interact with previously pretty inaccessible technologies.

naperlou
User Rank
Blogger
Re: Taking a page from gamers
naperlou   6/20/2012 9:06:11 AM
NO RATINGS
The Kinect approach is definately an important one for machine control.  It is also most like human vision.  I have seen, over many years (decades) the attempt to create autonomous vehicles and machines.  They often use exotic sensors.  Lately, though, there have been articles about using a Kinect system to drive these.  The vision system is often coupled with a database or model of the scenario.  This is much like what we humans do.  Factory robots are starting to use some of this technology as well.  This is a lot like the small robots that mimic insects, or other creatures.  Mimicing humans may be the way to go here as well.

Ann R. Thryft
User Rank
Blogger
Re: Taking a page from gamers
Ann R. Thryft   6/20/2012 1:06:35 PM
NO RATINGS
I think the key here is the Kinect visual-based motion sensor--a picture is worth 1000 lines of code? It's analogous to talking to your computer. They are both much more natural ways of interacting with machines, at least from the human perspective.

Rob Spiegel
User Rank
Blogger
Re: Taking a page from gamers
Rob Spiegel   6/20/2012 3:37:59 PM
NO RATINGS
Cool article, Ann. The video is quite amazing. While robots have been used for years in automation, your stories lately show a whole new side of robot potential. 

flared0ne
User Rank
Platinum
Something interesting to be considered.
flared0ne   6/20/2012 5:13:56 PM
NO RATINGS
Nice to see gesture recognition is getting up to speed and developing some traction in public awareness. Given the several mentions of various Kinect sensor implementations, it seems fair to mention another "disruptively innovative" technology which handles all the tasks this article describes. Look for and check out the threads of commentary, info etc which were started when a company named Leap Motion made an announcement on May 21st.

Key elements of their announcement: an inexpensive sensor device which enables position-detection, motion-detection, and gesture recognition -- with a reproducible position-detection accuracy of 0.01mm (i.e., ten micrometers, one wavelength of long-wavelength-range IR), anywhere within a "recognition space" volume of eight cubic feet. And a movement detect-and-report latency below the threshold for human perception -- USB comm latency and your monitor's refresh rate are the bottlenecks there (I'm still hoping to hear a stat for maximum trackable position rate-of-change, re effective point-measurement-rate). And an API which uses perhaps 5% of the CPU time on a nothing-to-write-home-about generic PC.  ...Hey, my jaw dropped too.

I am just one of many hopeful entries in their (still open) pool of developer applicants, with thousands scheduled to be selected to receive an SDK and a free Leap device in the next three months or so. Their obvious intention is to "crowd-source" a base of useable applications by the time the device is commercially available in the first part of 2013. Devices can be pre-ordered now, for the impatient.

Look for their website, their facebook page, their YouTube videos, and their forums. Because of patents pending, complete specs and technique info have not yet been released, but there has been some fairly credible guessing going on.

Important to note: The Leap technology will be making OUR reality "machine readable" -- If you can SEE something, you can use it as an input for consideration. No tape required. Anticipate interesting times.

Ann R. Thryft
User Rank
Blogger
Re: Something interesting to be considered.
Ann R. Thryft   6/21/2012 11:53:21 AM
NO RATINGS
flared0ne, I did see the Leap announcement, but so far it's not a real product yet. If they can do what they say they want to do, it may leave Kinect technology in the dust. Also, as we stated in my article: ShapeTape was used only to test the A*Star system. It will not be required to use it: that's what Kinect is for.

Charles Murray
User Rank
Blogger
Re: Taking a page from gamers
Charles Murray   6/20/2012 6:57:34 PM
NO RATINGS
Great story, Ann. I'm not familiar with ShapeTape sensing. How does it work?

Ann R. Thryft
User Rank
Blogger
Re: Taking a page from gamers
Ann R. Thryft   6/21/2012 11:54:13 AM
NO RATINGS
Chuck, here's a link to a page that describes how ShapeTape works, although not in much detail: http://www.measurand.com/shapetape.htm

Charles Murray
User Rank
Blogger
Re: Taking a page from gamers
Charles Murray   6/21/2012 9:23:58 PM
NO RATINGS
The ShapeTape truly is amazing, especially in terms of its real-time capabilities. Thanks, Ann.  

Ann R. Thryft
User Rank
Blogger
Re: Taking a page from gamers
Ann R. Thryft   6/22/2012 12:31:27 PM
NO RATINGS
Chuck, I think the ShapeTape almost deserves its own story, although it's not really used in apps we cover. Those include motion-capture techniques for animated movies: I've seen two that use a similar (if not the same) technology, and both were considered ground-breaking. One is the animated film based on Beowulf with Angelina Jolie playing Grendel's mom, and the other was A Scanner Darkly, based on a Philip K. Dick novel.

proent@pd.jaring.my
User Rank
Iron
Like a Chinese Puppet Opera
proent@pd.jaring.my   6/20/2012 6:02:34 PM
NO RATINGS

It is visualising an idea like the Chinese Puppet Opera Show. This is a new achievement, applications of this creation yet to determine. Remote handling an explosive item ?

Mydesign
User Rank
Platinum
Robots in Disater Area
Mydesign   6/21/2012 2:11:50 AM
NO RATINGS
Ann, I think this is a great achievement and revolutionary thought, where robots can be used in a very human friendly way. I think it may be able to detect the remote motions also, where we can use such technologies is disaster areas.

bobjengr
User Rank
Platinum
HUMAN GESTURES
bobjengr   6/21/2012 7:27:14 PM
NO RATINGS

Truly amazing!  I am also amazed at the speed in which the robotic system duplicates the movement of the shape tape and the degrees of freedom exhibited by the arm.   If the robots get much more sophistificated we will have to make sure the designers employ Asimov's Three Laws of Robotics:

  1. A robot may not injure a human being or, through inaction, allow a human being to come to harm.
  2. A robot must obey the orders given to it by human beings, except where such orders would conflict with the First Law.
  3. A robot must protect its own existence as long as such protection does not conflict with the First or Second Laws.

I suspect we have a long way to go but it seems to me the progress  is consistent and steady.  Great article Ann.

Ann R. Thryft
User Rank
Blogger
Re: HUMAN GESTURES
Ann R. Thryft   6/22/2012 12:12:31 PM
NO RATINGS
Thanks, Bob. Glad you like my articles on robots. Some truly amazing things are being done in robotics. I think you're right: we may need Asimov's 3 laws sooner than we realize: I just submitted a story on a swimming robot. Of course, if you think the future is going to go more along the lines of the Terminator story-line, then it may be already too late, lol.

Partner Zone
More Blogs
Gigabit and PoE are two networking technologies moving ahead in tandem as industrial users power remote Ethernet devices such as IP security cameras at 1,000 Mbps over existing CAT5 cable.
New disc magnet motors fit into the design trend of stepping up to closed loop performance while maintaining the cost advantage of stepper motor technology.
At the Design News webinar on June 27, learn all about aluminum extrusion: designing the right shape so it costs the least, is simplest to manufacture, and best fits the application's structural requirements.
Design News's latest radio show explores the benefits – and tradeoffs – of smart machines.
A new battery design, which replaces lithium with abundant and low-cost elemental sulfur, is still in its nascent stages but shows real promise for giving batteries more energy potential.
Design News Webinar Series
5/30/2013 11:00 a.m. California / 2:00 p.m. New York / 7:00 p.m. London
5/29/2013 11:00 a.m. California / 2:00 p.m. New York / 7:00 p.m. London
6/25/2013 11:00 a.m. California / 2:00 p.m. New York / 7:00 p.m. London
6/27/2013 11:00 a.m. California / 2:00 p.m. New York / 7:00 p.m. London
Blogs from Our Sponsors
From Dell / Intel®
New Paradigms in Design Work
Scott Hamilton, vertical market strategist for Dell Precision workstations, 5/2/2013    5
Early in my career, I worked as a draftsman and remember the days of drawing on vellum with numbered pencils and Mylar with plastic lead. This was a fun experience in the sense that I ...
From Dell / Intel®
Increased Workstation Performance Is as Easy as 'DPPO'
Trey Morton, Dell, 4/25/2013    2
I've been using workstations for more than 10 years and love finding ways to get more performance from my system. With demanding professional applications that require more power each ...
From Dell / Intel®
Taking Some of the Grit out of Manufacturing
Kirsten Billhardt, Manufacturing Industry Marketing Strategist, Dell, 3/26/2013    5
A lasting memory from my first job as an engineer in an auto assembly plant is standing on hard concrete at six in the morning, vending-machine coffee clutched in hand, listening to ...
Quick Poll
The Continuing Education Center offers engineers an entirely new way to get the education they need to formulate next-generation solutions.
Jun 24 - 28, Design Your Own Android App
SEMESTERS: 1  |  2  |  3


DN Radio
Sponsored by
NEXT UPCOMING BROADCAST
For industrial control applications, or even a simple assembly line, that machine can go almost 24/7 without a break. But what happens when the task is a little more complex? That’s where the “smart” machine would come in. The smart machine is one that has some simple (or complex in some cases) processing capability to be able to adapt to changing conditions. Such machines are suited for a host of applications, including automotive, aerospace, defense, medical, computers and electronics, telecommunications, consumer goods, and so on. This radio show will show what’s possible with smart machines, and what tradeoffs need to be made to implement such a solution.
Twitter Feed
Design News Twitter Feed
Like Us on Facebook

Sponsored Content

Technology Marketplace

Datasheets.com Parts Search

185 million searchable parts
(please enter a part number or hit search to begin)
Copyright © 2013 UBM Canon, A UBM company, All rights reserved. Privacy Policy | Terms of Service