A robot gripper hand, invented by engineers at Cornell University, has inspired some of the same researchers to write an algorithm that can teach any robot how to pick up oddly-shaped objects.
The algorithm allows a robot to learn complex grasping skills by trial and error. The robot can then apply what it has learned in situations it hasn't previously encountered. The researchers said the method is hardware agnostic and will work with any type of robot gripper. This could be especially useful for autonomous industrial robots used in assembly or palletizing lines.
An algorithm inspired by Cornell University's universal jamming gripper robot hand, shown here picking up a glass of water, can teach any industrial robot how to pick up unfamiliar, oddly-shaped objects. (Source: John Amend, Cornell University)
The original "universal jamming gripper" hand was developed in October 2010 by the Cornell Creative Machines Lab headed by Hod Lipson, associate professor of mechanical engineering and computer science. It consists of a large latex balloon filled with a granular material, such as ground coffee. By modulating the air pressure inside the balloon, the granular material can quickly harden or soften to adapt to the object the arm is attempting to grasp.
The new algorithm was developed by Lipson and Ashutosh Saxena, Cornell assistant professor of computer science and a specialist in machine learning. Using the algorithm, a robot employs a 3D image of an object to examine several rectangles that match the size of the gripper. The robot tests each rectangle on a variety of features, and is also trained with images of different objects.
During this process, the robot builds up a library of features that are common to the properties of "good-grasping" rectangles. When the robot is given a new object, it chooses the rectangle that has scored the highest, based on the rules it has developed for good grasping. The robot also considers the overall size and shape of the object to help it choose a stable grasping point.
This technology seems to allow for a certain amount of forgiveness in the pick location for larger objects. It would be great to have a cell that can easily adjust to different parts as they come down the assembly line. This would allow for touchup free product changes. That would be great.
I agree I don''t know that I see an application for an adaptable gripper. But I do believe the ability of robots to pick up parts and hold them in place perhaps to be welded by another robot would be an application where this would be helpful. But on the typical assembly line the job is going to be repetitive and follow the same steps again and again without having to adapt.
I really liked the article. I don't know if I completely understand the inner workings of the pressure adaping inside of the big blue ball, but the statistics of success for picking up parts is pretty cool.
I like the ability of the robot to adapt and learn according to it's memory or history. no matter what the robot or technology in the robot I just love to hear about how the SW is learning.
I have had a bit of experience with assembly lines. I can't think of any application for this gripper. Printed circuit board assembly needs very fast small part placement with vision compensation, or fast very fine placement of large parts with many leads, using vision compensation. I have only seen vacuum nozzles used. I can't see this gripper being used in a high-speed vision application. In automotive speed, accuracy, and payload are important. I don't think this gripper has any of these 3. Even where I have seen off-line programming using 3-D modeling, an actual human had to step through the program to touch-up positions and movements. Robots, aka Flexible Automation, vs. 'hard automation', was the answer to changing products. The gripper or 'end effector' is always customized to the application. The part must be both 'picked' and 'placed'.
To belabor the point: I don't think this gripper could pick up a 1mm x 2mm chip, take a vision shot, and then place it into a solder screened location, and do it again 1/10 second later. I also doubt that it could pick up a 50 lb bag of flour and place it to a pallet.
The gripper and the algorithm are interesting research, without a current practical application.
The point here is that, with a less expensive universal gripper, such as Cornell's, plus the algorithm the team invented, a robotic assembly line can quickly adapt to optimally picking up all kinds of new objects with different sizes and shapes that it's never encountered before. The alternative, which we've heard a lot about in DN articles and comments, is lengthy and expensive programming in 4D, presumably with highly specialized grippers. This would be a big benefit in assembly lines, especially those of EMS, which are continually changing products.
Right now this looks like a technology development seeking a solution. As the robots develop, solutions will appear. I've seen this notion of robots learning how to do things by trial and error. That's impressive.
Ann R Thryft; Yes, optimal vs. non-optimal is the clarification. For some applications the optimal gripper is vacuum cup(s). The human hand is a very versatile end effector. Duplicating it is not easy. There could be applications where this gripper would be optimal, but I don't think the water glass is one of them.
Glenn, thanks for that observation about the photo. I should have pointed out in the caption that this universal gripper, without the algorithm, can pick up objects but that this shows how it does so in a non-optimal manner, forming a "before" picture.
naperlou, not everyone thinks about how a robot would do things they themselves are doing. But that does sound like how engineers think. Thanks for the observation about the lack of sensors here--I think that's a good point, and it's interesting to know this isn't the only research team taking that approach.
By experimenting with the photovoltaic reaction in solar cells, researchers at MIT have made a breakthrough in energy efficiency that significantly pushes the boundaries of current commercial cells on the market.
We looked at a number of sources to determine this year's greenest cars, from KBB to automotive trade magazines to environmental organizations. These 14 cars emerged as being great at either stretching fuel or reducing carbon footprint.
From Dell / Intel® New Paradigms in Design Work Scott Hamilton, vertical market strategist for Dell Precision workstations, 5/2/2013 4
Early in my career, I worked as a draftsman and remember the days of drawing on vellum with numbered pencils and Mylar with plastic lead. This was a fun experience in the sense that I ...
I've been using workstations for more than 10 years and love finding ways to get more performance from my system. With demanding professional applications that require more power each ...
A lasting memory from my first job as an engineer in an auto assembly plant is standing on hard concrete at six in the morning, vending-machine coffee clutched in hand, listening to ...
A quick look into the merger of two powerhouse 3D printing OEMs and the new leader in rapid prototyping solutions, Stratasys. The industrial revolution is now led by 3D printing and engineers are given the opportunity to fully maximize their design capabilities, reduce their time-to-market and functionally test prototypes cheaper, faster and easier. Bruce Bradshaw, Director of Marketing in North America, will explore the large product offering and variety of materials that will help CAD designers articulate their product design with actual, physical prototypes. This broadcast will dive deep into technical information including application specific stories from real world customers and their experiences with 3D printing. 3D Printing is
To save this item to your list of favorite Design News content so you can find it later in your Profile page, click the "Save It" button next to the item.
If you found this interesting or useful, please use the links to the services below to share it with other readers. You will need a free account with each service to share an item via that service.
Tweet This
3 
