A prototype camera chip that combines a machine-vision-grade image sensor with hyperspectral sensing will go a long way toward integrating spectroscopy into industrial vision applications.
Imec's system-on-chip device puts a set of spectral filters that are directly post-processed at the wafer level on top of a commercially available CMOSIS CMV4000 image sensor. The four-megapixel image sensor has a maximum frame rate of 180fps, or six times the basic rate of industrial machine vision inspection applications.
A prototype camera chip meant for industrial vision applications combines a machine-vision-grade
image sensor with hyperspectral sensing.
Multispectral or hyperspectral cameras combine spectroscopy and imaging to distinguish objects that cannot be identified separately with traditional red-green-blue imaging methods. But this functionality has traditionally been limited to cameras that are large, expensive, and slow, so they can't usually be used for time-critical or high-throughput applications such as high-speed industrial inspection.
In industrial machine vision and inspection, the advantage of gathering spectroscopy data could be applied to objects made of multiple materials that look similar, such as certain types of films and thin layers of materials on printed circuit boards, or products made of multiple metals and different types of composites. Since each material has a unique spectral signature, data can be gathered by the sensor and extracted for further analysis to identify defects in product inspection for quality control applications.
What I like most about this technology is the huge difference in size between other multispectral cameras I've written about in the past and the fact that this is a chip-level solution, even doing post-processing filters on-chip. I think the need for this technology will only continue to increase as design features keep getting smaller, and with the mixes of multiple material types.
There's a large number of apps that could take advantage of this technology. Industrial machine vision and inspection of chips, boards and electronics sub-assemblies, R&D of several different kinds including component failure and analysis labs, medical labs of various kinds, and medical equipment manufacturing. It could possibly also be used in various kinds of materials detection, possibly in security apps, as well as for detecting counterfeit components made of inferior materials.
Having seen spectroscopy systems in the semiconductor industry in the 1980s, this seems like about as small a package as I can ever remember. Is this indeed smaller than the current state of the art? Has anyone else used a system on a chip approach like this one, Ann?
Hi Ann, this camera systems looks very interesting and powerful for many applications. I want to ask what is the typical spectral range of vision this components have and what is the difference with this one, I work with concentrated solar power systems and I wonder if this devices would work for analysis of ray tracing for beam radiation. Thank you and great article.
Interesting that it may be able to detect counterfeit components made of inferior materials. Right now, components coming back as returns are inspected by the human eye. There is a training program and certification for inspectors. But that process can't catch everything. Returns are the vulnerability area that lets counterfeit components into the legitimate-component bloodstream. A camera that can see better than the human eye could be a big help.
Chuck, there are other multispectral sensor chips of varying sizes, architectures and wavelength ranges--usually IR or IR plus visible light--but Imec's combination of hyperspectral spectroscopy sensor with regular visible light image sensor is unusual. It may also beunique. It's certainly one of the smallest I've seen, but I don't read German and I wouldn't be surprised if there are others (Germany is a leader in machine vision and imaging technology). That said, European Imec is a leading edge research institution, and they have a lot of firsts to their name.
Aldo, I'm not exactly sure what your question is. As the article states, the prototype chip's hyperspectral filter has 100 spectral bands between 560nm and 1,000nm. The filter bandwidth ranges from 3nm at 560nm to 20nm at 1,000nm, and the transmission efficiency is approximately 85 percent.\
Thanks, Ann! This is amazing technology. Taking a look at the original release, Imec mentions integration times as short at 2 ms, which, not counting transfer time, would equate to their specified max of 500 fps. When it comes to their hyperspectral filter, it has a maximum of 100 band settings at an effective slew rate of 2000 bands per second, which puts it around 500 us per band -- darn fast. I'm guessing that is the reaction time of the electro-optics they are using for their proprietary filter. Either way, this is a really impressive piece of technology that should find rapid acceptance in all sorts of machine vision applications.
William, thanks for the input. I'm not a specialist in this area, but I have a retentive reporter's memory and those specs sure looked leading edge, if not bleeding edge, to me. The one that first caught my eye, besides the integration of spectroscopy plus imaging on a chip, was the 6x maximum frame rate of the 4 MP image sensor. It's good to hear that the hyperspectral sensor frame rate is also wicked fast. The one thing we didn't get info on is the price. Since this is a prototype, it may go through some design shrinks for the first production runs that will help lower that.
A make-your-own Star Wars Sith Lightsaber hilt is heftier and better-looking than most others out there, according to its maker, Sean Charlesworth. You can 3D print it from free source files, and there's even a hardware kit available -- not free -- so you can build one just in time for Halloween.
Some next-generation bio-based materials are superior in performance to their petro-based counterparts, but also face some commercial challenges. This is especially true of certain biopolymers, adhesives, coatings, and advanced materials.
Cars and other vehicles, as well as electronics and medical devices, continue to lead the use cases for the new plastics products we've been seeing, as engineers design products for tougher environments.
LeMond Composites, founded by three-time Tour de France cycling champion Greg LeMond, is the first to license a new carbon fiber production method invented by Oak Ridge National Laboratory (ORNL) that's faster, cheaper, and greener.
This month will mark the launch of the SpeedFoiler, a super-fast, ultra-lightweight foiling catamaran that can fly short distances over water faster than other foiling designs, in part because of its carbon composite materials.
Focus on Fundamentals consists of 45-minute on-line classes that cover a host of technologies.
You learn without leaving the comfort of your desk. All classes are taught by subject-matter experts and all are archived.
So if you can't attend live, attend at your convenience.