Cray Inc. is establishing its supercomputer architectures for the remainder of the decade, planning to devise systems that are more efficient and easier to link together. The systems should boost performance beyond the petaflop range by the end of the decade.
As processor speeds increase, the ability to get data from memory is a bottleneck that grows at around 50% per year. Source: Innovative Computing Laboratory, University of Tennessee.
The Seattle-based company recently inked an agreement with the U.S. Government to continue developing a next-generation supercomputer code-named Black Widow. Cray and the Government will each invest about $17M through 2007.
Black Widow is expected to reach a peak performance of several hundred teraflops (floating point operations) initially, exceeding a petaflops (a thousand trillion calculations per second) in its product lifetime.
Looking further out, Cray is working closely with DARPA to continue developing advanced systems. These efforts, designed to yield products by 2010, will build upon work done under the existing cooperative agreement.
The later phase will create a merger of Cray’s proprietary vector systems and its scalar technologies. “We want to integrate them so we can get systems with different sorts of computation capability,” says Steve Scott, CTO at Cray.
He notes that DARPA and three partners including Cray are attempting to provide dramatic performance increases, addressing issues that plague designers today. “High end computing systems don’t scale well when they’re put in clusters, and they tend to be fragile, with a lot of reliability issues,” Scott says. They are also hard to program, he adds.
The performance target is petaflops and multiple petaflops. Advances will come in many areas with a similar focus. “The common theme is bandwidth. Bandwidth is not only the most important aspect, it’s the most expensive,” Scott says.
FLOPS are becoming cheaper, following Moore’s Law of doubling every 18 months, but bandwidth increases are far slower, he explains. One solution for that problem is to use bandwidth wisely. “We want to reduce the use of bandwidth, with fast processors we want to pull data in and operate on it, using it several times in that processor,” Scott says.
Bandwidth has a major impact on memory access. “Memory capacity is getting cheaper and cheaper at Moore’s Law rates, but the bandwidth to get to memory is not getting faster at that rate,” Scott says.
Another approach is to distribute processors. “Rather than send data to processors, we’ll sprinkle processors out in the memory subsystem, performing operations on data where it sits to reduce the amount of data that gets sent across networks,” Scott says. That provides the same end effect as increasing bandwidth, he adds.
Cray plans to use commodity memory chips in its new designs, improving performance with a technique called memory concurrency. “A processor typically asks for a number of words from memory, then waits for them. In the processors we design, there can have thousands of outstanding memory requests, keeping the pipeline between the processor and memory filled,” Scott says.
The company will also address programming, aiming to make it simpler for users to move from idea to operation.
With major product releases coming from big names like Sony, Microsoft, and Samsung, and big investments by companies like Facebook, 2015 could be the year that virtual reality (VR) and augmented reality (AR) finally pop. Here's take a look back at some of the technologies that got us here (for better and worse).
Good engineering designs are those that work in the real world; bad designs are those that don’t. If we agree to set our egos aside and let the real world be our guide, we can resolve nearly any disagreement.
The Industrial Internet of Things is bringing a previously reluctant process industry into the wireless fold. The ability to connect smart sensors to the Internet has spiked the demand for wireless devices in process manufacturing, according to the new study from ARC Advisory Group.
If you’re developing an embedded monitoring and control application, then you’ll want to take note of the upcoming Design News Continuing Education Center class, “Embedded Development Using Microchip Microcontrollers and the CCS C Compiler."
Focus on Fundamentals consists of 45-minute on-line classes that cover a host of technologies. You learn without leaving the comfort of your desk. All classes are taught by subject-matter experts and all are archived. So if you can't attend live, attend at your convenience.