In a clear demonstration of why AI leadership demands the best compute capabilities, NVIDIA today unveiled the world’s 22nd fastest supercomputer — DGX SuperPOD — which provides AI infrastructure that meets the massive demands of the company’s autonomous-vehicle deployment program.
The system was built in just three weeks with 96 NVIDIA DGX-2H supercomputers and Mellanox interconnect technology. Delivering 9.4 petaflops of processing capability, it has the muscle for training the vast number of deep neural networks required for safe self-driving vehicles.
Customers can buy this system in whole or in part from any DGX-2 partner based on our DGX SuperPOD design.
AI training of self-driving cars is the ultimate compute-intensive challenge.
A single data-collection vehicle generates 1 terabyte of data per hour. Multiply that by years of driving over an entire fleet, and you quickly get to petabytes of data. That data is used to train algorithms on the rules of the road — and to find potential failures in the deep neural networks operating in the vehicle, which are then re-trained in a continuous loop.
“AI leadership demands leadership in compute infrastructure,” said Clement Farabet, vice president of AI infrastructure at NVIDIA. “Few AI challenges are as demanding as training autonomous vehicles, which requires retraining neural networks tens of thousands of times to meet extreme accuracy needs. There’s no substitute for massive processing capability like that of the DGX SuperPOD.”
Powered by 1,536 NVIDIA V100 Tensor Core GPUs interconnected with NVIDIA NVSwitch and Mellanox network fabric, the DGX SuperPOD can tackle data with peerless performance for a supercomputer its size.
The system is hard at work around the clock, optimizing autonomous driving software and retraining neural networks at a much faster turnaround time than previously possible.
For example, the DGX SuperPOD hardware and software platform takes less than two minutes to train ResNet-50. When this AI model came out in 2015, it took 25 days to train on the then state-of-the-art system, a single NVIDIA K80 GPU. DGX SuperPOD delivers results that are 18,000x faster.
While other TOP500 systems with similar performance levels are built from thousands of servers, DGX SuperPOD takes a fraction of the space, roughly 400x smaller than its ranked neighbors.
And NVIDIA DGX systems have already been adopted by other organizations with massive computational needs of their own — ranging from automotive companies such as BMW, Continental, Ford and Zenuity to enterprises including Facebook, Microsoft and Fujifilm, as well as research leaders like Riken and U.S. Department of Energy national labs.
Reference Architecture to Build Your Own SuperPOD
A DGX SuperPOD isn’t just lightning fast for running deep learning models.
It’s also remarkably quick to deploy due to its modular, enterprise-grade design.
While systems of this scale often take 6-9 months to deploy, the DGX SuperPOD took just three weeks, with engineers following a prescriptive, validated approach.
Building supercomputers like the DGX SuperPOD has helped NVIDIA learn how to design our systems for large-scale AI machines. It marks an important evolution in supercomputing technology, that’s bringing massive power out of academia and into transportation companies and other industries that want to use high performance computing to accelerate their initiatives.
For organizations that don’t have an AI-ready data center but want to use the NVIDIA SuperPOD architecture to meet their needs, NVIDIA offers simplified, rapid deployment through the DGX-Ready Data Center program.
The company’s data center colocation service providers are on hand to support enterprise customers building and deploying world-class AI data centers based on DGX systems.
Innovation Begins at Home
The DGX SuperPOD isn’t the only in-house NVIDIA system to appear on the TOP500 list of the world’s fastest supercomputers.
NVIDIA’s SATURNV system was the first, debuting in 2016 at the top of the Green500 list, which recognizes the most energy-efficient systems in the world, and 28th on the TOP500.
Since then, the SATURNV Volta (powered by NVIDIA DGX-1 systems) and DGX-2H POD have also been recognized for their tremendous performance levels and efficient power consumption.
NVIDIA GPU-powered devices power 22 of the top 25 supercomputers on the latest Green500 list.