NVIDIA is showcasing this week at CES its DRIVE Localization — a system that unlocks the restraints to a global, mass-market solution for cars to find themselves on maps.
Leveraging the compute power of GPUs and the worldwide reach of NVIDIA DRIVE mapping partners, the DRIVE Localization software module is an open, scalable platform for vehicles to position themselves on high-definition maps with unprecedented robustness and accuracy, using mass-market sensors.
It’s vital for a self-driving car to be able to pinpoint its location within centimeters so it can understand its surroundings and establish a sense of the road and lane structures. This enables it to detect when a lane is forking or merging, plan lane changes and determine lane paths even when markings aren’t clear.
DRIVE Localization makes that precise positioning possible by matching semantic landmarks in the vehicle’s environment with features from HD maps to determine exactly where it is in real time. And by leveraging mass-market sensors the platform is cost effective — enabling use in personal cars.
A High-Performance, Mass-Market Solution
At the heart of DRIVE Localization is the NVIDIA DRIVE Xavier SoC, the world’s first auto-grade processor dedicated to autonomous driving. Architected to satisfy such demanding computational needs, Xavier contains a deep learning accelerator (DLA) and a CUDA engine.
In combination with the NVIDIA software platform, these processors operate fast inference for deep neural networks and high-performance parallel processing for computer vision algorithms, both of which are leveraged in the DRIVE Localization module.
Rather than relying on expensive lidar technology, DRIVE Localization gathers data from low-cost sensors on the vehicle — a front camera, a GNSS (Global Navigation Satellite System) receiver, an IMU (Inertial Measurement Unit) and the vehicle’s speedometer.
Xavier’s high-bandwidth sensor ingestion and processing pipelines enable NVIDIA’s dedicated deep neural networks to analyze data instantaneously and detect semantic features in a variety of weather and lighting conditions, such as lane boundaries, signs, poles and road edges.
The DRIVE Localization module then overlays a third-party map with the sensor data, evaluating thousands of viewpoints in parallel. It performs this process faster than real time, scoring a massive array of vantage points from the map to one frame of visual data to find the most precise position and orientation.
This requires an enormous amount of parallel computational horsepower, which the Xavier SoC delivers with efficiency.
A Scalable Ecosystem
While Xavier makes it possible for localization to work in real time, the system must also be able to perform this process wherever the car drives. To do so, NVIDIA turned to partners that have dedicated years and vast resources to building HD maps of the world’s roads — among them, Baidu, HERE, NavInfo, TomTom and Zenrin, which have made their maps compatible with DRIVE Software for global localization.
Additionally, NVIDIA is expanding the mapping ecosystem with its DRIVE Maps format, allowing any map vendor to convert to this format to leverage DRIVE Localization directly, laying the foundation to access further capabilities of the system.
Support from HD Mapping Partners
The world’s top HD mapping companies expressed support for the initiative. Among them:
- “The compute performance and efficiency of NVIDIA DRIVE combined with Baidu’s HD maps will lead the industry in unprecedented scale and accuracy for safe self-driving in China.”
– Gu Weihao, general manager, IDG Intelligent Vehicle Business Unit, Baidu
- “The speed and efficiency of NVIDIA DRIVE Localization makes it possible for mass-market vehicles to access our world-class HD mapping solution. We are excited to be a part of this truly global platform.”
– Matt Preyss, product marketing manager in Autonomous Driving, HERE
- “By combining our HD maps with NVIDIA DRIVE Localization, autonomous vehicles will be able to precisely and safely navigate China’s roads. GPU technology is key to the highly accurate localization necessary for fully self-driving cars.”
– Wang Miao, director of HD maps products, NavInfo
- “With NVIDIA DRIVE Localization, the TomTom HD map service can be applied in any vehicle to power the future of autonomy.”
– Willem Strijbosch, head of Autonomous Driving, TomTom
- “Autonomous vehicles in Japan need to localize in tough driving conditions, such as tight corners and multi-level highways, long tunnels and dense skyscrapers. The combination of NVIDIA Localization and Zenrin HD Map expects to meet these challenges.”
– Yasuko Osada, project manager, ZENRIN
Experience DRIVE Localization firsthand on the CES showfloor, at NVIDIA booth 6306 and TomTom booth 5226.