NVIDIA Unveils New Development Opportunities and Paths to Market for Millions of Developers

by Rev Lebaredian

With NVIDIA Omniverse, millions of developers around the world can now take their workflows to the next level. At GTC, we introduced exclusive events, sessions and other resources to showcase how we’re expanding Omniverse, the multi-GPU, real-time simulation, and reference development platform for 3D workflows.

Our dedicated Developer Day was an exclusive event that offered the latest tutorials, breakout sessions with engineers, and news and insights into NVIDIA Omniverse. It highlighted the many ways Omniverse power users and developers can build, extend and connect tools and platforms to the Omniverse ecosystem. In the breakout sessions, attendees connected with senior developers of Omniverse to learn more about the licensing structure for the platform.

With the growing NVIDIA Developer Program, Omniverse users can get access to the latest technical resources, tutorials and more. Developers and software providers are welcome to build custom tools on the Omniverse platform to expand its functionality.

We also announced additions to our Omniverse Connectors program with popular tools such as Esri, Reallusion, Lightmap, RADiCAL and Replica Studios that developers can use to streamline complex workflows.

NVIDIA Omniverse User Group

The next NVIDIA Omniverse User Group is tomorrow, Nov. 11 at 7 a.m. PT. All developers, researchers, creators, students, hobbyists and other professionals using Omniverse are welcome to join this special event, as is anyone interested in learning more about the platform.

The event will provide a behind-the-scenes look at upcoming NVIDIA Omniverse platform features, connect users with each other and reveal who won the latest Omniverse Create contest.

A New, Powerful Tool to Enhance Synthetic Data Generation

NVIDIA announced the new Omniverse Replicator, a synthetic data-generation engine that produces physically simulated synthetic data for training deep neural networks. Using Omniverse Replicator, developers can easily create massive and diverse data that’s not only physically accurate, but also tailored to their workflows.

NVIDIA introduced two Omniverse Replicator-based applications for generating synthetic data:

  • One for NVIDIA DRIVE Sim, a virtual world for hosting the digital twin of autonomous vehicles.
  • And one for NVIDIA Isaac Sim, a virtual world for the digital twin of manipulation robots.

These applications will help accelerate the development of autonomous vehicles and robots.

A New Platform Technology for Building Interactive, AI Avatars

NVIDIA also announced Omniverse Avatar, a technology platform that will enable developers to build intelligent “virtual robots.” Omniverse Avatar will connect NVIDIA technologies in speech AI, computer vision, natural language understanding, recommendation engines and simulation technologies to provide real-time, intelligent assistants for custom support or video conferencing and telepresence use cases.

New Omniverse Connectors and Extensions for Developers

Developers can explore how Omniverse Connectors and extensions open portals between apps. NVIDIA is working with partners to bring additional 3D tools to Omniverse, so more users can simplify complex tasks and accelerate workflows faster.

Some of the latest connections through Connectors or extensions now available in Omniverse beta launcher include:

  • Esri’s ArcGIS CityEngine is an application that helps users create massive cities all at once and enables users to easily make rapid adjustments to the architectural style or other features of their city model. Esri built an Omniverse Connector for CityEngine, so design teams can conveniently provide full 3D city models and geographic context (GIS), and visualize various aspects of an urban design with real-time photorealism. The beta Connector was used in the Ericsson demo shown during the GTC keynote.
  • Lightmap’s HDR Light Studio is an application that adds live HDRI map authoring and live HDRI textured area lights to existing 3D software and renderers. This lets creators easily create perfect lighting set-ups that make 3D content shine. The Omniverse extension to HDR Light Studio enables cutting-edge lighting workflows, where lighting can be easily created and art directed by teams collaborating in real time.
  • RADiCAL Live generates real-time 3D skeletal motion data from a single 2D video feed from any consumer device, without sensors, markers or special cameras. Users can connect a video live stream into Radical’s platform and receive multiplayer animation data back into apps and games on any device, anywhere in the world, in real time.
  • Reallusion is enhancing animation pipelines with the iClone Connector for Omniverse. With iClone, the character animation process is more streamlined, robust and easier than ever — Omniverse users can access a massive library of high-quality assets and create worlds with photorealistic digital humans, props, cameras and lights.
  • Replica Studios uses AI to help developers produce natural-sounding performances without a voiceover artist or studio. Replica is developing an Omniverse extension so developers can seamlessly use Replica’s voice library along with Omniverse-connected apps.

Additional Omniverse Connectors, extensions and content libraries coming soon include Adobe Substance 3D Material Plugin, Maxon Cinema4D, Clo Virtual Fashion, Daz3D, e-on software’s PlantFactory, PlantCatalog and VUE, Golaem, Notch, Style3D, TwinBru and Wacom pen support.

Help Build the Foundations of Omniverse Today

Learn more about the NVIDIA Omniverse open beta by diving into the Omniverse Resource Center, which details how developers can use Omniverse Kit and Omniverse Connect SDKs to build custom applications and extensions for the platform.

With the free open beta license, users can access all of the platform apps, live sync with their favorite 3D tools using Omniverse Connectors and collaborate with others. For teams, Omniverse Enterprise offers a yearly subscription.

For additional support, explore the Omniverse forums and our Medium channel, check out tutorials on Twitter and YouTube, and join our Discord server to chat with the community.

Watch NVIDIA founder and CEO Jensen Huang’s GTC keynote address below: