country_code

Beyond Be-leaf: Immersive 3D Experience Transports Audiences to Natural Worlds With Augmented Reality

Factory 42 uses NVIDIA RTX, CloudXR and 5G to power an interactive Green Planet AR Experience.
by

Imagine walking through the bustling streets of London’s Piccadilly Circus, when suddenly you’re in a tropical rainforest, surrounded by vibrant flowers and dancing butterflies.

That’s what audiences will see in the virtual world of The Green Planet AR Experience, an interactive, augmented reality experience that blends physical and digital worlds to connect people with nature.

During the Green Planet AR Experience, powered by EE 5G, visitors are led through a living rainforest and six distinct biomes by a 3D hologram of Sir David Attenborough, familiar to many as the narrator of some of the world’s most-watched nature documentaries.

All images courtesy of Factory 42.

Audiences engage and interact with the plant life by using a mobile device, which acts as a window into the natural world.

To bring these virtual worlds to life in a sustainable way, award-winning studio Factory 42 combined captivating storytelling with cutting-edge technology. Using NVIDIA RTX and CloudXR, the creative team elevated the AR experience and delivered high-fidelity, photorealistic virtual environments over a 5G network.


Natural, Immersive AR Over 5G — It’s a Stream Come True

The Green Planet AR Experience’s mission is to inspire, educate and motivate visitors toward positive change by showcasing how plants are vital to all life on earth. Through the project, Factory 42 and the BBC help audiences gain a deeper understanding of ecosystems, the importance of biodiversity and what it means to protect our planet.

To create an immersive environment that captured the rich, vivid colors and details of natural worlds, the Factory 42 team needed high-quality imagery and graphics power. Using mobile edge computing allowed them to deliver the interactive experience to a large number of users over EE’s private 5G network.

The AR experience runs on a custom, on-premises GPU edge-rendering stack powered by NVIDIA RTX 8000 professional GPUs. Using NVIDIA RTX, Factory 42 created ultra-high-quality 3D digital assets, environments, interactions and visual effects that made the natural elements look as realistic as possible.

With the help of U.K.-based integrator The GRID Factory, the GPU edge-rendering stack is connected to EE’s private 5G network using the latest Ericsson Industry Connect solution for a dedicated wireless cellular network. Using NVIDIA RTX Virtual Workstation (RTX vWS) on VMware Horizon, and NVIDIA’s advanced CloudXR streaming solution, Factory 42 can stream all the content from the edge of the private 5G network to the Samsung S21 mobile handsets used by each visitor.

“NVIDIA RTX vWS and CloudXR were a step ahead of the competitive products — their robustness, ability to fractionalize the GPU, and high-quality delivery of streamed XR content were key features that allowed us to create our Green Planet AR Experience as a group experience to thousands of users,” said Stephen Stewart, CTO at Factory 42.

The creative team at Factory 42 designed the content in the AR environment, which is rendered in real time with the Unity game engine. The 3D hologram of Sir David was created using volumetric capture technology provided by Dimension Studios. Spatial audio provides a surround-sound setup, which guides people through the virtual environment as digital plants and animals react to the presence of visitors in the space.

Combining these technologies, Factory42 created a new level of immersive experience — one only made possible through 5G networks.

“NVIDIA RTX and CloudXR are fundamental to our ability to deliver this 5G mobile edge compute experience,” said Stewart. “The RTX 8000 GPU provided the graphics power and the NVENC support required to deploy into an edge rendering cluster. And with CloudXR, we could create robust connections to mobile handsets.”

Sustainability was considered at every level of construction and operation. The materials used in building The Green Planet AR Experience will be reused or recycled after the event to promote circularity. And combining NVIDIA RTX and CloudXR with 5G, Factory 42 can give audiences interactive experiences with hundreds of different trees, plants and creatures inside an eco-friendly, virtual space.

Experience the Future of Streaming at GTC

Learn more about how NVIDIA is helping companies create unforgettable immersive experiences at GTC, which runs from March 21-24.

Registration is free. Sign up to hear from leading companies and professionals across industries, including Factory 42, as they share insights about the future of AR, VR and other extended reality applications.

And watch the keynote address by NVIDIA CEO Jensen Huang, on March 22 at 8 a.m. Pacific, to hear the latest news on NVIDIA technologies.

From Materials Simulation to Experimental Astronomy, New NVIDIA AI Software Unlocks Scientific Discoveries

NVIDIA CUDA-X libraries, microservices and reference code accelerate AI for science.
by

At the ISC conference running in Hamburg this week, NVIDIA is introducing new software that speeds AI for science, from chemistry and materials discovery to the search for dark matter. 

The NVIDIA DAQIRI library and new NVIDIA ALCHEMI NIM microservices — as well as the NVIDIA cuPhoton reference code, coming soon — turn work that once took hours or days on CPUs into real-time, GPU-accelerated pipelines. 

They’re a part of NVIDIA CUDA-X, a collection of tools and libraries that deliver dramatically higher performance across application domains, including AI and high-performance computing.

These performance gains are large and have real impact. Across disciplines, scientists are using AI and accelerated computing to generate data and insights with instruments and surveys faster than ever.  

For example, running on NVIDIA GB200 NVL72 systems, cuPhoton speeds loading, reading, processing and analysis of FITS data — the standard astronomical file format — from observatories and telescopes. In early access, cuPhoton accelerated loading and reading of FITS images collected by the Rubin Observatory’s Legacy Survey of Space and Time (LSST) by 14,900x. It also enabled up to 8,400x faster signal processing and analysis using 32 NVIDIA Grace Blackwell superchips. 

Ultimately, this means faster insights from the LSST camera — the largest digital camera ever built — which captures images of billions of far-away galaxies, as well as closer, faint objects that don’t reflect much light.

New Software, From the Lab Bench to the Telescope

The new software accelerates research on dark matter, materials simulation and more.

NVIDIA cuPhoton is a reference code for scientists looking to extract insights from multidimensional data collected from telescopes, X-rays and laser experiments. It’s built to load, process, analyze and visualize petabytes of data, and can be used alongside other NVIDIA CUDA-X technologies to build an end-to-end accelerated pipeline for work in fields including astrophysics and astronomy. 

Researchers at Princeton University collaborated with NVIDIA to develop cuPhoton and will use it — along with Harvard University — for processing and analysis of massive data collected from observatories and  dark energy surveys. 

NVIDIA DAQIRI — short for Data Acquisition for Integrated Real-time Instruments — is a high-performance networking library that streams data from fast detectors and sensors into NVIDIA software. Older systems are tied to fixed hardware and can drop data when instruments produce it faster than they can save it. DAQIRI keeps up by handling the stream as it arrives. 

A research project called A-GHOST was developed by scientists from CERN, the University of Chicago and University College London, in the framework of CERN openlab. It uses DAQIRI to run AI in real time on collision data recorded by the ATLAS Experiment at CERN. A-GHOST analyses data that  would normally be rejected by ATLAS  — over 99% of it, due to storage constraints — allowing it to catch potentially interesting signals that would otherwise be lost.

NVIDIA ALCHEMI comprises a collection of domain-specific microservices and a toolkit for accelerating chemical and materials discovery, with applications across battery materials, catalysts, OLED displays, beauty products and more. 

NVIDIA released in March two ALCHEMI NIM microservices for batched geometry relaxation (BGR) and batched molecular dynamics (BMD). These AI-accelerated tools let researchers simulate millions of molecules and materials at once: BGR to find their most stable structures, BMD to simulate how they move over time.

In addition, ALCHEMI is expected to soon include a microservice for the widely used Vienna Ab initio Simulation Package (VASP), enabling researchers to run materials simulations with higher GPU throughput. By running multiple VASP calculations on a single GPU with the NVIDIA Multi-Process Service, the microservice achieves a 3x speedup for geometry optimization — the process of finding the most stable arrangement of atoms in a material.

Plus, developers and researchers can use the ALCHEMI Toolkit to accelerate training of AI surrogate models called machine learning interatomic potentials and easily build custom, high-performance atomistic simulation workflows.

How Lila Sciences Runs the Scientific Method Nonstop With NVIDIA ALCHEMI 

Lila Sciences — which is building a scientific superintelligence platform and autonomous lab for life sciences, chemistry and materials science — collaborated with NVIDIA on a high-fidelity magnet simulation using ALCHEMI, demoed at NVIDIA GTC San Jose in March. 

Lila Sciences accelerated high-throughput materials screening by 50x using the ALCHEMI NIM microservice for BGR, identifying stable candidates that have higher chances of being synthesized. It then accelerated the calculation of magnetic properties by 30% for shortlisted candidates using the ALCHEMI VASP microservice in early access.

Lila Sciences conducts materials simulation with NVIDIA ALCHEMI. The image above, courtesy of Lila Sciences, depicts film coupons cut out from a sample synthesized in a sputterer, a system for creating ultrathin, highly uniform coatings of metals or ceramics onto a surface.

The speedups compound. ALCHEMI’s specialized kernels for TensorNet gave Lila a 6x speedup in training and inference and reduced memory usage by 3x, enabling simulations that previously took weeks in just days. 

Instead of running one experiment at a time, this approach evaluates multiple materials simultaneously in GPU memory and can be generalized for use cases spanning: 

  • Materials discovery — screening novel, stable compositions at scale 
  • Energy — discovering active, earth-abundant catalysts for producing chemicals and fuels
  • Electromagnetics — understanding and predicting complex magnetic behaviors

ALCHEMI sits at the simulation layer, generating the physical-science data that feeds the rest of the loop.

In addition, Lila Sciences accelerates scientific discovery with the full NVIDIA stack, using NVIDIA Megatron-LM and NVIDIA Nemotron for training — including the Nemotron 3 Nano and Nemotron 3 Super open models, as well as the NeMo RL and NeMo Gym libraries. The company also taps into NVIDIA BioNeMo for molecular generation, NVIDIA Triton and NIM microservices for inference serving, and NVIDIA Omniverse libraries for digital twins

“The work showcases using a powerful computing stack assembled to accelerate discovery at a scale no individual scientist could achieve alone,” said Andy Beam, cofounder and chief technology officer of Lila Sciences.

Availability

The NVIDIA ALCHEMI Toolkit and Toolkit-Ops are available for download from Github and PyPI. ALCHEMI NIM microservices are available for download from the NVIDIA NGC catalog. The ALCHEMI NIM microservice for VASP is expected to be available later this summer. 

DAQIRI is now available on GitHub. CuPhoton is expected to be available this summer.

Learn more about NVIDIA AI for science.

See notice regarding software product information.