country_code

New Performance Optimizations Supercharge NVIDIA RTX AI PCs for Gamers, Creators and Developers

Latest AI performance gains and features for RTX AI PCs unveiled at Microsoft Build.
by

NVIDIA today announced at Microsoft Build new AI performance optimizations and integrations for Windows that help deliver maximum performance on NVIDIA GeForce RTX AI PCs and NVIDIA RTX workstations.

Large language models (LLMs) power some of the most exciting new use cases in generative AI and now run up to 3x faster with ONNX Runtime (ORT) and DirectML using the new NVIDIA R555 Game Ready Driver. ORT and DirectML are high-performance tools used to run AI models locally on Windows PCs.

WebNN, an application programming interface for web developers to deploy AI models, is now accelerated with RTX via DirectML, enabling web apps to incorporate fast, AI-powered capabilities. And PyTorch will support DirectML execution backends, enabling Windows developers to train and infer complex AI models on Windows natively. NVIDIA and Microsoft are collaborating to scale performance on RTX GPUs.

These advancements build on NVIDIA’s world-leading AI platform, which accelerates more than 500 applications and games on over 100 million RTX AI PCs and workstations worldwide.

RTX AI PCs — Enhanced AI for Gamers, Creators and Developers

NVIDIA introduced the first PC GPUs with dedicated AI acceleration, the GeForce RTX 20 Series with Tensor Cores, along with the first widely adopted AI model to run on Windows, NVIDIA DLSS, in 2018. Its latest GPUs offer up to 1,300 trillion operations per second of dedicated AI performance.

In the coming months, Copilot+ PCs equipped with new power-efficient systems-on-a-chip and RTX GPUs will be released, giving gamers, creators, enthusiasts and developers increased performance to tackle demanding local AI workloads, along with Microsoft’s new Copilot+ features.

For gamers on RTX AI PCs, NVIDIA DLSS boosts frame rates by up to 4x, while NVIDIA ACE brings game characters to life with AI-driven dialogue, animation and speech.

For content creators, RTX powers AI-assisted production workflows in apps like Adobe Premiere, Blackmagic Design DaVinci Resolve and Blender to automate tedious tasks and streamline workflows. From 3D denoising and accelerated rendering to text-to-image and video generation, these tools empower artists to bring their visions to life.

For game modders, NVIDIA RTX Remix, built on the NVIDIA Omniverse platform, provides AI-accelerated tools to create RTX remasters of classic PC games. It makes it easier than ever to capture game assets, enhance materials with generative AI tools and incorporate full ray tracing.

For livestreamers, the NVIDIA Broadcast application delivers high-quality AI-powered background subtraction and noise removal, while NVIDIA RTX Video provides AI-powered upscaling and auto-high-dynamic range to enhance streamed video quality.

Enhancing productivity, LLMs powered by RTX GPUs execute AI assistants and copilots faster, and can process multiple requests simultaneously.

And RTX AI PCs allow developers to build and fine-tune AI models directly on their devices using NVIDIA’s AI developer tools, which include NVIDIA AI Workbench, NVIDIA cuDNN and CUDA on Windows Subsystem for Linux. Developers also have access to RTX-accelerated AI frameworks and software development kits like NVIDIA TensorRT, NVIDIA Maxine and RTX Video.

The combination of AI capabilities and performance deliver enhanced experiences for gamers, creators and developers.

Faster LLMs and New Capabilities for Web Developers

Microsoft recently released the generative AI extension for ORT, a cross-platform library for AI inference. The extension adds support for optimization techniques like quantization for LLMs like Phi-3, Llama 3, Gemma and Mistral. ORT supports different execution providers for inferencing via various software and hardware stacks, including DirectML.

ORT with the DirectML backend offers Windows AI developers a quick path to develop AI capabilities, with stability and production-grade support for the broad Windows PC ecosystem. NVIDIA optimizations for the generative AI extension for ORT, available now in R555 Game Ready, Studio and NVIDIA RTX Enterprise Drivers, help developers get up to 3x faster performance on RTX compared to previous drivers.

Inference performance for three LLMs using ONNX Runtime and the DirectML execution provider with the latest R555 GeForce driver compared to the previous R550 driver. INSEQ=2000 representative of document summarization workloads. All data captured with GeForce RTX 4090 GPU using batch size 1. The generative AI extension support for int4 quantization, plus the NVIDIA optimizations, result in up to 3x faster performance for LLMs.

Developers can unlock the full capabilities of RTX hardware with the new R555 driver, bringing better AI experiences to consumers, faster. It includes:

  • Support for DQ-GEMM metacommand to handle INT4 weight-only quantization for LLMs
  • New RMSNorm normalization methods for Llama 2, Llama 3, Mistral and Phi-3 models
  • Group and multi-query attention mechanisms, and sliding window attention to support Mistral
  • In-place KV updates to improve attention performance
  • Support for GEMM of non-multiple-of-8 tensors to improve context phase performance

Additionally, NVIDIA has optimized AI workflows within WebNN to deliver the powerful performance of RTX GPUs directly within browsers. The WebNN standard helps web app developers accelerate deep learning models with on-device AI accelerators, like Tensor Cores.

Now available in developer preview, WebNN uses DirectML and ORT Web, a Javascript library for in-browser model execution, to make AI applications more accessible across multiple platforms. With this acceleration, popular models like Stable Diffusion, SD Turbo and Whisper run up to 4x faster on WebNN compared to WebGPU and are now available for developers to use. Microsoft Build attendees can learn more about developing on RTX in the Accelerating development on Windows PCs with RTX AI in-person session on Wednesday, May 22, at 11 a.m. PT.

  • Categories:
  • AI

At Cannes Lions, NVIDIA Partners Reshape Advertising and Marketing With AI

by

The digital era gave the advertising and marketing industry speed; the AI era is giving it autonomous operations. 

For companies building next-generation technologies for advertising and marketing, the question is no longer whether to adopt AI but whether their infrastructure can support it at the speed and scale the industry demands. 

At Cannes Lions, running June 22-26 in France, industry leaders including Alembic, Amazon Web Services (AWS), Criteo, Higgsfield, KERV.ai and Taboola are showcasing how NVIDIA technologies help unlock greater creativity and enable faster, autonomous operations at enterprise scale.

Decision Intelligence at Enterprise Scale

Causal AI platform Alembic helps solve one of enterprises’ biggest challenges: proving what marketing initiatives actually drive growth, not just reporting on what happened. Modeling true causation simultaneously across every channel, market and audience requires AI infrastructure that can process enormous, fast-changing datasets without reducing them to correlation-based assumptions.

NVIDIA DGX Vera Rubin NVL72 systems enable Alembic to scale its Causal AI models to analyze more variables, run larger simulations and quantify the true drivers of growth across marketing investments. Alembic will be the first Causal AI company to use NVIDIA DGX Vera Rubin SuperPODs for enterprise-scale causal modeling, giving executives a single source of unbiased truth on what drove business outcomes and where capital is being wasted, so they can act with confidence on future decisions.

Alembic’s inference runs on private supercomputing infrastructure inside Equinix data centers where the enterprise data already lives, keeping AI workloads local. World Wide Technology extends this to secure and regulated environments. Together, the companies offer a complete enterprise AI stack purpose-built for executives and data leaders accountable for capital decisions. 

Smarter Bidding at Auction Speed

For advertisers, serving ads and relevant recommendations across billions of daily transactions requires AI that’s accurate, fast and affordable enough to run at scale.

Amazon Web Services (AWS) is bringing cloud infrastructure, foundation models and NVIDIA GPU-accelerated computing together into a cohesive stack for the adtech industry that can scale for the era of AI agents. AWS is giving advertisers and demand-side platforms, supply-side platforms and independent software vendors a production-ready reference implementation to run AI-powered bidding directly inside auctions — powered by NVIDIA Triton Inference Server, which delivers deep learning inference fast enough to fit within real-time auction windows. 

That means adtech companies can move from rules-based decisioning to AI-powered models for bid price optimization, audience activation and deal scoring directly within the live auction pipeline.

Advertising company Criteo helps retailers show the right product to the right shopper at the right moment, across one of the largest recommendation networks in digital advertising. Keeping those recommendations relevant means continuously retraining its AI on billions of shopper timelines, a process where speed directly translates to quality. 

Collaborating with NVIDIA, Criteo achieved a roughly 2x speedup in model training on NVIDIA Blackwell GPUs, driven by the NVIDIA cuEmbed open library. That efficiency already frees roughly 17,000 GPU hours a year, and the companies are now scaling the work further.

Infographic that depicts Criteo trains its AI on billions of shopper timelines, achieving a 2x speedup in model training on NVIDIA Blackwell GPUs, which frees roughly 17,000 GPU hours a year.

Taboola is applying the same infrastructure logic to conversational AI, using NVIDIA GPUs to power DeeperDive, its AI answer engine, and extending that infrastructure to AI platforms and chatbots so they can generate revenue from advertising.

Agentic AI Across the Marketing Workflow

In marketing and other industries, AI agents are increasingly acting as digital coworkers, taking on long-running tasks across planning, execution and optimization. But these agents are only deployable for enterprises when they come with proper controls, including safety guardrails, auditability and role-based permissioning. 

The NVIDIA Agent Toolkit, which includes NVIDIA NemoClaw blueprints and the NVIDIA OpenShell secure runtime, provides these controls.

For example, Higgsfield AI, an AI video and image generator production platform, offers Higgsfield Supercomputer agents that manage the full marketing automation lifecycle: from campaign ideation, planning, creative production to posting and autonomous campaign optimization — in a single interface. It orchestrates leading large language models alongside 35+ image, audio and video models, including Higgsfield’s proprietary Soul and Soul 2.0 models built on NVIDIA Blackwell architecture. 

As part of the collaboration, NVIDIA Agent Toolkit software, including NVIDIA Nemotron open models, powers specialized subagents within the Higgsfield Supercomputer, running continuously inside every campaign. NemoClaw and OpenShell are being integrated to provide the enterprise trust layer.  

The result: the full marketing lifecycle, from ideation and creative production through posting, performance analysis and optimization, is available in a single interface. Marketing campaigns for nearly 400 of the Fortune 500 companies are created on the platform. 

 

Video courtesy of Higgsfield.

Contextual and Content Intelligence at Scale

AI understanding content at the level of meaning requires advanced infrastructure. NVIDIA’s multimodal stack provides the vector search, data processing and video understanding capabilities that make this kind of intelligence viable at production scale.

AI-powered media leader KERV’s Moment Match Engine evaluates a multitude of signals across every video frame and media asset to understand individual scenes, objects and products, providing content recommendations based on ad creative — the visual and textual elements of an advertisement — to drive improved engagement.

 

Video courtesy of KERV.ai.

KERV.ai recently optimized its processing pipeline, achieving over 10x improvements in speed and efficiency when using the NVIDIA Nemotron 3 Nano Omni open model in the platform. KERV’s solution analyzes what each ad or media brief contains, who it resonates with and which exact moment within content environments to target. 

On MediaPerf, an open benchmark for AI video understanding, Nemotron 3 Nano Omni — adopted by ecosystem partners including PYLER, which uses NVIDIA DGX B200 systems — delivered the highest throughput and lowest inference cost of any model evaluated, open or closed source.

Learn more about how NVIDIA powers advertising and marketing technologies.

Featured video courtesy of Higgsfield.

  • Categories:
  • AI

Coherent Breaks Ground on Expanded Texas Facility, Scaling AI’s Optical Backbone

Coherent’s expansion at its Sherman, Texas, campus scales what it calls the world’s first volume production 6-inch indium phosphide fab, a key supplier across NVIDIA’s AI stack.
by

AI runs at the speed of light. More and more, that light is made in Texas.

Coherent broke ground today on an expanded manufacturing building in Sherman, Texas. 

The company makes the lasers, optical components and compound semiconductors that wire AI systems together — and runs what it calls the world’s first 6-inch indium phosphide fab. 

NVIDIA founder and CEO Jensen Huang and Coherent CEO Jim Anderson were on hand for the ceremony, joined by Sherman Mayor Shawn Temann and Adriana Cruz, executive director of Texas Economic Development and Tourism, who delivered remarks.  

The expanded building will scale production of the same InP wafers that carry data between chips, servers and data centers at the speed of light — the optical backbone of modern AI infrastructure.

It’s the kind of milestone that turns a commitment into construction: a concrete step in expanding advanced semiconductor manufacturing in the United States.

“AI is the ultimate general-purpose technology,” Huang said during a conversation with Anderson at the groundbreaking. “Because intelligence is fundamental — the ability to process information, to reason and solve problems — it affects every single industry.”

Public programs like the CHIPS Act, funded at roughly $50 billion, were designed to bring chip manufacturing back to the U.S. 

As part of today’s event, Coherent is announcing a $50 million CHIPS Act grant to help finance the expanded Sherman facility — building on roughly $17 million in earlier support from the Texas CHIPS program and the Sherman Economic Development Corporation.

NVIDIA’s own commitment to produce up to $500 billion of AI infrastructure in the U.S. through industry partnerships with new sites in Arizona and Texas adds private-sector momentum.

“Coherent is a world-class company, and the work you do is vital to our future, vital to the future of artificial intelligence and vital to reindustrializing the United States,” Huang said.

NVIDIA founder and CEO Jensen Huang and Coherent CEO Jim Anderson.

Compound semiconductors like indium phosphide and gallium arsenide — the materials behind the high-speed networking and optical interconnects that modern AI runs on — don’t get the headlines that logic chips do. But their domestic supply chains have been thin for years. Today’s event was an argument that the gap is closing.

When 576 GPUs span eight racks and operate as a single system — as they will in NVIDIA Vera Rubin Ultra NVL576, which links eight NVLink racks of 72 NVIDIA Rubin Ultra GPUs into one 576-GPU domain — copper can’t carry the signal across that distance. 

To connect hundreds of thousands of processors separated by hundreds or thousands of feet across a data center, the only way to solve that problem is silicon photonics, Huang explained. 

As signaling rates climb, the reach of a metal trace shrinks, and spanning eight racks in copper would burn power on retimers and signal conditioning that a data center would rather spend on compute. 

Optics pays a one-time penalty to move from electrical to light, but once paid, distance is nearly free. At NVL576 scale, light is the most power-efficient option. 

NVIDIA and Coherent aren’t new to each other — they’ve worked together for roughly two decades. 

In March, they deepened the relationship into a multiyear strategic partnership: NVIDIA is investing $2 billion in Coherent to support R&D, future capacity and U.S.-based manufacturing, alongside a multibillion-dollar purchase commitment for advanced laser and optical networking products.

Sherman, a city of roughly 45,000 people an hour north of Dallas, has become the latest dateline for the AI era — emblematic of a boom built as much on picks, shovels and manufacturing muscle as on software.

“When we get to full capacity, this site will support more than 550 direct jobs — and thousands of jobs, direct and indirect,” Anderson said.

What the factory ships isn’t a single product dropped into a single slot. It’s the lasers, transceivers and pluggable optical modules that move data across NVIDIA networking — each enabling a different part of the system.

“As AI systems grow larger and more powerful, connectivity is just as important as compute,” Anderson said. “AI runs on compute, but it scales on connectivity — and Sherman is where that connective tissue gets built.”

Today’s event made that visible.

Before the groundbreaking, guests toured the existing fab and previewed the equipment that will populate the expanded building once it’s running. An NVIDIA rack stood on the factory floor, one of the six stops on the tour. 

The tour was followed by a fireside chat with Huang and Anderson, where the two CEOs discussed the partnership and what scaling domestic optical manufacturing means for the AI buildout ahead.

“Today marks an important milestone — not just for Coherent, but for American manufacturing and for the future of AI infrastructure,” Anderson said. 

The semiconductor laser was born in U.S. labs — Bell Labs demonstrated a room-temperature version in 1970 — before the technology and its manufacturing largely migrated overseas.

“We were founded as a manufacturing company in 1971. We’ve always been a U.S. manufacturing company — and after 50 years, the most advanced 6-inch indium phosphide line in the world is right here in Sherman,” Anderson said. 

That manufacturing gap shows up in the wafers themselves: while silicon fabs run on 12-inch wafers, most of the world’s InP production is still stuck on 3- and 4-inch wafers — lower yields and far fewer components per run. 

Moving to 6-inch wafers roughly quadruples the usable area of a 3-inch wafer (area scales with the square of the diameter), driving down cost and unlocking the volume the AI buildout demands.


It took 50 years to build the first line, Huang said — and in one year, they’ve quadrupled it, a measure of the demand for accelerated computing.

Inside, the core processes are familiar: lithography, photoresist, depositing and etching materials, layer by layer. The difference is the material. On an InP substrate, engineers grow exotic compound-semiconductor layers and tune them for precise optical properties — the physics that lets a chip emit and modulate light.

Today, that InP travels inside Coherent’s pluggable optics — transceivers about the size of a USB stick that plug into the front of NVIDIA networking switches and move data between racks across the data center floor, where copper can’t reach. Each module carries an indium phosphide laser. 

Those same modules now help enable NVIDIA Spectrum-X Photonics and Quantum-X Photonics switches with co-packaged optics: Coherent supplies the external laser module that plugs into the switch’s front plate. 

And as NVIDIA works to keep optics from becoming the next bottleneck, demand for those lasers only climbs.

“Ten years from now, I think we’ll look back and realize AI is what made it possible to invest in sustainable energy, upgrade our energy grid and reconstitute a workforce,” Huang said. “You can’t have only information workers in an economy — you also have to have builders. We have an opportunity over the next 10 years to reshape our communities and be much more balanced.”

NVIDIA Accelerates Google DeepMind’s DiffusionGemma for Local AI

The new DiffusionGemma open model generates text in parallel — not one token at a time — and is optimized to run on the NVIDIA RTX PRO platform, NVIDIA DGX Spark systems and GeForce RTX GPUs.
by

Today, Google DeepMind released DiffusionGemma — an experimental open model built for exceptionally fast text generation. NVIDIA has optimized DiffusionGemma to run even faster across NVIDIA GeForce RTX GPUs, the NVIDIA RTX PRO platform and NVIDIA DGX Spark systems, from local PCs to the cloud. 

Rather than generating text one word at a time, DiffusionGemma generates multiple words in parallel to output whole blocks of text, opening a new, low-latency frontier for the kind of single-user workloads that developers, researchers and AI enthusiasts run every day. 

Features of the new model include: 

  • Parallel generation: DiffusionGemma denoises up to 256 tokens per step instead of predicting one at a time. 
  • Built on Gemma 4: DiffusionGemma is built on Gemma 4, a 26-billion-parameter mixture-of-experts model that activates just 3.8 billion parameters per step, pairing a diffusion head with Google’s Gemma 4 architecture. 
  • Up to 4x faster performance: The boost means fast text generation, where single-user generation usually stalls — on local hardware. 
  • Open and local: DiffusionGemma is open weights under a permissive Apache 2.0 license and runs entirely on RTX and DGX Spark — no cloud, no per-token cost — with day-zero support in Hugging Face Transformers, vLLM and Unsloth. 

A Different Way to Generate Text 

Almost every large language model (LLM) in wide use today is autoregressive — meaning it generates text one token at a time, with each new word depending on the one before it. That sequential process is what makes interactive AI feel like it’s typing. 

DiffusionGemma takes a different path. Built on the Gemma 4 26B mixture-of-experts architecture, it generates text the way diffusion models generate images: by starting from noise and refining a whole block of text at once. Each step denoises up to 256 tokens in parallel rather than emitting a single token and waiting to compute the next. 

The result is a model that thinks in blocks instead of sequentially. For latency-sensitive, single-user work — such as interactive chat, agentic loops or on-device assistants that plan and act — that parallelism translates into responses fast enough to keep pace with how developers think and iterate.

DiffusionGemma Flies on NVIDIA GPUs 

Generating one token at a time is fundamentally a memory-bound problem — a traditional LLM spends most of its time waiting on memory bandwidth, not doing math, which leaves a lot of compute on the table. 

Diffusion flips the equation. Pulling a full 256-token block through the transformer in parallel is a compute-bound workload — exactly what NVIDIA GPUs are built for. NVIDIA Tensor Cores accelerate the dense parallel math, and the CUDA software stack lets the model run efficiently from day one without bespoke tuning. In short, the model’s design plays directly to the GPUs strengths. 

That shows up in the numbers. DiffusionGemma delivers 1,000 tokens/sec on a single NVIDIA H100 Tensor Core GPU, 150 tokens/sec on NVIDIA DGX Spark and up to 2,000 tokens/sec on NVIDIA DGX Station — roughly 4x faster than an equivalent autoregressive model running in the same single-user regime.

That advantage holds across NVIDIA’s full lineup, running: 

  • Locally on the NVIDIA DGX Spark deskside personal AI supercomputer — powered by the NVIDIA GB10 Grace Blackwell Superchip with 128GB of unified memory — with the preinstalled NVIDIA AI software stack ready for prototyping, fine-tuning and fully local agent workflows. 
  • On NVIDIA RTX PRO 6000 workstations, providing developers, researchers and AI professionals with the headroom to run local low-latency generation and agentic loops as part of a professional workflow. 
  • On DGX Station, delivering best-in-class, local high-speed inference with up to 2,000 tokens/sec for low-latency text generation and agentic loops with 748GB of coherent memory.
  • On GeForce RTX GPUs, with llama.cpp support coming soon. 

Get Started Locally

The fastest way to start testing and prototyping the model is through Hugging Face Transformers, which runs DiffusionGemma on a GeForce RTX 5090 or DGX Spark out of the box. For higher-throughput inference, vLLM provides day-zero serving support.  

For adapting the model to a specific task or domain, fine-tuning is available through Unsloth and NVIDIA NeMo framework, with ready-made DGX Spark playbooks to get a local environment running quickly. Check out the vLLM playbooks for DGX Spark , RTX PRO and DGX Station. 

Try Diffusion Gemma on Hugging Face or test it for free using NVIDIA-hosted application programming interfaces at build.nvidia.com. 

Go deeper on the architecture and local deployment by reading the NVIDIA technical blog and the Google DeepMind announcement.

#ICYMI: The Latest From RTX AI Garage 

🎬 NVIDIA researchers released SANA-WM, an open source world model that turns a single image and a camera path into a minute-long, 720p video with precise 6-DoF control. At just 2.6 billion parameters, its distilled version generates a full 60-second clip in 34 seconds on a single NVIDIA GeForce RTX 5090 GPU using the NVFP4 format — delivering up to 36x higher throughput than comparable open models while running on one GPU. Read the paper. 

🛠️ Building Windows agents just got a full toolset — NVIDIA and Microsoft rolled out turnkey agent sandboxing on native Windows — Microsoft eXecution Containers plus the NVIDIA OpenShell runtime — alongside up to 2x faster agentic inference and native Windows support for Hermes Agent. 

🤖DGX Spark goes from unboxing to a running agent in minutes — A streamlined NVIDIA NemoClaw install gets developers to a working local agent fast, with Qwen3.6-35B running up to 2.6x faster on vLLM. And the new cluster assistant in NVIDIA Sync links up to four DGX Spark units into one 512GB pool — enough for ~400-billion-parameter models. 

Plug in to RTX Spark on FacebookInstagramTikTok and X — and stay informed by subscribing to the RTX Spark newsletter. 

See notice regarding software product information.

  • Categories:
  • AI