NVIDIA expands confidential computing for AI infrastructure

NVIDIA expands confidential computing for AI infrastructure
NVIDIA boosts AI security

As AI developers seek stronger protections for sensitive models and training data, NVIDIA is adding a new confidential computing option for dedicated infrastructure. The expansion also extends the company’s security architecture across Grace Blackwell and Rubin systems, while adding support in NVIDIA DSX OS for cloud providers building AI factories.

Highlights

  • NVIDIA launched Confidential Bare Metal, a new deployment option within NVIDIA Confidential Computing, securing AI workloads on dedicated third-party infrastructure with hardware-level controls.
  • NVIDIA Confidential Computing now offers three deployment modes—Confidential Bare Metal, Confidential Containers, and Confidential Virtual Machines—broadening customer alignment with specific trust boundaries and operational needs.
  • Google Cloud extends Confidential Bare Metal support to A4X Max instances with NVIDIA GB300 NVL72, while Cohere plans integration into Model Vault, enhancing hardware-based security for sensitive AI workloads.

New deployment option for secure AI workloads

NVIDIA Newsroom said NVIDIA is launching Confidential Bare Metal, a new deployment option within NVIDIA Confidential Computing that lets frontier model builders run sensitive workloads on dedicated third-party infrastructure while keeping control of their models and data.

The new option adds platform security controls designed to protect data in transit, measure platform integrity and enforce hardware-level access restrictions. NVIDIA says this allows customers using bare-metal instances to own and operate bespoke software stacks, including host and platform infrastructure software, across cloud, neocloud and enterprise environments.

NVIDIA Confidential Computing now includes three deployment modes, Confidential Bare Metal for bare-metal infrastructure, Confidential Containers for Kubernetes environments and Confidential Virtual Machines for virtualized environments. The company says the setup is intended to help organizations align deployment choices with their trust boundaries and operating requirements.

Cloud and enterprise rollout broadens market reach

According to NVIDIA, the broader confidential computing platform is also expanding across NVIDIA Grace Blackwell and Rubin systems and will integrate with NVIDIA DSX OS as a reference architecture for cloud providers developing AI factories.

Cohere plans to integrate Confidential Bare Metal into Cohere Model Vault, using NVIDIA confidential computing trusted execution environments to extend hardware-rooted security directly to the GPU. Phil Blunsom, chief technology officer at Cohere, says the approach is designed to protect customer data, models in memory and interconnects during execution.

Google Cloud is extending support for Confidential Bare Metal to A4X Max instances powered by NVIDIA GB300 NVL72 systems. NVIDIA says that combination brings non-virtualized accelerated computing together with cryptographic protection for training data and model intellectual property, while support now also extends to NVIDIA Grace Blackwell NVL72, x86-based NVIDIA HGX Rubin NVL8 and NVIDIA DGX Rubin NVL8 systems.

Our earlier article on Cohere’s planned acquisition of AI cybersecurity startup AISLE explained how the deal would add software vulnerability detection and threat-focused capabilities to Cohere’s broader enterprise push alongside its combination with Aleph Alpha. We noted that the move also expands Cohere’s European footprint via AISLE’s Prague engineering hub and positions the group to offer stronger security options, including private deployments on customers’ own systems.

This material may contain third-party opinions, none of the data and information on this webpage constitutes investment advice according to our Disclaimer. While we adhere to strict Editorial Integrity, this post may contain references to products from our partners.