Nvidia and Microsoft are building a supercomputer in the cloud

NVIDIA and Microsoft are collaborating on a new cloud-based AI-focused supercomputer, which they claim will be “one of the most powerful in the world” when complete.

The new machine will leverage the supercomputing infrastructure of Microsoft Azure (opens in new tab) combined with NVIDIA GPUs (opens in new tab), networking, and AI software. It's set to contain ND- and NC-series virtual machines specifically designed for AI distributed training and inference. 

Source