The average rack density in most data centers today is 7-10 kW. Modern AI workloads are driving deployments of GPUs and other AI infrastructure that can require 50 kW today and, in fact, well over 100 kW in a single rack. The rapid acceleration in power densities and performance needs are driving change in data center facility design, and the need for more sustainable infrastructure.

This session will cover the theoretical and practical design limitations to support AI, and solutions to engineer around them. We will discuss how a data center is designed and built, how the use cases that the infrastructure deployed in them supports help shape that design, and what the AI data center looks like from a construction, cooling, and connectivity perspective.

The session will also look into the variety and nuances of GPU chip considerations in data centers with relation to power density and liquid cooling technology options.