Supermicro Data Center Stories

A Closer Look: Rack-Scale to Data Center-Scale AI Building Block Solutions

Written by Supermicro Experts | May 22, 2025 12:36:46 AM

Building up from the system node level to the rack cluster level to the data center level is a tremendous challenge today that requires a holistic strategy. We had a webinar featuring experts from Supermicro--Johnson Eung, Senior Growth Product Manager in AI and Alok Srivastava, Director of Solutions Management AI. They addressed how scalability, complexity, and budgets are all impacting deployment. 

Watch Now: Rack-Scale to Data Center-Scale AI Building Block Solutions

Here were some key takeaways:

  • AI model parameters are growing rapidly, posing challenges.
  • Supermicro focuses on building block solutions for flexibility.
  • Liquid cooling significantly reduces power usage effectiveness (PUE).
  • Networking complexity is a major challenge in AI data center deployment.
  • Scalable units can optimize space and power in data centers.
  • Supermicro has extensive experience in deploying large AI clusters.
  • Holistic planning is essential for maximizing data center capacity.
  • Power budgets must be carefully managed for efficiency.

Webinar Highlights:

Liquid Cooling: AI's Secret Weapon

Johnson: "We have deployed high-performance computing clusters, we've deployed university research labs, and now AI has gotten to the point where it's unequivocal. You need liquid cooling. Now you can still deploy without liquid cooling, but what that means is you're actually paying a lot in electricity just to cool your data center. "

 

Are you ready? AI's Power Surge

Johnson: "What we're asking for when we're asking folks to build the next AI data centers, which are now starting to be called AI factories, right? We're asking them to scale and build something that has never had the infrastructure ready for it.

 

AI Model Parameters Pace of Growth

Alok: "The most fundamental component of AI to spell success is a well-trained model. And the model parameters are growing at a tremendous pace."

 

 

This is just a small sample of the webinar. Visit the link below to really understand the significance of liquid cooling and how to deploy your data center successfully.

Watch the on-demand webinar: Rack-Scale to Data Center-Scale AI Building Block Solutions

 

Additional Resources: