Supermicro Delivers Liquid-Cooled AI Solutions with AMD GPUs

Supermicro, Inc. liquid-cooled and air-cooled GPU solutions will be available with the new AMD Instinct MI350 series GPUs, optimized for performance, scalability, and efficiency., according to Supermicro. The Supermicro H14 generation of GPU optimized solutions featuring dual AMD EPYC 9005 CPUs along with the AMD Instinct MI350 series GPUs, are designed for organizations seeking performance at scale.

"Supermicro continues to lead the industry with the most experience in delivering high-performance systems designed for AI and HPC applications," says Charles Liang, president and CEO of Supermicro. "Our Data Center Building Block Solutions enable us to quickly deploy end-to-end data center solutions to market, bringing the latest technologies for the most demanding applications. The addition of the new AMD Instinct MI350 series GPUs to our GPU server lineup strengthens and expands our industry-leading AI solutions and gives customers greater choice and better performance as they design and build the next generation of data centers."

Learn more about Supermicro Servers with AMD Instinct MI350 Series GPUs here.

Supermicro's H14 generation data center solutions offer flexibility for AI, HPC, Cloud, and Enterprise workloads. These systems are built on Supermicro's building-block architecture to help customers upgrade and scale workloads. The Supermicro GPU servers feature the latest AMD EPYC CPU and AMD Instinct GPUs, which offer AI-enabled solutions, adding to Supermicro's data center building block solutions (DCBBS).

"Our new AMD Instinct MI350 series delivers up to 40 percent more tokens-per-dollar relative to the competition, while retaining the industry standard form factor for OEM infrastructure compatibility," says Dr. Lisa Su, CEO and chair, AMD. "By combining these GPUs with Supermicro's proven platforms, their customers can deploy fully integrated, air- or liquid-cooled racks built entirely on AMD technology, giving them the flexibility and efficiency they need to deploy robust AI solutions at any scale."

Supermicro is expanding its liquid-cooled and air-cooled high-performance fabric 8-GPU system, leveraging the open multi-architecture industry standard OCP Accelerator Module (OAM) to support the latest AMD Instinct MI350 series GPUs. The 4U liquid-cooled system with AMD Instinct MI355X GPUs features Supermicro's new improved Direct Liquid Cooling (DLC) architecture incorporating new technologies for cooling various server components and reducing power consumption by up to 40%. Customers can choose Supermicro's 4U liquid-cooled option for higher-density rack-scale deployments as well as the 8U option for air-cooled environments.

Designed to maximize computational throughput, memory bandwidth utilization, and energy efficiency to enable more power-efficient AI inference. these accelerated GPU servers with AMD Instinct MI350 series will offer 288GB HBM3e per GPU, boosting 1.5x memory capacity compared to previous generations of AMD Instinct accelerator, 8TB/s bandwidth, and 1.8x petaflops of FP16 / FP8 compared to the previous generation Instinct MI325X.

"AI models aren't just increasing in size; they're demanding faster, more efficient infrastructure that can stay consistently deployable in real-world environments," says Paul Schell, industry analyst at ABI Research. "By adding AMD MI350 series GPUs into its latest H14 generation, Supermicro demonstrates a commitment to providing scalable, high-performance and memory solutions that are optimized for both AI training and inference. With support for both liquid and air cooling, these systems offer the flexibility and efficiency that CSPs, neo-clouds and enterprises alike need to power the next wave of AI growth."

These GPU solutions are designed for powering AI at scale, across cloud service providers and enterprise partners, built on the 4th Gen AMD CDNA architecture, the AMD Instinct MI350 Series delivers energy efficiency for a range of workloads, from AI training and inference to complex scientific simulations. The new AMD MI350 series will also feature new FP6 and FP4 data types to provide AI capabilities.

Sources: Press materials received from the company and additional information gleaned from the company’s website.