Cloud Adoption is Driving HPC Toward Digital R&D

High Performance Computing is a massive industry ($55 billion by 2024) that is the lifeblood of research and science innovation.

High Performance Computing is a massive industry ($55 billion by 2024) that is the lifeblood of research and science innovation. From supersonic jets to developing cures for pandemics – research engineers rely on HPC for algorithmically complex workloads running on massive datasets.

Today this HPC industry is still running mostly on-prem in supercomputers and Linux clusters in private datacenters. But the rate of specialized architectures, the diversity of options for simulation software, and the general pressure to bring more agility to research engineers to rival the “developer experience” their enterprise software developers face – has created a massive surge in moving HPC workloads to the cloud.

Big Compute sponsor, Rescale, analyzed the aggregated data of more than 300 customers to generate insights leading high performance computing practitioners. This inaugural Big Compute report reveals the drivers behind the massive cloud transformation wave that is overtaking the HPC domain.

Big Compute is Driving the HPC Industry to the Cloud

Big Compute is the use of high performance computing (HPC) hardware and specialized software at scale to achieve breakthroughs in science, engineering and business. The report — “Big Compute:  2021 Cloud HPC Ecosystem” — reveals key trends in how HPC hardware and specialized software are accelerating cloud adoption across science, engineering and business.

An Explosion of Simulation Software and Specialized Architectures

The simulation software market is on fire – an industry expected to reach $21 billion by 2025. Across our library of 600 software packages that Rescale supports, we’re seeing most organizations typically run three or more simulation software packages.

ANSYS Fluent is the most dominant simulation software provider across most HPC use cases, but within every industry, domain-specific challengers are ever- growing. For example, CFD++ (Aerospace), LS-DYNA (Energy), CONVERGE 3.0 (Automotive).

It’s a great time to be a science engineer, in terms of the diversity of simulation software choice, and this report catalogues some of these emergent simulation softwares in specific industries.

Source: Big Compute 2021 State of Cloud HPC Report
Source: Big Compute 2021 State of Cloud HPC Report

Multi-Cloud is Uniquely Valuable for HPC and an Operational Reality

The combination of a fast growing catalogue of HPC software packages, up against different public cloud providers offering different advantages in underlying architecture is driving a multi-cloud trend. This report shows that more than 50 percent of HPC users are using more than one public cloud provider, up from 35% in 2018.

Source: Big Compute 2021 State of Cloud HPC Report

HPC Leaders are Seeking to Close Talent Gaps and Deliver on Digital R&D

Business leaders understand how cloud changed software development and are now looking to apply cloud transformation to R&D.  Research engineers are specialists in the science domains they serve.

Cloud providers are specialists in cloud infrastructure. But the universe of engineers who are specialized in both the applied science domains and cloud infrastructure is very small, exacerbated by a talent shortage in the HPC industry.  This report found that for most HPC execs, they are looking to automation to deliver more holistic R&D solutions, including workflow automation to help their organizations get the most out of the cloud.

Source: Big Compute 2021 State of Cloud HPC Report
Source: Big Compute 2021 State of Cloud HPC Report - Download Full Report

Related Resource

Download the Paper

2021 State of Cloud HPC Report
Rescale has the privilege of partnering with many of the companies driving cloud transformation for high performance computing (HPC). A decade ago when “cloud” mosty meant mobile apps, social media, and big data, we envisioned a world where scientists and engineers are fully empowered to tackle humanity’s biggest challenges. Today, cloud HPC is a mainstream reality. Download Now!

More Rescale Coverage

Intelligent Computing for Digital R&D
In this white paper, we present the core ideas and new trends in Software-Defined Compute, and how Rescale automates SDC for IT and HPC organizations.
Editor’s Picks: November 11-17, 2022
One of the picks will be chosen as DE’s Editor’s Pick of the Week.
Big Compute 22: Rescale Launches Compute Recommendation Engine
Rescale announces AI-driven Compute Optimization Engine, offers browser-accessible Elastic Cloud Workstation
FREE WEBINAR MARCH 29 - The Driving Forces Behind Cloud-Based Engineering Simulation
In this webinar, Rescale presents exclusive research on cloud-based engineering trends.
Sponsored Content
Cloud HPC Rising to Meet New Workplace Demands
With many organizations redefining the future of work and collaboration, cloud-enabled teams and tools are increasingly the lifeblood of business continuity.
How to leverage cloud computing resources for automotive manufacturing
The automotive industry has routinely used high performance computing (HPC) throughout the automobile design and development process. Download this paper to learn more.
Rescale Company Profile

Share This Article

Subscribe to our FREE magazine, FREE email newsletters or both!

Join over 90,000 engineering professionals who get fresh engineering news as soon as it is published.