AI in Design: In Need of New Hardware

New hardware options are emerging to support artificial intelligence use cases.

New hardware options are emerging to support artificial intelligence use cases.

Altair says its new DesignAI product “provides a cost-effective acceleration of engineering processes that integrates with existing engineering workflows and toolchains.” Image courtesy of Altair.

Just when you thought the buzz surrounding artificial intelligence (AI) couldn’t get any more pervasive, it seems engineering vendors are working overtime to bring AI to design. From initial design to simulation and detail drawing, companies across the gamut are adding AI features now.

The following three software companies are in three different aspects of product development. They are representative of what the entire industry is doing to bring AI to engineering:

Altair offers DesignAI, which it says combines “physics-based simulation-driven design and machine learning-based AI-driven design to create high-potential designs earlier in development cycles.”

Dassault Systèmes’ SOLIDWORKS is researching how to use AI for the complicated task of creating parametric models: “There is no company right now that can generate parametric models from picture or text input,” says Shrikant Savant, who works on AI and machine learning for Dassault Systèmes. “What we want to do is give users a generative AI model that works out of the box, but we also understand that customers would like to further customize the model by training it on their own data.”

Graebert recently released AI Assist for ARES Commander. The new feature is powered by OpenAI technology and trained on the specifics of both drafting and engineering. Sample requests could include “How do I calculate the wire gauge for a given amount of power?” or “I need technical advice on sheet metal blending.”

These new features—and many more like them—represent a significant evolution for product design software. These new powers come with their own set of hardware requirements, distinct from those of traditional CAD/CAE software. From power consumption to CPU performance and motherboard capabilities, AI-enhanced design will make new demands from workstations.

More Is Not Always Better

The transition to AI-enhanced CAD/CAE applications presents new challenges for the person shopping for engineering workstations. For example, high clock speeds rule for existing CAD/CAE work, where most of the processing is sequential. These applications benefit more from the speed of the cores than how many cores are in a CPU.

In today’s CPU market, existing CAD/CAE applications generally run well on Intel Core i7, i9 or the equivalent AMD Ryzen 7 or 9. For AI-enhanced CAD/CAE, more cores are better. Because AI is heavily dependent on parallel processing, AI-enhanced CAD/CAE workstations should have AMD Ryzen Threadripper or Intel Xeon series with high core counts (16, 32 or more), because they can better process parallel tasks more efficiently.

With graphics processing units (GPU), the key metric is newness. The latest generations from both AMD and NVIDIA include new capabilities designed with AI in mind. Traditional CAD/CAE does just fine with earlier midrange professional GPUs like NVIDIA Quadro or AMD Radeon Pro. AI-Enhanced CAD/CAE, on the other hand, will benefit from newer high-end GPUs with substantial CUDA cores and tensor cores (for NVIDIA) or Stream Processors (for AMD) and significant VRAM (8GB or higher). NVIDIA’s RTX A4000-A6000 or the Tesla series are specifically designed for AI tasks, offering tensor cores optimized for machine learning algorithms.

In a bit of AI product name irony, Tesla, the electric vehicle manufacturer, is working on a $1 billion supercomputer for AI development. The new supercomputer will be powered by NVIDIA Tesla-generation GPUs (and, to be fair, truckloads of AMD GPUs as well).

The differences extend to other workstation components. For traditional CAD/CAE, 16-32 GB of RAM is typically sufficient for most CAD tasks. Speeds of DDR4-3200 or higher can offer performance benefits. For AI-enhanced CAD/CAE, consider 64GB of RAM as the minimum, and get the fastest RAM your vendor offers. This ensures smooth multitasking and data handling for AI processes, which can be memory-intensive.

In traditional CAD/CAE, solid-state drives (SSD) are preferred over the spinning hard disk drives (HDD) for their speed. It is not uncommon to specify both. A 512 GB or larger SSD can serve as the boot drive, with additional HDDs used for bulk storage. AI-enhanced CAD/CAE will do better with the newest SSD technology NVMe, at 1 TB or more capacity. This will be the primary drive to accommodate large datasets and ensure rapid data access times. Other storage technology can be included for long-term data storage. Consider RAID configurations to ensure data redundancy and greater between-drive speed.

Neural Concept is a startup in the CAE/AI software space. Its first product, Shape, can study any nonparametric 3D design. Shape was used to refine the design of the most recent vehicle to establish the world record time for a human-powered vehicle. Image courtesy of Neural Concept.

High-end GPUs use a lot of electricity and generate a lot of heat. Traditional CAD/CAE workstations do just fine with standard cooling solutions and a power supply of around 650-750 watts. AI-enhanced CAD/CAE workstations should come with advanced liquid cooling systems and power supplies of 1,000 watts or more.

It might be easy to overlook networking as a category for upgrade. AI can generate very large data sets. If you are using cloud storage or processing, you will want the faster transmission rate. Gigabit Ethernet is usually sufficient for traditional CAD/CAE. Consider 10 Gigabit Ethernet or faster for AI-enhanced CAD/CAE solutions. Also, be sure the workstations have the latest Wi-Fi standard (e.g., Wi-Fi 6) if wireless connectivity is important.

Finally, make sure the motherboard supports the latest I/O standards (e.g., PCIe 4.0/5.0) and offers plenty of expansion slots for additional GPUs, memory, and storage options.

Representative Models

Following is a sampling of workstations that meet or exceed the specifications suggested above.

Puget Systems Single GPU Tower Workstation for Machine Learning / AI

The base model ($4,782) is a midtower workstation that ships with either Windows or Linux. It is the model Puget Systems uses for development with Stable Diffusion, a generative AI model that produces unique photorealistic images from text and image prompts.

  • CPU: AMD Ryzen 9 7900X 4.76 GHz 12 Core
  • RAM: 64GB DDR5-5600 (2x32GB)
  • GPU: NVIDIA GeForce RTX 4080 SUPER 16GB
  • Open Air
  • Storage: Two 1TB NVM3 PCIe Gen4 M.2 SSD (Peak 7000 MB/s)
  • Power: Super Flower Leadex VII Gold 1000W (80 PLUS Gold)
  • OS: Windows 11 Pro 64-Bit or (subtract $98.39) Ubuntu Linux 22.04 LTS 64-Bit Installation with Gnome Desktop

Most of Puget Systems’ revenue comes from workstations, but it also offers rackmount multiple GPU enclosures. This 6U NVIDIA rack was originally designed for crypto mining, but is finding a second use as an AI development platform. Image courtesy of Puget Systems.

Dell Precision 7960 Tower

The base model of this top seller ($4,129) offers Intel Xeon and NVIDIA, and more than 100 options for storage, RAM and other components.

  • CPU: Intel Xeon w5-3425 30MB cache, 12 cores, 24 threads, 3.2GHz
  • RAM: 32GB (2x16GB) DDR5, ECC
  • GPU: NVIDIA T1000 8GB, GDDR6
  • Storage: 512GB, M.2, PCIe NVMe, SSD, Class 40
  • Power: Not specified, not Energy Star qualified

Xi Computers MTower 2P64X

A dizzying array of options await the online buyer. The unit spec’d here ($6,195) is a midrange option with two CPUs and two GPUs. Xi recommends Supermicro motherboards.

  • CPU: Two Intel 2nd Gen Xeon Scalable Refresh Silver, 10 cores, 20 threads, 2.4GHz
  • RAM: 128GB DDR5-4800 (8x16GB)
  • GPU: Two NVIDIA RTX A4000 16GB GDDR6 ECC, 6144 compute unified device architecture (CUDA) cores, 192 Tensor cores, 140W
  • Storage: Primary is 4TB Samsung SSD 870 QVO 2.5 SATA 6Gb/Sec. Secondary is 4TB 7200 RPM SATA 6.0Gb/s WD Gold Datacenter
  • Power: 1000W Gold Certified 80 Plus Corsair RM1000e
  • OS: Windows 11 Pro 64-Bit or a variety of Red Hat Linux options

More Altair Coverage

Altair Company Profile

More AMD Coverage

Accelerating Electric Vehicle Development with Multidisciplinary Simulation and High-Performance Computing
In this new Making the Case guide, learn how a unified approach to design and multidisciplinary simulation from Dassault Systèmes, combined with high-performance computing powered by AMD EPYC™ processors, can accelerate EV design.
Expanded AMD Instinct GPU Roadmap Now Out
New AMD Instinct MI325X accelerator expected to be available in Q4 2024 with up to 288GB of HBM3E memory; new AMD Instinct MI350 series accelerators based on AMD CDNA 4 architecture expected to be available in 2025 .
AMD Offers AMD Instinct, Ryzen and EPYC Processors
Next-generation AMD EPYC processors to extend data center CPU enhancements, according to company.
MSI Unveils Server Platforms with Latest AMD EPYC Processors
These new platforms, designed for cloud-native environments, deliver performance and efficiency for data centers, according to MSI.
AMD Grows EPYC CPU Portfolio
The AMD EPYC 4004 Series CPUs offer enterprise-grade performance, scalability and modern security features powered by “Zen 4” architecture. 
Lenovo Debuts Desktops Powered by AMD Processors
Next-generation business workstations feature AI capabilities.
AMD Company Profile

More Dassault Systemes Coverage

Unified Modeling And Simulation (MODSIM) For Sustainable Product Development
Companies in all sectors must address the need for greater sustainability to meet customer demands. The development of new products necessitates rigorous testing and evaluation, while efforts must be made to decrease emissions and operate in a more economical fashion.
Generative AI Enters Next Phase with Natural Language
It’s not about typing or shouting executable commands.
Dassault Systèmes’ 3DEXPERIENCE Platform Enhances Drone Innovation
 Dhaksha adopts Dassault Systèmes’ 3DEXPERIENCE platform, including its SIMULIA software applications.
Spatial Now Offers HOOPS Communicator
New product offering enhanced by web visualization for 3D application.
Dassault, JLR Extend Partnership
JLR continues to deploy Dassault Systèmes’ 3DEXPERIENCE platform globally, to support the end-to-end development of all its modern luxury vehicles.
SPECapc SOLIDWORKS 2024 Benchmark Available
The SPECapc for SOLIDWORKS 2024 benchmark consists of 48 graphics tests and 12 CPU tests, SPEC reports.
Dassault Systemes Company Profile

More Graebert Coverage

Graebert Company Profile

More NVIDIA Coverage

Share This Article

Subscribe to our FREE magazine, FREE email newsletters or both!

Join over 90,000 engineering professionals who get fresh engineering news as soon as it is published.

About the Author

Randall  Newton's avatar
Randall Newton

Randall S. Newton is principal analyst at Consilia Vektor, covering engineering technology. He has been part of the computer graphics industry in a variety of roles since 1985.

  Follow DE