Digital Engineering 24/7

Helping design and engineering professionals discover, evaluate and specify technologies and processes that shorten the design cycle and enable success.

Dell, NVIDIA Look to Data Centers as the Driving Force of Enterprise AI

Dell, NVIDIA discuss visions of AI-driven data center hardware at Dell Technologies World; NVIDIA announces NVLink Fusion at COMPUTEX

Latest Engineering Computing News

Latest Engineering Computing Resources

By Kenneth Wong  

May 21, 2025

This week at Dell Technologies World (The Venetian, Las Vegas, May 20-21), executives from JPMorgan Chase and Lowe's joined Dell founder, chairman, and CEO Michael Dell during the keynote, to discuss the integration of generative AI into their business and data management strategies, powered by Dell hardware. 

Larry Feinsmith, managing director and head of Global Technology Strategy, Innovation & Partnerships, JPMorgan Chase, revealed, "We've rolled out [our Large Language Model suite] to 200,000 people at JPMorgan Chase ... and that's used for QA summarization, content generation, with our own data in a highly secure way ... We've built applications for our financial advisors, our contact center agents, people that interact with clients, so that they can have information at the tip of their finger ..."

Seemantini Godbole, Executive VP, Chief Digital & Information Officer, Lowe’s, said, "[At a Lowe's store] you're kind of spending a couple of minutes and wondering, Hey, I wish I had help ... we are going to pick up those signals through computer vision, and we are going to know that there is a customer in a particular aisle waiting for help. And then, Uber-style, we are going to send notifications to the associates in that department. They are going to get a notification on their zebra device ... They are going to press the button that says, I'm on my way."

Dell AI Factory with NVIDIA, Version 2.0

Although not in person, NVIDIA CEO Jensen Huang appeared via a recorded talk with Dell's CEO. Haung imagined AI agents trained on existing data working in cybersecurity, software engineering, marketing, sales operations, forecasting, and supply chain management. "All these different AI agents can augment our human workforce ... To bring these AI agents to the world's enterprises, some of them want to do it in the cloud, but many of them want to do it on premise," he observed.

Dell chimed in, "Customers want to bring the AI to the data, rather than bring data to the AI ... Many customers are essentially creating intelligence with their proprietary data to enhance their own businesses."

For Dell and NVIDIA, that creates opportunities to bundle together their hardware, under the Dell AI Factory with NVIDIA, Version 2.0. Huang said, "[Enterprises] can take their raw data, their institutional knowledge, and put it into the Dell AI Factory, to refine that data. What comes out of it, is intelligence."

Core Hardware

AI Factory 2.0 is build on Dell data-center products with NVIDIA GPUs. Among the core products are the air-cooled Dell PowerEdge XE9780 and XE9785 servers, alongside the liquid-cooled Dell PowerEdge XE9780L and XE9785L servers. According to Dell, the new PowerEdge servers support up to 192 NVIDIA Blackwell Ultra GPUs with direct-to-chip liquid cooling. They can be customized with up to 256 NVIDIA Blackwell Ultra GPUs per Dell IR7000 rack. Dell says its PowerEdge XE9680 can deliver up to four times faster large language model (LLM) training with the 8-way NVIDIA HGX B300.

Also in the lineup are:

  • the Dell PowerEdge XE9712 with NVIDIA GB300 NVL72, with 50 times more AI reasoning inference output and five-fold improvement in throughput;
  • and the Dell PowerEdge XE7745 server with NVIDIA RTX Pro 6000 Blackwell Server Edition GPUs (available in July 2025), build with validated NVIDIA Enterprise AI Factory design with support for up to 8 GPUs in a 4U chassis, optimized to run physical and agentic AI applications for robotics, digital twins, and multi-modal AI applications.

Huang said, "We have Grace CPU versions. We have air-cooled versions and liquid-cooled versions. We have versions designed for running in virtualized environments, like VMware and Red Hat. We have systems that are designed to run with Kubernetes, and the developers will use brand new Dell workstations with our RTX Pro GPUs and AI GPUs." 

Dell revealed it plans to support the NVIDIA Vera CPU, via the NVIDIA Vera Rubin platform, with a new Dell PowerEdge XE server. 

NVIDIA, Foxconn, and Taiwan Joind Hands for a Supercomputer Project

There's a good reason for Huang to skip the Dell Technologies World. He was in Taipei this week, delivering the keynote to COMPUTEX 2025

“AI has ignited a new industrial revolution -- science and industry will be transformed,” Huang hailed. “We are delighted to partner with Foxconn and Taiwan to help build Taiwan's AI infrastructure, and to support TSMC (Taiwan Semiconductor Manufacturing Company) and other leading companies to advance innovation in the age of AI and robotics.”

In a press announcement, NVIDIA revealed it's working with Foxconn Hon Hai Technology Group and the Taiwanese government to build an AI Factory supercomputer to deliver NVIDIA Blackwell infrastructure to researchers, startups, and industries.

"Foxconn will provide the AI infrastructure through its subsidiary Big Innovation Company as an NVIDIA Cloud Partner. Featuring 10,000 NVIDIA Blackwell GPUs, the AI factory will significantly expand AI computing availability and fuel innovation for Taiwan researchers and enterprises. The Taiwan National Science and Technology Council will use the Big Innovation Company supercomputer to provide AI cloud computing resources to the Taiwan technology ecosystem, accelerating AI development and adoption across sectors," said NVIDIA.

NVIDIA reveals NVLink Fusion as the connectivity component for AI infrastructure. Image courtesy of NVIDIA

NVLink Fusion for AI Server Connectivity

At COMPUTEX, NVIDIA also revealed its NVIDIA NVLink Fusion, a new silicon for building semi-custom AI infrastructure. "NVLink Fusion also equips cloud providers with an easy path to scale out AI factories to millions of GPUs, using any ASIC, NVIDIA’s rack-scale systems and the NVIDIA end-to-end networking platform — which delivers up to 800Gb/s of throughput," NVIDIA said.

Taiwan-based hardware makers, including Acer, GIGABYTE, and MSI, announced they would deliver their DGX Spark and DGX Station personal AI supercomputers. "AI has revolutionized every layer of the computing stack -- from silicon to software,” said Huang. “Direct descendants of the DGX-1 system that ignited the AI revolution, DGX Spark and DGX Station are created from the ground up to power the next generation of AI research and development.”

The company also announced it plans to speed up the transition to enterprise AI factories with NVIDIA RTX PRO Servers and a new NVIDIA Enterprise AI Factory-validated design for data centers. The new architecture is meant to deliver acceleration for AI, design, engineering, and business applications.

RTX PRO Servers are built with NVIDIA RTX PRO 6000 Blackwell Server Edition GPUs. NVIDIA hopes to drive the shift from CPU-based systems to efficient GPU-accelerated infrastructure with these servers. 

 

More about NVIDIA

Since its founding in 1993, NVIDIA (NASDAQ: NVDA) has been a pioneer in accelerated computing. The company’s invention of the GPU in 1999 sparked the growth of the PC gaming market, redefined computer graphics, ignited the era of modern AI and…

Cut Retrieval-Augmented Generation (RAG) Hallucinations by 50%

Most teams hit the same wall with enterprise AI: LLMs that hallucinate, pipelines that don’t scale, and infrastructure that’s harder to design than the models themselves.

Latest in NVIDIA

Latest in NVLink

About Kenneth Wong

Kenneth Wong

Kenneth Wong is Digital Engineering's resident blogger and senior editor. Email him at [email protected] or share your thoughts or suggestions at digitaleng.news/facebook.

Follow DE
on Facebook
on Linkedin

Related Topics

Engineering Computing   HPC   Cluster Computing   Servers and Data Centers   News   AI Factory   Data Centers   Dell   Dell Technologies World   NVIDIA   NVLink   All topics
 

Subscribe

Subscribe to our FREE magazine, FREE email newsletters or both!

Join over 90,000 engineering professionals who get fresh engineering news as soon as it is published.

Subscribe today

 
 

From our Sponsors

Meltio Takes Metal Additive to the Next Level
Meltio's DED technology enables industries to tailor and customize their solutions to create & repair metal parts.
Easing the Transition from ETO to CTO with Configuration Lifecycle Management
Manufacturers are discovering that the Configure-to-Order (CTO) model provides significant benefits when it comes to customization.
Siemens + Altair = The Next Chapter in Design and Simulation
With its acquisition of Altair, Siemens creates a unified simulation portfolio combining generative design with high-performance computing and AI workflows.