Keysight Launches an AI Inference Emulation Platform

Keysight Technologies, Inc. debuts Keysight AI Inference Builder (KAI Inference Builder), an emulation and analytics platform designed to validate inference-optimized AI infrastructure at scale. Keysight demonstrated the solution at NVIDIA GTC. 

KAI Inference Builder recreates realistic inference workload patterns and modeling industry-specific usage patterns to validate AI infrastructure, applications, and data center deployments. The platform gives AI cloud providers, hardware vendors, and application developers a scalable solution for measuring, validating, and optimizing real-world inference performance. 

Key benefits of KAI Inference Builder include: 

• KAI Inference Builder emulates AI inference workloads at scale and validates full-stack deployments under real-world conditions.
• KAI Inference Builder emulates industry-specific usage patterns and LLM architectures for AI models, enabling organizations to model and analyze infrastructure and application behavior across different types of AI data center deployments. 
• KAI Inference Builder evaluates inference workflows from user request to model response. 
• KAI Inference Builder can do client-only emulation. 

“Inference is the key to unlocking AI’s ROI, but that can be challenging to achieve when system resources aren’t optimized for capacity and performance," says Ram Periakaruppan, vice president and general manager, Network Test & Security Solutions at Keysigh. "KAI Inference Builder provides visibility into real-world inference performance across the full stack, enabling customers to validate and optimize deployments before hardware reaches the rack.” 

“As AI data centers scale to unprecedented levels, pre-deployment validation has transitioned from a best practice to a mission-critical requirement," says Amit Katz, vice president of Networking at NVIDIA. "The integration of KAI Inference Builder with NVIDIA DSX Air provides the essential environment needed to eliminate performance volatility, and enables NVIDIA AI Factory partners and customers to emulate real inference workloads and preemptively resolve bottlenecks, ensuring optimized AI services reach the market quickly.” 

Sources: Press materials received from the company and additional information gleaned from the company’s website.