Vicor’s Power-on-Package Enables Higher Performance for Artificial Intelligence Processors

Vicor Corporation (NASDAQ: VICR) today announced the introduction of Power-on-Package modular current multipliers for high performance, high current, CPU/GPU/ASIC (“XPU”) processors. By freeing up XPU socket pins and eliminating losses associated with delivery of current from the motherboard to the XPU, Vicor’s Power-on-Package solution enables higher current delivery for maximum XPU performance.

In response to the ever-increasing demands of high performance applications – artificial intelligence, machine learning, big data mining – XPU operating currents have risen to hundreds of Amperes. Point-of-Load power architectures in which high current power delivery units are placed close to the XPU mitigate power distribution losses on the motherboard but do nothing to lessen interconnect challenges between the XPU and the motherboard. With increasing XPU currents, the remaining short distance to the XPU – the “last inch” – consisting of motherboard conductors and interconnects within the XPU socket has become a limiting factor in XPU performance and total system efficiency.

Vicor’s new Power-on-Package Modular Current Multipliers (“MCMs”) fit within the XPU package to expand upon the efficiency, density, and bandwidth advantages of Vicor’s Factorized Power Architecture, already established in 48V Direct-to-XPU motherboard applications by early adopters. As current multipliers, MCMs mounted on the XPU substrate under the XPU package lid, or outside of it, are driven at a fraction (e.g., 1/64^th) of the XPU current from an external Modular Current Driver (MCD). The MCD, located on the motherboard, drives MCMs and accurately regulates the XPU voltage with high bandwidth and low noise.  The solution profiled today, consisting of two MCMs and one MCD, enables delivery of up to 320A of continuous current to the XPU, with peak current capability of 640A.

With MCMs mounted directly to the XPU substrate, the XPU current delivered by the MCMs does not traverse the XPU socket. And, because the MCD drives MCMs at a low current, power from the MCD can be efficiently routed to MCMs reducing interconnect losses by 10x even though 90% of the XPU pins typically required for power delivery are reclaimed for expanded I/O functionality. Additional benefits include a simplified motherboard design and a substantial reduction in the minimum bypass capacitance required to keep the XPU within its voltage limits.

Two initial Power-on-Package devices are being introduced during the August 22^nd Open Data Center Committee (ODCC) meeting in Beijing, China: a MCM3208S59Z01A6C00 Modular Current Multiplier (MCM) and a MCD3509S60E59D0C01 Modular Current Multiplier Driver (MCD). Multiple MCMs may be operated in parallel for increased current capability. The small (32mm x 8mm x 2.75mm) package and low noise characteristics of the MCM make it suitable for co-packaging with noise-sensitive, high performance ASICs, GPUs and CPUs.  Operating temperature range is -40C to +125C.  These devices represent the first in a portfolio of Power-on-Package solutions scalable to various XPU needs.

Over the past ten years Vicor has pioneered 48V Direct-to-XPU power development, reducing losses by an average of 25% every two years, while increasing power system density and cost-effectiveness. The MCM-MCD ChiP-set introduced today continues that evolution. By overcoming the obstacles imposed on XPUs by external high current delivery through the “last inch”, Vicor’s Power-on-Package technology does more than just improve performance and simplify motherboard design – it enables XPUs to achieve previously unattainable performance levels that are necessary to fulfilling the promise of Artificial Intelligence.