NVIDIA's Vera Rubin platform memory cost share rises to 62%, with SOCAMM2 as the main driver

According to UBS's analysis of the Vera Rubin superchip Bill of Materials (BOM), the share of memory semiconductors in the total cost of the platform has risen to about 62%, a significant increase from the 53% of the previous generation Blackwell Ultra (GB300). The total cost of the Vera Rubin superchip (which includes 1 Vera CPU and 2 Rubin GPUs) is approximately $38,902, with memory-related costs reaching $24,297. The cost of HBM4 is about $4,943 (accounting for 12.7% of the total cost), while the cost of the SOCAMM2 connecting the CPU is about $19,355 (accounting for 49.8% of the total cost), making it the core driver of rising memory costs.

SOCAMM2 is a server memory module based on low-power DRAM LPDDR5X, supporting a maximum capacity of 1.5TB per CPU. The Vera Rubin NVL72 cabinet (which includes 72 Rubin GPUs and 36 Vera CPUs) is equipped with a total of 74.7TB DRAM, of which HBM4 accounts for 20.7TB, and LPDDR5X for the CPUs reaches 54TB, with the LPDDR usage in a single cabinet equivalent to about 4,500 high-end smartphones. However, due to uncertainties in the supply of LPDDR5X and HBM4E, NVIDIA is considering reducing the HBM configuration for the next generation Rubin Ultra.