Nvidia Tests Rubin Ultra With Lower Memory as HBM4 Costs Surge

Nvidia is reportedly testing Rubin Ultra variants with reduced memory configurations, including SKUs as low as 192 GB, in response to HBM4 cost inflation and supply shortages. The company is diversifying its memory stack to preserve margin and availability rather than shipping a single high-memory flagship.

For AI operators, this signals a bifurcation in the GPU market: memory-constrained SKUs will become the volume product, while high-memory parts command scarcity premiums. Workloads that previously assumed 288 GB or more per accelerator will need to be re-architected for smaller memory footprints, increasing reliance on disaggregated memory, sharding, or offloading to CPU RAM. Inference serving for large-context models will become more expensive per token on constrained SKUs, pushing operators toward quantization and speculative decoding to fit within reduced capacity. Second-order effect: the shortage will accelerate software-side memory efficiency, making tight memory the norm rather than the exception. Builders should benchmark against sub-200 GB profiles now to avoid procurement surprises in late 2026.