SK hynix Details Memory-Tiering Technologies for AI Inference

Your call?🐂 Bullish🐻 Bearish

SALT-KV evaluates cache reuse value and storage cost, while CMM-Hybrid stages predicted data from SSD into DRAM. SK hynix also plans to develop High Bandwidth Flash between HBM and SSDs.