Memory optimization

RecShard: Statistical Feature-Based Memory Optimization for Industry-Scale Neural Recommendation
We propose RecShard, a fine-grained embedding table (EMB) partitioning and placement technique for deep learning recommendation models …
Geet Sethi, Bilge Acun, Niket Agarwal, Christos Kozyrakis, Caroline Trippel, Carole-Jean Wu
Cite DOI