Memory

Large Product Key Memory for Pretrained Language Models

Large product key memory augmentation for pretrained language models with catastrophic drift mitigation for improved accuracy and speed trade-off in finetuning - ___[Findings of EMNLP 2020](https://2020.emnlp.org/)___ ยท ___[SustaiNLP @ EMNLP 2020](https://sites.google.com/view/sustainlp2020)___