Transformer

Dynamic-TinyBERT: Boost TinyBERT's Inference Efficiency by Dynamic Sequence Length

Dynamic sequence length reduction to further enhance the inference efficiency of TinyBERT beyond static compression - ___[ENLSP @ NeurIPS 2021](https://neurips2021-nlp.github.io)___

Length-Adaptive Transformer: Train Once with Length Drop, Use Anytime with Search

Train-once, anytime-inference framework for any transformer via length drop training and multi-objective evolutionary search - ___[ACL 2021](https://2021.aclweb.org)___ ยท ___[SustaiNLP @ EMNLP 2021](https://sites.google.com/view/sustainlp2021)___ (Best Paper Award)