About
Experience
Publications
Activities
Light
Dark
Automatic
Transformer
Dynamic-TinyBERT: Boost TinyBERT's Inference Efficiency by Dynamic Sequence Length
Dynamic sequence length reduction to further enhance the inference efficiency of TinyBERT beyond static compression - ___[ENLSP Workshop @ NeurIPS 2021](https://neurips2021-nlp.github.io)___
Length-Adaptive Transformer: Train Once with Length Drop, Use Anytime with Search
Train-once, anytime-inference framework for any transformer via length drop training and multi-objective evolutionary search - ___[ACL 2021](https://2021.aclweb.org)___
Cite
×