Fabio James Fehr, François Fleuret, Arnaud Pannatier, Haolin Chen
Transformer-based architectures are the model of choice for natural language understanding, but they come at a significant cost, as they have quadratic complexity in the input length, require a lot of training data, and can be difficult to tune. In the pur ...
Assoc Computational Linguistics-Acl2023
