Joshua Ainslie
Publications by Year
Research Areas
Natural Language Processing Techniques, Topic Modeling, Multimodal Machine Learning Applications, Domain Adaptation and Few-Shot Learning, Speech Recognition and Synthesis
Most-Cited Works
- → FNet: Mixing Tokens with Fourier Transforms(2022)474 cited
- → Big Bird: Transformers for Longer Sequences(2020)273 cited
- → GQA: Training Generalized Multi-Query Transformer Models from Multi-Head Checkpoints(2023)270 cited
- → ETC: Encoding Long and Structured Inputs in Transformers(2020)265 cited
- → LongT5: Efficient Text-To-Text Transformer for Long Sequences(2022)195 cited
- → RealFormer: Transformer Likes Residual Attention(2021)79 cited
- → Making Transformers Solve Compositional Tasks(2022)34 cited
- → CoLT5: Faster Long-Range Transformers with Conditional Computation(2023)24 cited