Blake A. Hechtman
Publications by Year
Research Areas
Parallel Computing and Optimization Techniques, Advanced Data Storage Technologies, Advanced Neural Network Applications, Distributed systems and fault tolerance, Interconnection Networks and Systems
Most-Cited Works
- → Scaling Language Models: Methods, Analysis & Insights from Training Gopher(2021)242 cited
- → Heterogeneous-race-free memory models(2014)101 cited
- → QuickRelease: A throughput-oriented approach to release consistency on GPUs(2014)68 cited
- → Mesh-TensorFlow: Deep Learning for Supercomputers(2018)52 cited
- → Overlap Communication with Dependent Computation via Decomposition in Large Deep Learning Models(2022)50 cited
- → Exploring memory consistency for massively-threaded throughput-oriented processors(2013)45 cited
- → GSPMD: General and Scalable Parallelization for ML Computation Graphs(2021)37 cited
- → Scale MLPerf-0.6 models on Google TPU-v3 Pods(2019)35 cited
- → Scaling Local Self-Attention for Parameter Efficient Visual Backbones(2021)35 cited
- → Large-Scale Discrete Fourier Transform on TPUs(2021)28 cited