2BP: 2-Stage Backpropagation
Research paper by Christopher Rae and collaborators. Published 2024-05-28. Topics: Deep Neural Networks (DNNs), pipeline parallelism, backward propagation, 2-stage backpropagation (2BP), throughput.
Resource information
- Authors
- Christopher Rae, Joseph K. L. Lee, James Richings
- Research topics
- Deep Neural Networks (DNNs), pipeline parallelism, backward propagation, 2-stage backpropagation (2BP), throughput, LLaMa-like transformer
- Publication date
- 2024-05-28
- Publication
- arXiv
- Last record update
- Nov 3, 2026