DAMI: Dual-Axis Memory Initialization for Enhanced Long-Context Retrieval in Gated Linear Attention
Research paper by Zhangchi Feng and collaborators. Published 2026-10-30. Topics: gated linear recurrences, Gated DeltaNet, A_log, dt_bias, Dual-Axis Memory Initialization.
Resource information
- Authors
- Zhangchi Feng, Harry Jiang, Yangyifei Luo, Ray Zhang, Richong Zhang
- Research topics
- gated linear recurrences, Gated DeltaNet, A_log, dt_bias, Dual-Axis Memory Initialization, DAMI, geometric timescales, KDA, GDN2, Mamba-2, RWKV-7, RULER-style retrieval
- Publication date
- 2026-10-30
- Publication
- arXiv
- Last record update
- Nov 3, 2026