5,533,575 AI resources indexedWorking toward the world’s largest AI resource index.

PDF

Eagle and Finch: RWKV with Matrix-Valued States and Dynamic Recurrence

Research paper by Bo Peng and collaborators. Published 2024-04-08. Topics: multi-headed matrix-valued states, dynamic recurrence mechanism, RNNs, greedy matching, multilingual corpus.

Resource information

Authors
Bo Peng, Daniel Goldstein, Quentin Anthony, Alon Albalak, Eric Alcaide, Stella Biderman, Eugene Cheah, Teddy Ferdinan, Haowen Hou, Przemysław Kazienko, Kranthi Kiran GV, Jan Kocoń, Bartłomiej Koptyra, Satyapriya Krishna, Ronald McClelland Jr., Niklas Muennighoff, Fares Obeid, Atsushi Saito, Guangyu Song, Haoqin Tu, Stanisław Woźniak, Ruichong Zhang, Bingchen Zhao, Qihang Zhao, Peng Zhou, Jian Zhu, Rui-Jie Zhu
Research topics
multi-headed matrix-valued states, dynamic recurrence mechanism, RNNs, greedy matching, multilingual corpus
Publication date
2024-04-08
Publication
arXiv
Last record update
Nov 3, 2026