Eagle and Finch: RWKV with Matrix-Valued States and Dynamic Recurrence
Research paper by Bo Peng and collaborators. Published 2024-04-08. Topics: multi-headed matrix-valued states, dynamic recurrence mechanism, RNNs, greedy matching, multilingual corpus.
Resource information
- Authors
- Bo Peng, Daniel Goldstein, Quentin Anthony, Alon Albalak, Eric Alcaide, Stella Biderman, Eugene Cheah, Teddy Ferdinan, Haowen Hou, Przemysław Kazienko, Kranthi Kiran GV, Jan Kocoń, Bartłomiej Koptyra, Satyapriya Krishna, Ronald McClelland Jr., Niklas Muennighoff, Fares Obeid, Atsushi Saito, Guangyu Song, Haoqin Tu, Stanisław Woźniak, Ruichong Zhang, Bingchen Zhao, Qihang Zhao, Peng Zhou, Jian Zhu, Rui-Jie Zhu
- Research topics
- multi-headed matrix-valued states, dynamic recurrence mechanism, RNNs, greedy matching, multilingual corpus
- Publication date
- 2024-04-08
- Publication
- arXiv
- Last record update
- Nov 3, 2026
