Research paper
A Survey of RWKV
Research paper by Zhiyuan Li and collaborators. arXiv record dated 2025-01-05. Research area: Language technology.
Zhiyuan Li, Tingyu Xia, Yi Chang, Yuan Wu
Not specifiedView resource
Research papers
Publications about AI methods and applications.
Resources
Search resultsResearch paper
ARWKV: Pretrain is not what we need, an RNN-Attention-Based Language Model Born from Transformer
Research paper by Lin Yueyu and collaborators. Published 2025-01-26. Topics: hybrid quadratic, subquadratic attention models, multi-head architectures, Transformer, Linear RNN.
Lin Yueyu, Li Zhiyuan, Peter Yue, Liu Xiao
CC BY 4.0View resource
Research paper
Belief-State RWKV for Reinforcement Learning under Partial Observability
Research paper by Liu Xiao. arXiv record dated 2026-04-01. Research area: Machine learning.
Liu Xiao
CC BY 4.0View resource
Research paper
Beyond Quadratic: Linear-Time Change Detection with RWKV
Research paper by Zhenyu Yang and collaborators. arXiv record dated 2026-03-20. Research area: Computer vision.
Zhenyu Yang, Gensheng Pei, Tao Chen, Xia Yuan, Haofeng Zhang, Xiangbo Shu, Yazhou Yao
Not specifiedView resource
Research paper
BlackGoose Rimer: Harnessing RWKV-7 as a Simple yet Superior Replacement for Transformers in Large-Scale Time Series Modeling
Research paper by Li weile and collaborators. Published 2025-03-08. Topics: Transformers, LSTMs, GRUs, RWKV-7, meta-learning.
Li weile, Liu Xiao
CC BY 4.0View resource
Research paper
Cross-attention for State-based model RWKV-7
Research paper by Liu Xiao and collaborators. arXiv record dated 2025-04-19. Research area: Computer vision.
Liu Xiao, Li Zhiyuan, Lin Yueyu
CC BY 4.0View resource
Research paper
DAMI: Dual-Axis Memory Initialization for Enhanced Long-Context Retrieval in Gated Linear Attention
Research paper by Zhangchi Feng and collaborators. Published 2026-10-30. Topics: gated linear recurrences, Gated DeltaNet, A_log, dt_bias, Dual-Axis Memory Initialization.
Zhangchi Feng, Harry Jiang, Yangyifei Luo, Ray Zhang, Richong Zhang
Not specifiedView resource
Research paper
Diffusion-RWKV: Scaling RWKV-Like Architectures for Diffusion Models
Research paper by Zhengcong Fei and collaborators. Published 2024-04-06. Topics: RWKV, diffusion model, patchnified inputs, spatial aggregation complexity, FID.
Zhengcong Fei, Mingyuan Fan, Changqian Yu, Debang Li, Junshi Huang
Not specifiedView resource
Research paper
Eagle and Finch: RWKV with Matrix-Valued States and Dynamic Recurrence
Research paper by Bo Peng and collaborators. Published 2024-04-08. Topics: multi-headed matrix-valued states, dynamic recurrence mechanism, RNNs, greedy matching, multilingual corpus.
Bo Peng, Daniel Goldstein, Quentin Anthony, Alon Albalak, Eric Alcaide, Stella Biderman, Eugene Cheah, Teddy Ferdinan, Haowen Hou, Przemysław Kazienko, Kranthi Kiran GV, Jan Kocoń, Bartłomiej Koptyra, Satyapriya Krishna, Ronald McClelland Jr., Niklas Muennighoff, Fares Obeid, Atsushi Saito, Guangyu Song, Haoqin Tu, Stanisław Woźniak, Ruichong Zhang, Bingchen Zhao, Qihang Zhao, Peng Zhou, Jian Zhu, Rui-Jie Zhu
Not specifiedView resource
Research paper
Efficient RWKV-based Representation Learning for 3D Point Clouds
Research paper by Yun Liu and collaborators. arXiv record dated 2026-06-09. Research area: Computer vision.
Yun Liu, Xuefeng Yan, Liangliang Nan, Xianzhi Li, Peng Li, Zhe Zhu, Honghua Chen, Mingqiang Wei
Not specifiedView resource
Research paper
Falcon Mamba: The First Competitive Attention-free 7B Language Model
Research paper by Jingwei Zuo and collaborators. Published 2024-10-07. Topics: Mamba architecture, large language model, Transformers, Mistral 7B, Llama3.1 8B.
Jingwei Zuo, Maksim Velikanov, Dhia Eddine Rhaiem, Ilyas Chahed, Younes Belkada, Guillaume Kunsch, Hakim Hacid
Not specifiedView resource
Research paper
Fast and effective prediction of spatiotemporal nonlinear dynamics using the tailored RWKV architecture
Research paper by Jinho Lee and collaborators, published 2026 in Journal of Physics Photonics. Research area: Neural Networks and Reservoir Computing.
Jinho Lee, Jincheol Kim
Not specifiedView resource
No matching resources
Try a broader search or clear some filters.
Platform labels describe intended use. Read each resource's author credits, requirements and available access methods.