Research paper by Xianjun Yang and collaborators. Published 2023-05-27. Topics: Divergent N-Gram Analysis, DNA-GPT, N-gram analysis, probability divergence, large language models.
Xianjun Yang, Wei Cheng, Linda Petzold, William Yang Wang, Haifeng Chen
Research paper by Yikai Zhang and collaborators. Published 2024-01-13. Topics: rotary position embedding, attention entropy, attention scores, Position Interpolation (PI), YaRN.
Research paper by Xiangru Tang and collaborators. Published 2023-09-16. Topics: Large Language Models, structure-aware fine-tuning, Struc-Bench, GPT-NeoX 20B, GPT-3.5.
Xiangru Tang, Yiming Zong, Yilun Zhao, Arman Cohan, Mark Gerstein