Research paper by Jarvis Guo and collaborators. Published 2024-12-06. Topics: multimodal large language models, instruction-tuning dataset, intermediate rationales, CoT reasoning, MathVerse.
Jarvis Guo, Tuney Zheng, Yuelin Bai, Bo Li, Yubo Wang, King Zhu, Yizhi Li, Graham Neubig, Wenhu Chen, Xiang Yue
Research paper by Tao Shen and collaborators. arXiv record dated 2025-11-23. Research area: Computer vision.
Tao Shen, Xin Wan, Taicai Chen, Rui Zhang, Junwen Pan, Dawei Lu, Fanding Lei, Zhilin Lu, Yunfei Yang, Chen Cheng, Qi She, Chang Liu, Zhenbang Sun
In this report, we introduce MammothModa, yet another multi-modal large language model (MLLM) designed to achieve state-of-the-art performance starting from an elementary baseline. We focus on three key design insights: (i) Integrating Visual Capabilities while Maintaining Complex Language Understanding: In addition to the vision encoder, we incorporated the Visual Attention Experts into the LLM to enhance its visual capabilities. (ii) Extending Context Window for High-Resolution and Long-Duration Visual Feature: We explore the Visual Merger Module to effectively reduce the token number of high-resolution images and incorporated frame positio
She, Qi, Pan, Junwen, Wan, Xin, Zhang, Rui, Lu, Dawei, Huang, Kai
Research paper by Shubham Toshniwal and collaborators. Published 2024-02-15. Topics: Large language models, LLMs, MetaMathQA, MAmmoTH, GPT-4.
Shubham Toshniwal, Ivan Moshkov, Sean Narenthiran, Daria Gitman, Fei Jia, Igor Gitman
Research paper by Yiming Jia and collaborators. Published 2025-03-13. Topics: vision-language models, multimodal datasets, question-answer pairs, visual QA, text QA.
Yiming Jia, Jiachen Li, Xiang Yue, Bo Li, Ping Nie, Kai Zou, Wenhu Chen