5,441,677 AI resources indexedWorking toward the world’s largest AI resource index.

PDF

Research papers

Publications about AI methods and applications.

How to use the library

Resources

Search results
Search stays within research papers.
Research paper

MammothModa: Multi-Modal Large Language Model

In this report, we introduce MammothModa, yet another multi-modal large language model (MLLM) designed to achieve state-of-the-art performance starting from an elementary baseline. We focus on three key design insights: (i) Integrating Visual Capabilities while Maintaining Complex Language Understanding: In addition to the vision encoder, we incorporated the Visual Attention Experts into the LLM to enhance its visual capabilities. (ii) Extending Context Window for High-Resolution and Long-Duration Visual Feature: We explore the Visual Merger Module to effectively reduce the token number of high-resolution images and incorporated frame positio

She, Qi, Pan, Junwen, Wan, Xin, Zhang, Rui, Lu, Dawei, Huang, Kai
Creative Commons Attribution 4.0 InternationalView resource

Platform labels describe intended use. Read each resource's author credits, requirements and available access methods.