4th PVUW MeViS 3rd Place Report: Sa2VA
Research paper by Haobo Yuan and collaborators. arXiv record dated 2025-04-01. Research area: Computer vision.
Resource information
- Authors
- Haobo Yuan, Tao Zhang, Xiangtai Li, Lu Qi, Zilong Huang, Shilin Xu, Jiashi Feng, Ming-Hsuan Yang
- Research area
- Computer vision
- Application domain
- General AI research
- AI methods
- Large language models
- Research topics
- cs.CV
- arXiv record date
- 2025-04-01
- Publication
- arXiv
- Upstream last modified
- Apr 2, 2025
- Last record update
- Nov 4, 2026
Abstract
Referring video object segmentation (RVOS) is a challenging task that requires the model to segment the object in a video given the language description. MeViS is a recently proposed dataset that contains motion expressions of the target objects, leading to a challenging benchmark, compared with existing RVOS benchmarks. On the other hand, for referring expression tasks, a new trend is to adopt multi-modal large language model (MLLM) to achieve better image and text alignment. In this report, we show that with a simple modification to the test time inference method on stronger MLLMs, we can lead to stronger results on MeVIS. In particular, we adopt the recent method Sa2VA, a unified model for dense grounded understanding of both images and videos. By enlarging the scope of key frames, without any further training, we can achieve the 3rd place in the 4th PVUW workshop.