Moondream Segmentation: From Words to Masks
Research paper by Ethan Reid. arXiv record dated 2026-04-03. Research area: Computer vision.
Resource information
- Authors
- Ethan Reid
- Research area
- Computer vision
- Application domain
- General AI research
- AI methods
- Reinforcement learning
- Research topics
- cs.CV, cs.AI
- arXiv record date
- 2026-04-03
- Publication
- arXiv
- Upstream last modified
- Apr 6, 2026
- Last record update
- Nov 4, 2026
Abstract
We present Moondream Segmentation, a referring image segmentation extension of Moondream 3, a vision-language model. Given an image and a referring expression, the model autoregressively decodes a vector path and iteratively refines the rasterized mask into a final detailed mask. We introduce a reinforcement learning stage that resolves ambiguity in the supervised signal by directly optimizing mask quality. Rollouts from this stage produce coarse-to-ground-truth targets for the refiner. To mitigate evaluation noise from polygon annotations, we release RefCOCO-M, a cleaned RefCOCO validation split with boundary-accurate masks. Moondream Segmentation achieves a cIoU of 80.2% on RefCOCO (val) and 62.6% mIoU on LVIS (val).