Explore the Full Program of SIGGRAPH Asia 2025!
Close

Presentation

Fine-Grained Spatially Varying Material Selection in Images
DescriptionSelection is the first step in many image editing processes, enabling faster and simpler modifications of all pixels sharing a common modality. In this work, we present a method for material selection in images, robust to lighting and reflectance variations, which can be used for editing downstream tasks. We rely on vision transformer (ViT) models and process their features for selection, proposing a multi-resolution processing strategy that yields finer and more stable selection results than current methods. Furthermore, we enable selection at two levels: texture and sub-texture, leveraging our novel two-level material selection (DuMaS) dataset, which includes dense annotations for over 800,000 synthetic images, both on the texture and subtexture levels.