Presentation
RCTrans: Transparent Object Reconstruction in Natural Scene via Refractive Correspondence Estimation
DescriptionTransparent object reconstruction in an uncontrolled natural scene is a challenging task due to its complex appearance. Existing methods optimize the object shape with RGB color as supervision, which suffer from locality and ambiguity, and fail to recover fine details. In this paper, we present RC-Trans, which uses ray-background correspondence as much more efficient constraints to achieve high-quality reconstruction, while maintaining a convenient setup. The key technology to achieve this is a novel pre-trained correspondence estimation network, which allows us to acquire correspondence under arbitrary scenes and camera views. In addition, a confidence evaluation is introduced to protect the reconstruction from inaccurate estimated correspondence. Extensive experiments on both synthetic and real data demonstrate that our method can produce much more accurate results, without any extra acquisition burden. The code and dataset will be publicly available.
Event Type
Technical Papers
TimeMonday, 15 December 20251:10pm - 1:20pm HKT
LocationMeeting Room S421, Level 4