Toward Robust and 3D-Aware RGB-NIR Imaging in the Dark
A 3D-aware RGB-NIR method recovers clean low-light images without clean RGB supervision, targeting more robust dark-scene imaging.
Excerpt
Muyao Niu, Mingze Ma, Yifan Zhan, Qingtian Zhu, Zhihang Zhong — Robust low-light imaging remains challenging for the community. Recent studies have explored fusing Near-Infrared (NIR) with noisy RGB to achieve improved enhancement, yet most methods depend on carefully curated training data pairs, with limited robustness under different scenarios. This paper offers a new perspective for RGB-NIR low-light imaging by incorporating 3D-aware neural modeling. Without using clean RGB supervision, a powerful model can be optimized to implicitly fuse extremely noisy RGB observations with NIR cues in 3D space, effectively recovering clean RGB images. The proposed model obviates the requirement for clean RGB data collection, generalizes across different noise levels. Extensive evaluations on synthetic and real data demonstrate its superiority. Codes available: https://github.com/MyNiuuu/3DarkFusion
Read at source: https://arxiv.org/abs/2607.29684