Joint 3D shape and hyperspectral reconstruction from single-view spectro-polarimetric imaging

TY - JOUR

T1 - Joint 3D shape and hyperspectral reconstruction from single-view spectro-polarimetric imaging

AU - Peng, Pengming

AU - Wang, Zhen

AU - Zhao, Zhengyi

AU - Zhao, Chengfu

AU - Yan, Rong

AU - Li, Lianjie

AU - Liu, Wenhui

AU - Bian, Liheng

PY - 2026/3/1

Y1 - 2026/3/1

N2 - Shape from Polarization (SfP) has emerged as a promising technique for reconstructing the three-dimensional (3D) structure of objects using polarization information. However, existing 3D reconstruction methods generally suffer from degraded accuracy when dealing with dark or low-reflectivity surfaces, resulting in unreliable point cloud data. Furthermore, most current methods generally focus on geometric reconstruction, such as surface normals or depth maps, limiting their ability to capture the spectral characteristics of objects' materials. Here, we propose a novel single-view spectro-polarimetric imaging (SVSPI) method that, for the first time to our knowledge, achieves joint reconstruction of 3D shape and hyperspectral information from single-view spectro-polarimetric imaging for dark-surfaced objects. This method uses an on-chip broadband hyperspectral imaging sensor and introduces a dedicated spectral-polarization-3D dataset to support training and evaluation. Experimental results demonstrate the effectiveness of the proposed method, achieving the simultaneous reconstruction of surface normals, depth maps, and spectral information within the 400-1000 nm range under complex environmental conditions.

AB - Shape from Polarization (SfP) has emerged as a promising technique for reconstructing the three-dimensional (3D) structure of objects using polarization information. However, existing 3D reconstruction methods generally suffer from degraded accuracy when dealing with dark or low-reflectivity surfaces, resulting in unreliable point cloud data. Furthermore, most current methods generally focus on geometric reconstruction, such as surface normals or depth maps, limiting their ability to capture the spectral characteristics of objects' materials. Here, we propose a novel single-view spectro-polarimetric imaging (SVSPI) method that, for the first time to our knowledge, achieves joint reconstruction of 3D shape and hyperspectral information from single-view spectro-polarimetric imaging for dark-surfaced objects. This method uses an on-chip broadband hyperspectral imaging sensor and introduces a dedicated spectral-polarization-3D dataset to support training and evaluation. Experimental results demonstrate the effectiveness of the proposed method, achieving the simultaneous reconstruction of surface normals, depth maps, and spectral information within the 400-1000 nm range under complex environmental conditions.

UR - https://www.scopus.com/pages/publications/105031718684

U2 - 10.1364/OL.588516

DO - 10.1364/OL.588516

M3 - Article

C2 - 41759112

AN - SCOPUS:105031718684

SN - 0146-9592

VL - 51

SP - 1132

EP - 1135

JO - Optics Letters

JF - Optics Letters

IS - 5

ER -