Depth and Thermal Sensor Fusion to Enhance 3D Thermographic Reconstruction
Posted on 2018-03-21 - 16:55
3D geometrical models with incorporated surface temperature data provide important information for various applications such as medical imaging, energy auditing, and intelligent robots. In this paper we present a robust method for mobile and real-time 3D thermographic reconstruction through depth and thermal sensor fusion. A multimodal imaging device consisting of a thermal camera and a RGB-D sensor is calibrated geometrically and used for data capturing. Based on the underlying principle that temperature information remains robust against illumination and viewpoint changes, we present a Thermal-guided Iterative Closest Point (T-ICP) methodology to facilitate reliable 3D thermal scanning applications. The pose of sensing device is initially estimated using correspondences found through maximizing the thermal consistency between consecutive infrared images. The coarse pose estimate is further refined by finding the motion parameters that minimize a combined geometric and thermographic loss function. Experimental results demonstrate that complimentary information captured by multimodal sensors can be utilized to improve performance of 3D thermographic reconstruction. Through effective fusion of thermal and depth data, the proposed approach generates more accurate 3D thermal models using significantly less scanning data.
CITE THIS COLLECTION
DataCite
3 Biotech
3D Printing in Medicine
3D Research
3D-Printed Materials and Systems
4OR
AAPG Bulletin
AAPS Open
AAPS PharmSciTech
Abhandlungen aus dem Mathematischen Seminar der Universität Hamburg
ABI Technik (German)
Academic Medicine
Academic Pediatrics
Academic Psychiatry
Academic Questions
Academy of Management Discoveries
Academy of Management Journal
Academy of Management Learning and Education
Academy of Management Perspectives
Academy of Management Proceedings
Academy of Management Review
Cao, Yanpeng; Xu, Baobei; Ye, Zhangyu; Yang, Jiangxin; Cao, Yanlong; Tisse, Christel-loic; et al. (2018). Depth and Thermal Sensor Fusion to Enhance 3D Thermographic Reconstruction. Optica Publishing Group. Collection. https://doi.org/10.6084/m9.figshare.c.3977952.v1
or
Select your citation style and then place your mouse over the citation text to select it.
Resource Link
SHARE
Usage metrics
Read the peer-reviewed publication
AUTHORS (7)
YC
Yanpeng Cao
BX
Baobei Xu
ZY
Zhangyu Ye
JY
Jiangxin Yang
YC
Yanlong Cao
CT
Christel-loic Tisse
XL
Xin Li