Logo image
Back
Diffusion Models-Based Purification for Common Corruptions on Robust 3D Object Detection
Journal article   Open access   Peer reviewed

Diffusion Models-Based Purification for Common Corruptions on Robust 3D Object Detection

Mumuxin Cai, Xupeng Wang, Ferdous Sohel and Hang Lei
Sensors (Basel, Switzerland), Vol.24(16), 5440
2024
DOI: https://doi.org/10.3390/s24165440
pdf
Published3.03 MBDownloadView
CC BY V4.0,  Open Access

Abstract

LiDAR sensors have been shown to generate data with various common corruptions, which seriously affect their applications in 3D vision tasks, particularly object detection. At the same time, it has been demonstrated that traditional defense strategies, including adversarial training, are prone to suffering from gradient confusion during training. Moreover, they can only improve their robustness against specific types of data corruption. In this work, we propose LiDARPure, which leverages the powerful generation ability of diffusion models to purify corruption in the LiDAR scene data. By dividing the entire scene into voxels to facilitate the processes of diffusion and reverse diffusion, LiDARPure overcomes challenges induced from adversarial training, such as sparse point clouds in large-scale LiDAR data and gradient confusion. In addition, we utilize the latent geometric features of a scene as a condition to assist the generation of diffusion models. Detailed experiments show that LiDARPure can effectively purify 19 common types of LiDAR data corruption. Further evaluation results demonstrate that it can improve the average precision of 3D object detectors to an extent of 20% in the face of data corruption, much higher than existing defence strategies.

Details

Metrics

4 File views/ downloads
49 Record Views
Logo image