Optimizing 3D object detection for embedded systems in automated vehicles using sensor data fusion and CUDA computing

This article explores the utilization of the processing power of GPUs using CUDA computation for real-time aggregation of multi-sensor data and detection of 3D objects using parallel clustering algorithms. The purpose is to implement an algorithm that fuses raw lidar point cloud data and 2D camera image object detections to produce 3D object clusters in a lidar point cloud. Most of the computation has been implemented using CUDA parallelism to investigate the capability of GPU devices in this task, which is a common challenge in automated driving. The results indicate that processing times can be optimized within the algorithm, which is crucial when considering the large amounts of data provided by lidar and camera-based systems. The algorithm can perform inference on the Jetson Xavier AGX at rates of ~20 to ~220 ms depending on the number of objects and their corresponding point amounts in the KITTI dataset.