Search Results

A Joint Probabilistic Data Association (JPDA) multi-objective tracking improvement algorithm based on camera-radar fusion is proposed to address the problems of poor single-sensor tracking performance, unknown target detection probability, and missing valid targets in complex traffic scenarios. First, according to the correlation rule between the target track and the measurement, the correlation probability between the target and the measurement is obtained; then the measurement collection is divided into camera-radar measurement matched target, camera-only measurement matched target, radar-only measurement matched target, and no-match target; and the correlation probability is corrected with different confidence levels to avoid the use of unknown detection probability.

In the autonomous driving perception task, the accuracy of target detection is an essential evaluation, especially for small targets. In this work, we propose a multi-sensor fusion neural network that combines radar and image data to improve the confidence level of the camera when detecting targets and the accuracy of the prediction box regression. The fusion network is based on the basic structure of single-shot multi-box detection (SSD). Inspired by the attention mechanism in image processing, our work incorporates the a priori knowledge of radar detection in the convolutional block attention module (CBAM), which forms a new attention mechanism module called radar convolutional block attention module (RCBAM). We add the RCBAM into the SSD target detection network to build a deep neural network fusing millimeter-wave radar and camera.