Search Results

Multi-sensor information fusion framework is the eyes for unmanned driving and Advanced Driver Assistance System (ADAS) to perceive the surrounding environment. In addition to the perception of the surrounding environment, real-time vehicle localization is also the key and difficult point of unmanned driving technology. The disappearance of high-precision GPS signal suddenly and defect of the lane line will bring much more difficult and dangerous for vehicle localization when the vehicle is on unmanned driving. In this paper, a road boundary feature extraction algorithm is proposed based on multi-sensor information fusion of automotive radar and vision to realize the auxiliary localization of vehicles. Firstly, we designed a 79GHz (78-81GHz) Ultra-Wide Band (UWB) millimeter-wave radar, which can obtain the point cloud information of road boundary features such as guardrail or green belt and so on.

Estimating the motion state of peripheral targets is a very important part in the environment perception of intelligent vehicles. The accurate estimation of the motion state of the peripheral targets can provide more information for the intelligent vehicle planning module which means the intelligent vehicle is able to anticipate hazards ahead of time. To get the motion state of the target accurately, the target’s range, velocity, orientation angle and yaw rate need to be estimated. Three-dimensional high-resolution automotive millimeter wave radar can measure radial range, radial velocity, azimuth angle and elevation angle about multiple reflections of an extended target. Thus, the three-dimensional range information and three-dimensional velocity information can be obtained. With multiple three-dimensional high-resolution automotive millimeter-wave radar, it is possible to measure information in various directions of a target.

In the autonomous driving perception task, the accuracy of target detection is an essential evaluation, especially for small targets. In this work, we propose a multi-sensor fusion neural network that combines radar and image data to improve the confidence level of the camera when detecting targets and the accuracy of the prediction box regression. The fusion network is based on the basic structure of single-shot multi-box detection (SSD). Inspired by the attention mechanism in image processing, our work incorporates the a priori knowledge of radar detection in the convolutional block attention module (CBAM), which forms a new attention mechanism module called radar convolutional block attention module (RCBAM). We add the RCBAM into the SSD target detection network to build a deep neural network fusing millimeter-wave radar and camera.