Search Results

Tracking vehicle trajectories is essential for autonomous vehicles and advanced driver-assistance systems to understand traffic environment and evaluate collision risk. In order to reduce the position deviation and fluctuation of tracking on-road vehicle by millimeter-wave radar (MMWR), an interactive multi-model Kalman filter (IMM-KF) tracking algorithm including data association and track management is proposed. In general, it is difficult to model the target vehicle accurately due to lack of vehicle kinematics parameters, like wheel base, uncertainty of driving behavior and limitation of sensor’s field of view. To handle the uncertainty problem, an interacting multiple model (IMM) approach using Kalman filters is employed to estimate multitarget’s states. Then the compensation of radar ego motion is achieved, since the original measurement is under the radar polar coordinate system.

Multi-sensor information fusion framework is the eyes for unmanned driving and Advanced Driver Assistance System (ADAS) to perceive the surrounding environment. In addition to the perception of the surrounding environment, real-time vehicle localization is also the key and difficult point of unmanned driving technology. The disappearance of high-precision GPS signal suddenly and defect of the lane line will bring much more difficult and dangerous for vehicle localization when the vehicle is on unmanned driving. In this paper, a road boundary feature extraction algorithm is proposed based on multi-sensor information fusion of automotive radar and vision to realize the auxiliary localization of vehicles. Firstly, we designed a 79GHz (78-81GHz) Ultra-Wide Band (UWB) millimeter-wave radar, which can obtain the point cloud information of road boundary features such as guardrail or green belt and so on.

The radar-based advanced driver assistance systems (ADAS) like autonomous emergency braking (AEB) and forward collision warning (FCW) can reduce accidents, so as to make vehicles, drivers and pedestrians safer. For active safety, automotive millimeter-wave radar is an indispensable role in the automotive environmental sensing system since it can work effectively regardless of the bad weather while the camera fails. One crucial task of the automotive radar is to detect and distinguish some objects close to each other precisely with the increasingly complex of the road condition. Nowadays almost all the automotive radar products work in bidimensional area where just the range and azimuth can be measured. However, sometimes in their field of view it is not easy for them to differentiate some objects, like the car, the manhole covers and the guide board, when they align with each other in vertical direction.

Millimeter-wave automotive radars can prevent traffic accidents and save human lives as they can detect vehicles and pedestrians even in night and in bad weather. Various types of automotive radars operating at 24 and 77 GHz bands are developed for various applications, like adaptive cruise control, blind-spot detection and lane change assistance. In each year, millions of millimeter-wave radar are sold worldwide. Millimeter-wave radar is composed of radar hardware and radar signal processing software, which detects the targets among noise, measures the distance, longitudinal speed and the azimuth angle of the targets, tracks the targets continuously, and controls the ego vehicle to brake or accelerate. Performance of the radar signal processing software is closely related with the radar hardware properties and radar measurement conditions.

Millimeter wave (MMW) automotive radar plays an important role in the advanced driving assistance system (ADAS), which detects vehicles, pedestrians and other obstacles. In the adaptive cruise control (ACC) and the automatic emergency brake (AEB) system, the target needs to be oriented. One of the automotive radar’s task is to get the direction information which includes the range, speed, azimuth and height of the target by high intermediate frequency (IF) signal sampling rate. In order to solve the problem of high sampling rate for the MMW radar caused by the traditional Nyquist sampling theorem when the target is located, a new method based on the compressed sensing (CS) for the target location is proposed in this paper. This paper presents the linear frequency modulated continuous wave (LFMCW) model and simulates the sampling and reconstruction of the radar’s IF signal via CS technique by using MATLAB.

For sensing system, the trustworthiness of the variant sensors is the crucial point when dealing with advanced driving assistant system application. In this paper, an approach to a hybrid camera-radar application of vehicle tracking is presented, able to meet the requirement of such demand. Most of the time, different types of commercial sensors available nowadays specialize in different situations, such as the ability of offering a wealth of detailed information about the scene for the camera or the powerful resistance to the severe weather for the millimeter-wave (MMW) radar. The detection and tracking in different sensors are usually independent. Thus, the work here that combines the variant information provided by different sensors is indispensable and worthwhile. For the real-time requirement of merging the measurement of automotive MMW radar in high speed, this paper first proposes a fast vehicle tracking algorithm based on image perceptual hash encoding.

Faced with intricate traffic conditions, the single sensor has been unable to meet the safety requirements of Advanced Driver Assistance Systems (ADAS) and autonomous driving. In the field of multi-target tracking, the number of targets detected by vision sensor is sometimes less than the current tracks while the number of targets detected by millimeter wave radar is more than the current tracks. Hence, a multi-sensor information fusion algorithm is presented by utilizing advantage of both vision sensor and millimeter wave radar. The multi-sensor fusion algorithm is based on centralized fusion strategy that the fusion center takes a unified track management. At First, vision sensor and radar are used to detect the target and to measure the range and the azimuth angle of the target. Then, the detections data from vision sensor and radar is transferred to fusion center to join the multi-target tracking with the prediction of current tracks.

Estimating the motion state of peripheral targets is a very important part in the environment perception of intelligent vehicles. The accurate estimation of the motion state of the peripheral targets can provide more information for the intelligent vehicle planning module which means the intelligent vehicle is able to anticipate hazards ahead of time. To get the motion state of the target accurately, the target’s range, velocity, orientation angle and yaw rate need to be estimated. Three-dimensional high-resolution automotive millimeter wave radar can measure radial range, radial velocity, azimuth angle and elevation angle about multiple reflections of an extended target. Thus, the three-dimensional range information and three-dimensional velocity information can be obtained. With multiple three-dimensional high-resolution automotive millimeter-wave radar, it is possible to measure information in various directions of a target.

Smart electric vehicles need more accurate and more timely information as well as control than traditional vehicles, which depends on great environmental sensors such as millimeter-wave radar. In this way, the electromagnetic compatibility of whole vehicle would confront more serious challenges because of its high frequency range. Thus, this paper studies the electromagnetic distribution and electromagnetic interference suppression of smart electric vehicles with the followings. Firstly, the millimeter wave radar is modeled and optimized. Micro strip patch antenna, with small size, light mass and low cost, is used as array element of antenna. Millimeter wave radar is modeled and simulated step by step from array element to line array to planar matrix. Then the Cross Shape - Uniplanar Compact - Electromagnetic Band Gap (CS-UC-EBG) structure is deployed to optimize its electromagnetic characteristics, based on finite time domain difference model theory.

Automotive radar is the most important component in the autonomous driving system, which detects the obstacles, vehicles and pedestrians around with acceptable cost. The target tracking is one of the key functions in the automotive radar which estimates the position and speed of the targets having regarding to the measurement inaccuracy and interferences. Modern automotive radar requires a multi-target tracking algorithm, as in the radar field of view hundreds of targets can present. In practice, the automotive radar faces very complicated and fast-changing road conditions, for example tunnels and curved roads. The targets’ unpredictable movements and the reflections of the electromagnetic wave from the tunnel walls and the roads will make the multi-target tracking a difficult task. Such situation may last several seconds so that the continuous tracks of the targets cannot be maintained and the tracks are dropped mistakenly.

In the autonomous driving perception task, the accuracy of target detection is an essential evaluation, especially for small targets. In this work, we propose a multi-sensor fusion neural network that combines radar and image data to improve the confidence level of the camera when detecting targets and the accuracy of the prediction box regression. The fusion network is based on the basic structure of single-shot multi-box detection (SSD). Inspired by the attention mechanism in image processing, our work incorporates the a priori knowledge of radar detection in the convolutional block attention module (CBAM), which forms a new attention mechanism module called radar convolutional block attention module (RCBAM). We add the RCBAM into the SSD target detection network to build a deep neural network fusing millimeter-wave radar and camera.

A Joint Probabilistic Data Association (JPDA) multi-objective tracking improvement algorithm based on camera-radar fusion is proposed to address the problems of poor single-sensor tracking performance, unknown target detection probability, and missing valid targets in complex traffic scenarios. First, according to the correlation rule between the target track and the measurement, the correlation probability between the target and the measurement is obtained; then the measurement collection is divided into camera-radar measurement matched target, camera-only measurement matched target, radar-only measurement matched target, and no-match target; and the correlation probability is corrected with different confidence levels to avoid the use of unknown detection probability.

Multi-Target tracking is a central aspect of modeling the surrounding environment of autonomous vehicles. Automotive millimeter-wave radar is a necessary component in the autonomous driving system. One of the biggest advantages of radar is it measures the velocity directly. Another big advantage is that the radar is less influenced by environmental conditions. It can work day and night, in rainy or snowy conditions. In the expressway scenario, the forward-looking radar can generate multiple objects, to properly track the leading vehicle or neighbor-lane vehicle, a multi-target tracking algorithm is required. How to associate the track and the measurement or data association is an important question in a multi-target tracking system. This paper applies the nearest-neighbor method to solve the data association problem and uses an extended Kalman filter to update the state of the track.

A formal gesture recognition based on optics has limitations, but millimeter-wave (MMW) radar has shown significant advantages in gesture recognition. Therefore, the MMW radar has become the most promising human-computer interaction equipment, which can be used for human-computer interaction of vehicle personnel. This paper proposes a multi-branch network based on a residual neural network (ResNet) to solve the problems of insufficient feature extraction and fusion of the MMW radar and immense algorithm complexity. By constructing the gesture sample library of six gestures, the MMW radar signal is processed and coupled to establish the relationship between the motion parameters of the distance, speed, and angle of the gesture information and time, and the depth features are extracted. Then the three depth features are fused. Finally, the classification and recognition of MMW radar gesture signals are realized through the full connection layer.

Radar is playing more and important role in multiple object detection and tracking system due to the fact that Radar can not only determine the velocity instantly but also it is less influenced by environment conditions. However, Radar faces the problem that it has many detection clutter，false alarms and detection results are easily affected by the reflected echoes of road boundary in traffic scenes. Besides this, With the increase of the number of targets and the number of effective echoes, the number of interconnection matrices increases exponentially in joint probability data association, which will seriously affect the real-time and accuracy of high-speed scene algorithms.in the tracking system. So, A method of using millimeter wave radar to detect and fit the boundary guardrail of high-speed road is proposed, and the fitting results are applied to the vehicle detection and tracking system to improve the tracking accuracy.

SLAM (Simultaneous Localization and Mapping) plays a key role in autonomous driving. Recently, 4D Radar has attracted widespread attention because it breaks through the limitations of 3D millimeter wave radar and can simultaneously detect the distance, velocity, horizontal azimuth and elevation azimuth of the target with high resolution. However, there are few studies on 4D Radar in SLAM. In this paper, RI-FGO, a 4D Radar-Inertial SLAM method based on Factor Graph Optimization, is proposed. The RANSAC (Random Sample Consensus) method is used to eliminate the dynamic obstacle points from a single scan, and the ego-motion velocity is estimated from the static point cloud. A 4D Radar velocity factor is constructed in GTSAM to receive the estimated velocity in a single scan as a measurement and directly integrated into the factor graph. The 4D Radar point clouds of consecutive frames are matched as the odometry factor.

Accurate and reliable localization in GNSS-denied environments is critical for autonomous driving. Nevertheless, LiDAR-based and camera-based methods are easily affected by adverse weather conditions such as rain, snow, and fog. The 4D Radar with all-weather performance and high resolution has attracted more interest. Currently, there are few localization algorithms based on 4D Radar, so there is an urgent need to develop reliable and accurate positioning solutions. This paper introduces RIO-Vehicle, a novel tightly coupled 4D Radar/IMU/vehicle dynamics within the factor graph framework. RIO-Vehicle aims to achieve reliable and accurate vehicle state estimation, encompassing position, velocity, and attitude. To enhance the accuracy of relative constraints, we introduce a new integrated IMU/Dynamics pre-integration model that combines a 2D vehicle dynamics model with a 3D kinematics model.