Search Results

Multi-sensor information fusion framework is the eyes for unmanned driving and Advanced Driver Assistance System (ADAS) to perceive the surrounding environment. In addition to the perception of the surrounding environment, real-time vehicle localization is also the key and difficult point of unmanned driving technology. The disappearance of high-precision GPS signal suddenly and defect of the lane line will bring much more difficult and dangerous for vehicle localization when the vehicle is on unmanned driving. In this paper, a road boundary feature extraction algorithm is proposed based on multi-sensor information fusion of automotive radar and vision to realize the auxiliary localization of vehicles. Firstly, we designed a 79GHz (78-81GHz) Ultra-Wide Band (UWB) millimeter-wave radar, which can obtain the point cloud information of road boundary features such as guardrail or green belt and so on.

The radar-based advanced driver assistance systems (ADAS) like autonomous emergency braking (AEB) and forward collision warning (FCW) can reduce accidents, so as to make vehicles, drivers and pedestrians safer. For active safety, automotive millimeter-wave radar is an indispensable role in the automotive environmental sensing system since it can work effectively regardless of the bad weather while the camera fails. One crucial task of the automotive radar is to detect and distinguish some objects close to each other precisely with the increasingly complex of the road condition. Nowadays almost all the automotive radar products work in bidimensional area where just the range and azimuth can be measured. However, sometimes in their field of view it is not easy for them to differentiate some objects, like the car, the manhole covers and the guide board, when they align with each other in vertical direction.

Millimeter-wave automotive radars can prevent traffic accidents and save human lives as they can detect vehicles and pedestrians even in night and in bad weather. Various types of automotive radars operating at 24 and 77 GHz bands are developed for various applications, like adaptive cruise control, blind-spot detection and lane change assistance. In each year, millions of millimeter-wave radar are sold worldwide. Millimeter-wave radar is composed of radar hardware and radar signal processing software, which detects the targets among noise, measures the distance, longitudinal speed and the azimuth angle of the targets, tracks the targets continuously, and controls the ego vehicle to brake or accelerate. Performance of the radar signal processing software is closely related with the radar hardware properties and radar measurement conditions.

Millimeter wave (MMW) automotive radar plays an important role in the advanced driving assistance system (ADAS), which detects vehicles, pedestrians and other obstacles. In the adaptive cruise control (ACC) and the automatic emergency brake (AEB) system, the target needs to be oriented. One of the automotive radar’s task is to get the direction information which includes the range, speed, azimuth and height of the target by high intermediate frequency (IF) signal sampling rate. In order to solve the problem of high sampling rate for the MMW radar caused by the traditional Nyquist sampling theorem when the target is located, a new method based on the compressed sensing (CS) for the target location is proposed in this paper. This paper presents the linear frequency modulated continuous wave (LFMCW) model and simulates the sampling and reconstruction of the radar’s IF signal via CS technique by using MATLAB.

For sensing system, the trustworthiness of the variant sensors is the crucial point when dealing with advanced driving assistant system application. In this paper, an approach to a hybrid camera-radar application of vehicle tracking is presented, able to meet the requirement of such demand. Most of the time, different types of commercial sensors available nowadays specialize in different situations, such as the ability of offering a wealth of detailed information about the scene for the camera or the powerful resistance to the severe weather for the millimeter-wave (MMW) radar. The detection and tracking in different sensors are usually independent. Thus, the work here that combines the variant information provided by different sensors is indispensable and worthwhile. For the real-time requirement of merging the measurement of automotive MMW radar in high speed, this paper first proposes a fast vehicle tracking algorithm based on image perceptual hash encoding.

Lane marking detection plays a crucial role in Autonomous Driving Systems or Advanced Driving Assistance System. Vision based lane marking detection technology has been well discussed and put into practical application. LiDAR is more stable for challenging environment compared to cameras, and with the development of LiDAR technology, price and lifetime are no longer an issue. We propose a lane marking detection algorithm based on solid-state LiDARs. First a series of data pre-processing operations were done for the solid-state LiDARs with small field of view, and the needed ground points are extracted by the RANSAC method. Then, based on the OTSU method, we propose an approach for extracting lane marking points using intensity information.

Validation is one of the main challenges in development of automated driving systems (ADS). Due to the complexity of these systems and the various influence factors on their functional safety, current testcase generation methods can hardly guarantee the completeness and effectivity of the validation on system level. Separate validation of system components is a way to make system approval possible. In this paper, an approach is presented to generate deductively testcases for the validation of the environment perception sensors, which are the most essential components of ADS. This approach is originated from the model-based testing method, which is commonly used to validate software-based systems and extended by considering various external influence factors as follows: By modeling and analyzing applications in ADS, application oriented usecases of perception sensors are first derived.

Estimating the motion state of peripheral targets is a very important part in the environment perception of intelligent vehicles. The accurate estimation of the motion state of the peripheral targets can provide more information for the intelligent vehicle planning module which means the intelligent vehicle is able to anticipate hazards ahead of time. To get the motion state of the target accurately, the target’s range, velocity, orientation angle and yaw rate need to be estimated. Three-dimensional high-resolution automotive millimeter wave radar can measure radial range, radial velocity, azimuth angle and elevation angle about multiple reflections of an extended target. Thus, the three-dimensional range information and three-dimensional velocity information can be obtained. With multiple three-dimensional high-resolution automotive millimeter-wave radar, it is possible to measure information in various directions of a target.

The camera-based advanced driver assistance systems (ADAS) like lane departure warning system (LDWS) and lane keeping assist (LKA) can make vehicles safer and driving easier. Lane detection is indispensable for these lane-based systems for achieving vehicle local localization and behavior prediction. Since the vision is vulnerable to the variable environment conditions such as bad weather, occlusions and illumination, the robustness is important. In this paper, a robust algorithm for detecting and tracking multiple lanes with arbitrary shape is proposed. We extend the previously lane detection and tracking process from the space domain to the temporal-spatial domain by using a more robust and general multi-lane model. First, new slice images containing temporal information are generated from image sequences. Instead of binarization process, we use a more general detector for extracting the lane marker candidates with prior knowledge to generate the binary slice image.

Automotive radar is the most important component in the autonomous driving system, which detects the obstacles, vehicles and pedestrians around with acceptable cost. The target tracking is one of the key functions in the automotive radar which estimates the position and speed of the targets having regarding to the measurement inaccuracy and interferences. Modern automotive radar requires a multi-target tracking algorithm, as in the radar field of view hundreds of targets can present. In practice, the automotive radar faces very complicated and fast-changing road conditions, for example tunnels and curved roads. The targets’ unpredictable movements and the reflections of the electromagnetic wave from the tunnel walls and the roads will make the multi-target tracking a difficult task. Such situation may last several seconds so that the continuous tracks of the targets cannot be maintained and the tracks are dropped mistakenly.

In the autonomous driving perception task, the accuracy of target detection is an essential evaluation, especially for small targets. In this work, we propose a multi-sensor fusion neural network that combines radar and image data to improve the confidence level of the camera when detecting targets and the accuracy of the prediction box regression. The fusion network is based on the basic structure of single-shot multi-box detection (SSD). Inspired by the attention mechanism in image processing, our work incorporates the a priori knowledge of radar detection in the convolutional block attention module (CBAM), which forms a new attention mechanism module called radar convolutional block attention module (RCBAM). We add the RCBAM into the SSD target detection network to build a deep neural network fusing millimeter-wave radar and camera.

A Joint Probabilistic Data Association (JPDA) multi-objective tracking improvement algorithm based on camera-radar fusion is proposed to address the problems of poor single-sensor tracking performance, unknown target detection probability, and missing valid targets in complex traffic scenarios. First, according to the correlation rule between the target track and the measurement, the correlation probability between the target and the measurement is obtained; then the measurement collection is divided into camera-radar measurement matched target, camera-only measurement matched target, radar-only measurement matched target, and no-match target; and the correlation probability is corrected with different confidence levels to avoid the use of unknown detection probability.