Search Results

SLAM (Simultaneous Localization and Mapping) plays a key role in autonomous driving. Recently, 4D Radar has attracted widespread attention because it breaks through the limitations of 3D millimeter wave radar and can simultaneously detect the distance, velocity, horizontal azimuth and elevation azimuth of the target with high resolution. However, there are few studies on 4D Radar in SLAM. In this paper, RI-FGO, a 4D Radar-Inertial SLAM method based on Factor Graph Optimization, is proposed. The RANSAC (Random Sample Consensus) method is used to eliminate the dynamic obstacle points from a single scan, and the ego-motion velocity is estimated from the static point cloud. A 4D Radar velocity factor is constructed in GTSAM to receive the estimated velocity in a single scan as a measurement and directly integrated into the factor graph. The 4D Radar point clouds of consecutive frames are matched as the odometry factor.

Multi-Target tracking is a central aspect of modeling the surrounding environment of autonomous vehicles. Automotive millimeter-wave radar is a necessary component in the autonomous driving system. One of the biggest advantages of radar is it measures the velocity directly. Another big advantage is that the radar is less influenced by environmental conditions. It can work day and night, in rainy or snowy conditions. In the expressway scenario, the forward-looking radar can generate multiple objects, to properly track the leading vehicle or neighbor-lane vehicle, a multi-target tracking algorithm is required. How to associate the track and the measurement or data association is an important question in a multi-target tracking system. This paper applies the nearest-neighbor method to solve the data association problem and uses an extended Kalman filter to update the state of the track.

The research and development of data-driven highly automated driving system components such as trajectory prediction, motion planning, driving test scenario generation, and safety validation all require large amounts of naturalistic vehicle trajectory data. Therefore, a variety of data collection methods have emerged to meet the growing demand. Among these, camera-equipped drones are gaining more and more attention because of their obvious advantages. Specifically, compared to others, drones have a wider field of bird's eye view, which is less likely to be blocked, and they could collect more complete and natural vehicle trajectory data. Besides, they are not easily observed by traffic participants and ensure that the human driver behavior data collected is realistic and natural. In this paper, we present a complete vehicle trajectory data extraction framework based on aerial videos. It consists of three parts: 1) objects detection, 2) data association, and 3) data cleaning.

Recently, several datasets have become available for occupant monitoring algorithm development, including real and synthetic datasets. However, real data acquisition is expensive and labeling is complex, while virtual data may not accurately reflect actual human physiology. To address these issues and obtain high-fidelity data for training intelligent driving monitoring systems, we have constructed a hybrid dataset that combines real driving image data with corresponding virtual data generated from 3D driving scenarios. We have also taken into account individual anthropometric measures and driving postures. Our approach not only greatly enriches the dataset by using virtual data to augment the sample size, but it also saves the need for extensive annotation efforts. Besides, we can enhance the authenticity of the virtual data by applying ergonomics techniques based on RAMSIS, which is crucial in dataset construction.

Positioning system is a key module of autonomous driving. As for LiDAR SLAM system, it faces great challenges in scenarios where there are repetitive and sparse features. Without loop closure or measurements from other sensors, odometry match errors or accumulated errors cannot be corrected. This paper proposes a construction method of LiDAR anchor constraints to improve the robustness of the SLAM system in the above challenging environment. We propose a robust anchor extraction method that adaptively extracts suitable cylindrical anchors in the environment, such as tree trunks, light poles, etc. Skewed tree trunks are detected by feature differences between laser lines. Boundary points on cylinders are removed to avoid misleading. After the appropriate anchors are detected, a factor graph-based anchor constraint construction method is designed. Where direct scans are made to anchor, direct constraints are constructed.

Autonomous driving related technologies have become a hot topic in academia and industry. Planning control is one of the core technologies of autonomous driving, which is conducive to vehicles safe and efficient driving. This paper proposes a novel optimal speed control algorithm, which considers the power system's energy consumption, the speed limit on the road, and the safe distance of the vehicle in front. An optimal speed control model of “From battery to wheel” energy consumption is established by constructing a performance index function based on the best-fitting formula of motor power, motor speed and torque. Based on the optimal control principle, the fourth-order ordinary differential equation of the speed control model is established, based on the indirect adjoining approach, the speed control model under the restriction of the road speed limit and safe distance of the preceding vehicle is derived and the analytical expression is obtained.

With the popularity of automated vehicles, the future mixed traffic flow contains automated vehicles with different degrees of intelligence developed by other manufacturers. Therefore, simulating the interaction behavior of automated vehicles with varying levels of intelligence is crucial for testing and evaluating autonomous driving systems. Since the algorithm of traffic vehicles with various intelligence levels is difficult to obtain, it leads to hardships in quantitatively characterizing their interaction behaviors. Therefore, this paper designs a new automated vehicle test platform to solve the problem. The intelligent vehicle testbed with multiple personalized in-vehicle control units in the loop consists of three parts: 1. Multiple controllers in the loop to simulate the behavior of traffic vehicles；2. The central console applies digital twin technology to share the same traffic scenario between the tested vehicle and the traffic vehicle, creating a mixed traffic flow. 3.

As one of the key technologies in autonomous driving, the lateral planning module guides the lateral movement during the driving process. An integrated lateral planning module should consider the non-holonomic constraints of a vehicle, the optimization of the generated trajectory and the applicability to various scenarios. However, the current lateral planning methods can only meet parts of these requirements. In order to satisfy all the performance requirements above, a novel Potential Field (PF) based lateral planning method is proposed in this paper. Firstly, a PF model is built to describe the potential risk of the traffic entities, including the obstacles, road boundaries and lines. The potential fields of these traffic entities are determined by their properties and the traffic regulations. Secondly, the planning algorithm is presented, which comprises three modules: state prediction, state search and trajectory generation.

A rapid path-planning algorithm that generates drivable paths for an autonomous vehicle operating in structural road is proposed in this paper. Cubic B-spline curve is adopted to generating smooth path for continuous curvature and, more, parametric basic points of the spline is adjusted to controlling the curvature extremum for kinematic constraints on vehicle. Other than previous approaches such as inverse kinematics, model-based prediction postprocess approach or closed-loop forward simulation, using the kinematics model in each iteration of path for smoothing and controlling curvature leading to time consumption increasing, our method characterized the vehicle curvature constraint by the minimum length of segment line, which synchronously realized constraint and smooth for generating path. And Differ from the path of robot escaping from a maze, the intelligent vehicle traveling on road in structured environments needs to meet the traffic rules.

Image corruptions due to noise, blur, contrast change, etc., could lead to a significant performance decline of Deep Neural Networks (DNN), which poses a potential threat to DNN-based autonomous vehicles. Previous works attempted to explain corruption from a Fourier perspective. By comparing the absolute Fourier spectrum difference between corrupted images and clean images in the RGB color space, they regard the noise from some corruptions (Gaussian noise, defocus blur, etc.) as concentrating on the high-frequency components while others (contrast, fog, etc.) concentrate on the low-frequency components. In this work, we present a new perspective that unifies corruptions as noise from high frequency and thus propose an image augmentation algorithm to achieve a more robust performance against common corruptions. First, we notice the 1/fα statistical rule of the natural image's spectrum and the channels-wise differential sensitivity on the YCbCr color space of the Human Visual System.

Gesture control has been increasingly applied to automotive industry to reduce the distraction caused by in-vehicle interactions to the primary task of driving. The aim of this study is to find out if gestures can reasonably be used to control in-car devices. Since there exists a big cultural difference of gesture between different countries because of its particularity, a set of gestures which support intuitive human-machine interaction in an automotive environment is searched. The results show a gesture dictionary for a variety of on-board functions, which conforms to Chinese drivers’ driving habits. Furthermore, this paper also describes a driving simulator test to evaluate the usability of gesture from different aspects including the effectiveness, efficiency, satisfaction, memorability and security. Static driving simulator is considered as an excellent environment for the in-car secondary task as its high safety level, repeatability and reliability.

On the study of reducing the disturbance on driver’s attention induced by low frequency vehicle interior stationary noise, a subjective evaluation is firstly carried out by means of rank rating method which introduces Distraction Level (DL) as evaluation index. A visual-finger response test is developed to help evaluating members better recognize the Distraction Level during the evaluation. A non-linear back propagation artificial neural network (BPANN) is then modeled for the prediction of subjective Distraction Level, in which linear sound pressure RMS amplitudes of five Critical Band Rates (CBRs) from 20 to 500Hz are selected as inputs of the model. These inputs comprise an input vector of BPANN. Furthermore, active noise equalization (ANE) on DL is realized based on Filtered-x Least Mean Square (FxLMS) algorithm that controls the gain coefficients of inputs of trained BPANN.

Lane Keeping Assistance System (LKAS) is a typical lateral driver assistance system with low acceptance. One of the main reasons is that fixed parameters cannot satisfy individual differences. So LKAS adaptive to driver characteristics needs to be designed. Driver Steering Override (DSO) process is an important process of LKAS. It happens when contradiction between driver’s intention and system behavior occurs. As feeling of overriding will affect the overall experience of using LKAS, the design of DSO characteristics is worthy of attention. This research provided an adaptive design scheme aiming at DSO characteristics for LKAS by building Driver Preference Model (DPM) based on simulator test data from preliminary experiments. The DPM was to represent the relationship between driver characteristics indices and driver preferred system characteristics indices. So that new drivers’ preference can be predicted by DPM based on their own daily driving data with LKAS switched off.

Harmony-with-traffic refers to the ability of autonomous vehicles to maximize the driving benefits such as comfort, efficiency, and energy consumption of themselves and the surrounding traffic during interactive driving under traffic rules. In the test of harmony-with-traffic, one or more background vehicles that can respond to the driving behavior of the vehicle under test are required. For this purpose, the functional requirements of car-following model for harmony-with-traffic evaluation are analyzed from the dimensions of test conditions, constraints, steady state and dynamic response. Based on them, an interactive car-following model (ICFM) is developed. In this model, the concept of equivalent distance is proposed to transfer lateral influence to longitudinal. The calculation methods of expected speed are designed according to the different car-following modes divided by interaction object, reaction distance and equivalent distance.

Real-time interaction between a driver and the simulator is problematic. In this study, the racing car driving simulator has been established, which is composed of the following functional components: Motion Controller, Simview, Scenario Editor, Application Programmer Interface (APIs) and Crash Simulation. With TCP/IP protocol, the Motion Controller receives driver's manipulation, road unevenness and crash situation of Simview, then generates motion streams that reflecting the current conditions, and sends them to Simview and to the hydraulic platform. Furthermore, by detecting and analyzing general vehicle two-dimensional impact, a kind of complete and applicable calculation method has been established, and complicated vehicle impacts can be analyzed accurately. This racecar driving simulator places a racing driver in a interactive environment, and provides the driver with high-fidelity motion, visual, auditory, and force feedback cues.

Radar is playing more and important role in multiple object detection and tracking system due to the fact that Radar can not only determine the velocity instantly but also it is less influenced by environment conditions. However, Radar faces the problem that it has many detection clutter，false alarms and detection results are easily affected by the reflected echoes of road boundary in traffic scenes. Besides this, With the increase of the number of targets and the number of effective echoes, the number of interconnection matrices increases exponentially in joint probability data association, which will seriously affect the real-time and accuracy of high-speed scene algorithms.in the tracking system. So, A method of using millimeter wave radar to detect and fit the boundary guardrail of high-speed road is proposed, and the fitting results are applied to the vehicle detection and tracking system to improve the tracking accuracy.

Based on the emergency lane change cases extracted from the China naturalistic driving data, the driving steering behavior divides into three phases: collision avoidance, lateral movement and steering stabilization. Using the steering primitive fitting by Gaussian function, the distribution of the duration time, the relationship between steering wheel rate and deflection were analyzed in three phases. It is shown that the steering behavior essentially is composed of steering primitives during the emergency lane-change. However, the combination of the steering primitives is different according to the specific steering constraints in three phases. In the collision avoidance phase, a single steering primitive with high peak is used for the fast steering; in the lateral movement and stabilization phase, a combination of two or even more steering primitives is built to a more accurate steering.

X-in-the-loop (XiL) framework is a validation concept for vehicle product development, which integrates different virtual and physical components to improve the development efficiency. In order to develop and validate an extended validation method based on XiL, Tongji University in Shanghai, China and the Karlsruhe Institute of Technology (KIT) in Karlsruhe, Germany co- performed a feasibility study about an X-in-the-distance-loop demonstration platform. The X-in-the-distance-loop demonstration platform includes a MATLAB/Simulink software platform and geographically distributed equipment (driver simulator, driving electric motor and dynamometer test stand), which are used to conduct bidirectional experiments to test communication of powertrain data between China and Germany.

Lane-keeping assist system (LKA) alerts the driver or intervenes in the driving when the vehicle deviates from the lane. But its effect is highly dependent on the driver’s acceptance. Distance to Lane Crossing (DTLC) and Time to Lane Crossing (TTLC) are two important factors to consider the danger level of the scenario, which are also two references for drivers to make decisions. At present, most of the functional design standards are based on these values, while they often differ for different vehicle movements. This study uses a driving robot to precisely control the test conditions and performs field tests on two advanced autonomous vehicles in National Intelligent Connected Vehicle (Shanghai) Pilot Zone. The test conditions are extended based on various test standards and the LKA performance of vehicles in the pre-experiment.

A driver steering model for emergency lane change based on the China naturalistic driving data is proposed in this paper. The steering characteristic of three phases is analyzed. Using the steering primitive fitting by Gaussian function, the steering behaviors in collision avoidance and lateral movement phases can be described, and the stabilization steering principle of yaw rate null is found. Based on the steering characteristic, the near and far aim point used in steering phases is analyzed. Using the near and far aim point correction model, a driver steering model for emergency lane change is established. The research results show that the driver emergency steering model proposed in this paper performs well when explaining realistic steering behavior, and this model can be used in developing the ADAS system.