Search Results

SLAM (Simultaneous Localization and Mapping) plays a key role in autonomous driving. Recently, 4D Radar has attracted widespread attention because it breaks through the limitations of 3D millimeter wave radar and can simultaneously detect the distance, velocity, horizontal azimuth and elevation azimuth of the target with high resolution. However, there are few studies on 4D Radar in SLAM. In this paper, RI-FGO, a 4D Radar-Inertial SLAM method based on Factor Graph Optimization, is proposed. The RANSAC (Random Sample Consensus) method is used to eliminate the dynamic obstacle points from a single scan, and the ego-motion velocity is estimated from the static point cloud. A 4D Radar velocity factor is constructed in GTSAM to receive the estimated velocity in a single scan as a measurement and directly integrated into the factor graph. The 4D Radar point clouds of consecutive frames are matched as the odometry factor.

Speech enhancement can extract clean speech from noise interference, enhancing its perceptual quality and intelligibility. This technology has significant applications in in-car intelligent voice interaction. However, the complex noise environment inside the vehicle, especially the human voice interference is very prominent, which brings great challenges to the vehicle speech interaction system. In this paper, we propose a speech enhancement method based on target speech features, which can better extract clean speech and improve the perceptual quality and intelligibility of enhanced speech in the environment of human noise interference. To this end, we propose a design method for the middle layer of the U-Net architecture based on Long Short-Term Memory (LSTM), which can automatically extract the target speech features that are highly distinguishable from the noise signal and human voice interference features in noisy speech, and realize the targeted extraction of clean speech.

This paper presents an integrated modeling approach for real-time discretionary lane-changing decisions by autonomous vehicles, aiming to achieve human-like behavior. The approach incorporates a two-player normal-form game and a novel risk field method. The normal-form game represents the strategic interactions among traffic participants. It captures the trade-offs between lane-changing benefits and risks based on vehicle motion states during a lane change. By continuously determining the Nash equilibrium of the game at each time step, the model decides when it is appropriate to change the lane. A novel risk field method is integrated with the game to model risks in the game pay-offs. The risk field introduces regions along the desired target lane with different time headway ranges and risk weights, capturing traffic participants' complex risk perceptions and considerations in lane-changing scenarios.

Lane change obstacle avoidance is a common driving scenario for autonomous vehicles. However, existing methods for lane change obstacle avoidance in vehicles decouple path and velocity planning, neglecting the coupling relationship between the path and velocity. Additionally, these methods often do not sufficiently consider the lane change behaviors characteristic of human drivers. In response to these challenges, this paper innovatively applies the Dynamic Movement Primitives (DMPs) algorithm to vehicle trajectory planning and proposes a real-time trajectory planning method that integrates DMPs and Artificial Potential Fields (APFs) algorithm (DMP-Fs) for lane change obstacle avoidance, enabling rapid coordinated planning of both path and velocity. The DMPs algorithm is based on the lane change trajectories of human drivers. Therefore, this paper first collected lane change trajectory samples from on-road vehicle experiments.

Recently, several datasets have become available for occupant monitoring algorithm development, including real and synthetic datasets. However, real data acquisition is expensive and labeling is complex, while virtual data may not accurately reflect actual human physiology. To address these issues and obtain high-fidelity data for training intelligent driving monitoring systems, we have constructed a hybrid dataset that combines real driving image data with corresponding virtual data generated from 3D driving scenarios. We have also taken into account individual anthropometric measures and driving postures. Our approach not only greatly enriches the dataset by using virtual data to augment the sample size, but it also saves the need for extensive annotation efforts. Besides, we can enhance the authenticity of the virtual data by applying ergonomics techniques based on RAMSIS, which is crucial in dataset construction.

This paper focuses on lane-changing trajectory planning and trajectory tracking control in autonomous vehicle technology. Aiming at the lane-changing behavior of autonomous vehicles, this paper proposes a new lane-changing trajectory planning method based on particle swarm optimization (PSO) improved third-order Bezier curve path planning and polynomial curve speed planning. The position of Bezier curve control points is optimized by the particle swarm optimization algorithm, and the lane-changing trajectory is optimized to improve the comfort of lane changing process. Under the constraints of no-collision and vehicle dynamics, the proposed method can ensure that the optimal lane-changing trajectory can be found in different lane-changing scenarios. To verify the feasibility of the above planning algorithm, this paper designs the lateral and longitudinal controllers for trajectory tracking control based on the vehicle dynamic tracking error model.

Automated driving system is a multi-source sensor data fusion system. However different type sensor has different operating frequencies, different field of view, different detection capabilities and different sensor data transition delay. Aiming at these problems, this paper introduces the processing mechanism of out of sequence measurement data into the multi-target detection and tracking system based on millimeter wave radar and camera. After the comparison of ablation experiments, the longitudinal and lateral tracking performance of the fusion system is improved in different distance ranges.

In order to improve the efficiency of safety performance test for intelligent vehicles and construct the test case set quickly, critical scenarios based on graded hazard disposal model of human drivers are proposed, which can be used for extraction of test cases for safety performance. Based on the natural driving data in China Field Operational Test (China-FOT), the four-stage collision avoidance process of human drivers is obtained, including steady driving stage, risk judgment stage, collision reaction stage and collision avoidance stage. And there are two human driver states: general state and alert state. Then the graded hazard disposal model of human drivers is constructed.

The driver monitoring system (DMS) plays an essential role in reducing traffic accidents caused by human errors due to driver distraction and fatigue. The vision-based DMS has been the most widely used because of its advantages of non-contact and high recognition accuracy. However, the traditional RGB camera-based DMS has poor recognition accuracy under complex lighting conditions, while the IR-based DMS has a high cost. In order to improve the recognition accuracy of conventional RGB camera-based DMS under complicated illumination conditions, this paper proposes a lightweight low-illumination image enhancement network inspired by the Retinex theory. The lightweight aspect of the network structure is realized by introducing a pixel-wise adjustment function. In addition, the optimization bottleneck problem is solved by introducing the shortcut mechanism.

To improve the maneuverability and energy consumption of an electrical vehicle, a two-level speed control method based on model predictive control (MPC) is proposed for accurate control of the vehicle during downhill coasting. The targeted acceleration is planned using the anti-interference speed filter and MPC algorithm in the upper-level controller and executed using the integrated algorithm with the inverse vehicle dynamics and proportional-integral-derivative control model (PID) in the lower-level controller, improving the algorithm’s anti-interference performance and road adaptability. Simulations and vehicle road tests showed that the proposed method could realize accurate real-time speed control of the vehicle during downhill coasting. It can also achieve a smaller derivation between the actual and targeted speeds, as well as more stable speeds when the road resistance changes abruptly, compared with the conventional PID method.

Harmony-with-traffic refers to the ability of autonomous vehicles to maximize the driving benefits such as comfort, efficiency, and energy consumption of themselves and the surrounding traffic during interactive driving under traffic rules. In the test of harmony-with-traffic, one or more background vehicles that can respond to the driving behavior of the vehicle under test are required. For this purpose, the functional requirements of car-following model for harmony-with-traffic evaluation are analyzed from the dimensions of test conditions, constraints, steady state and dynamic response. Based on them, an interactive car-following model (ICFM) is developed. In this model, the concept of equivalent distance is proposed to transfer lateral influence to longitudinal. The calculation methods of expected speed are designed according to the different car-following modes divided by interaction object, reaction distance and equivalent distance.

The research and development of data-driven highly automated driving system components such as trajectory prediction, motion planning, driving test scenario generation, and safety validation all require large amounts of naturalistic vehicle trajectory data. Therefore, a variety of data collection methods have emerged to meet the growing demand. Among these, camera-equipped drones are gaining more and more attention because of their obvious advantages. Specifically, compared to others, drones have a wider field of bird's eye view, which is less likely to be blocked, and they could collect more complete and natural vehicle trajectory data. Besides, they are not easily observed by traffic participants and ensure that the human driver behavior data collected is realistic and natural. In this paper, we present a complete vehicle trajectory data extraction framework based on aerial videos. It consists of three parts: 1) objects detection, 2) data association, and 3) data cleaning.

Low-frequency vibration caused by road roughness while driving is transmitted to the human body through tires, suspension, and seats. Prolonged exposure of the human body to the vibratory environment will have an impact on ride comfort or even health issues. In order to investigate the vibration response of various segments of occupants while driving, a 15-DOF multi-body dynamic model depicting the shanks with feet, thighs, pelvis, torso with arms, and the head of occupants is established in the two-dimensional sagittal plane, which considers the contact between the occupant and the cushion, backrest headrest, and the vehicle floor simultaneously. The biodynamic parameters are obtained by fitting the published vibration experimental data based on an optimization algorithm. The previously proposed half-car model is incorporated into the human model to construct an integrated vehicle-human model for further ride comfort analysis.

Visual sensors are widely used in autonomous vehicles (AVs) for object detection due to the advantages of abundant information and low-cost. But the performance of visual sensors is highly affected by low light conditions when AVs driving at nighttime and in the tunnel. The low light conditions decrease the image quality and the performance of object detection, and may cause safety of the intended functionality (SOTIF) problems. Therefore, to analyze the performance limitations of visual sensors in low light conditions, a controlled light experiment on a proving ground is designed. The influences of low light conditions on the two-stage algorithm and the single-stage algorithm are compared and analyzed quantificationally by constructing an evaluation index set from three aspects of missing detection, classification, and positioning accuracy.

With the widespread application of autonomous driving technology, occupant comfort has become a key topic. Occupant comfort of autonomous vehicles depends on the driving system’s performance, so studying the causes of occupant discomfort will help design driving systems. In addition to the discomfort in NVH and thermal comfort, occupant comfort is also affected by other factors such as safety perception. To study the impact of safety perception on comfort, this paper designed a road experiment and focused on the overtaking scenarios. Because the interaction between the ego vehicle and others is strong during overtaking, the occupants are more likely to receive visual stimuli, resulting in discomfort caused by safety perception. In the experiment, occupant discomfort scores were collected in real-time by the tool developed in this paper.

A formal gesture recognition based on optics has limitations, but millimeter-wave (MMW) radar has shown significant advantages in gesture recognition. Therefore, the MMW radar has become the most promising human-computer interaction equipment, which can be used for human-computer interaction of vehicle personnel. This paper proposes a multi-branch network based on a residual neural network (ResNet) to solve the problems of insufficient feature extraction and fusion of the MMW radar and immense algorithm complexity. By constructing the gesture sample library of six gestures, the MMW radar signal is processed and coupled to establish the relationship between the motion parameters of the distance, speed, and angle of the gesture information and time, and the depth features are extracted. Then the three depth features are fused. Finally, the classification and recognition of MMW radar gesture signals are realized through the full connection layer.

Recent researches in autonomous driving mainly consider the uncertainty in perception and prediction modules for safety enhancement. However, obstacles which block the field-of-view (FOV) of sensors could generate blind areas and leaves environmental uncertainty a remaining challenge for autonomous vehicles. Current solutions mainly rely on passive obstacles avoidance in path planning instead of active perception to deal with unexplored high-risky areas. In view of the problem, this paper introduces the concept of information entropy, which quantifies uncertain information in the blind area, into the motion planning module of autonomous vehicles. Based on model predictive control (MPC) scheme, the proposed algorithm can plan collision-free trajectories while actively explore unknown areas to minimize environmental uncertainty. Simulation results under various challenging scenarios demonstrate the improvement in safety and comfort with the proposed perception-aware planning scheme.

As a newly designed hybrid transmission, DHT (Dedicated Hybrid Transmission) owns the advantages of compact structure, multi-modes and excellent comprehensive performance. Compared with the traditional add-on hybrid transmission with one single motor, DHT uses one independent generator for engine starting and speed adjusting which can be largely improve the driving performance in the mode changing process. Based on the series-parallel DHT with wet clutch for power coupling, this paper firstly analyses the power coupling clutch device functionalities from the power flow viewpoint under normal and limp home condition. And for the changing process from series to parallel mode, a clutch coordination control strategy is designed by combining generator fast speed adjusting with clutch accurately pressure controlling to fulfill the fast driver intension response and clutch protection.

As the connectivity of vehicles increases rapidly, more vehicles have the capability to communicate with each other. Because Vehicular Ad-hoc NETworks (VANETs) have the characteristics of solid mobility and decentralization, traditional security strategies such as authentication, firewall, and access control are difficult to play an influential role. As a soft security method, trust management can ensure the security attributes of VANETs. However, the rapid growth of newly encountered nodes of the trust management system also increases the requirements for trust establishing mechanisms. Without a proper trust establishment mechanism, the trust value of the newly encountered nodes will deviate significantly from its actual performance, and the trust management system will suffer from newcomer attacks.

The past decade has witnessed the rapid development of autonomous parking technology, since it has promising capacity to improve traffic efficiency and reduce the burden on drivers. However, it is prone to the trap of self-centeredness when each vehicle is automated parking in isolation. And it is easy to cause traffic congestion and even chaos when multiple autonomous vehicles require of parking into the same lot. In order to address the multiple vehicle parking problem, we propose a parking planning method with genetic algorithm. Firstly, an optimal mathematic model is established to describe the multiple autonomous vehicle parking problem. Secondly, a genetic algorithm is designed to solve the optimization problem. Thirdly, illustrative examples are developed to verify the parking planner. The performance of the present method indicates its competence in addressing parking multiple autonomous vehicles problem.