Search Results

SLAM (Simultaneous Localization and Mapping) plays a key role in autonomous driving. Recently, 4D Radar has attracted widespread attention because it breaks through the limitations of 3D millimeter wave radar and can simultaneously detect the distance, velocity, horizontal azimuth and elevation azimuth of the target with high resolution. However, there are few studies on 4D Radar in SLAM. In this paper, RI-FGO, a 4D Radar-Inertial SLAM method based on Factor Graph Optimization, is proposed. The RANSAC (Random Sample Consensus) method is used to eliminate the dynamic obstacle points from a single scan, and the ego-motion velocity is estimated from the static point cloud. A 4D Radar velocity factor is constructed in GTSAM to receive the estimated velocity in a single scan as a measurement and directly integrated into the factor graph. The 4D Radar point clouds of consecutive frames are matched as the odometry factor.

Speech enhancement can extract clean speech from noise interference, enhancing its perceptual quality and intelligibility. This technology has significant applications in in-car intelligent voice interaction. However, the complex noise environment inside the vehicle, especially the human voice interference is very prominent, which brings great challenges to the vehicle speech interaction system. In this paper, we propose a speech enhancement method based on target speech features, which can better extract clean speech and improve the perceptual quality and intelligibility of enhanced speech in the environment of human noise interference. To this end, we propose a design method for the middle layer of the U-Net architecture based on Long Short-Term Memory (LSTM), which can automatically extract the target speech features that are highly distinguishable from the noise signal and human voice interference features in noisy speech, and realize the targeted extraction of clean speech.

This paper presents an integrated modeling approach for real-time discretionary lane-changing decisions by autonomous vehicles, aiming to achieve human-like behavior. The approach incorporates a two-player normal-form game and a novel risk field method. The normal-form game represents the strategic interactions among traffic participants. It captures the trade-offs between lane-changing benefits and risks based on vehicle motion states during a lane change. By continuously determining the Nash equilibrium of the game at each time step, the model decides when it is appropriate to change the lane. A novel risk field method is integrated with the game to model risks in the game pay-offs. The risk field introduces regions along the desired target lane with different time headway ranges and risk weights, capturing traffic participants' complex risk perceptions and considerations in lane-changing scenarios.

Lane change obstacle avoidance is a common driving scenario for autonomous vehicles. However, existing methods for lane change obstacle avoidance in vehicles decouple path and velocity planning, neglecting the coupling relationship between the path and velocity. Additionally, these methods often do not sufficiently consider the lane change behaviors characteristic of human drivers. In response to these challenges, this paper innovatively applies the Dynamic Movement Primitives (DMPs) algorithm to vehicle trajectory planning and proposes a real-time trajectory planning method that integrates DMPs and Artificial Potential Fields (APFs) algorithm (DMP-Fs) for lane change obstacle avoidance, enabling rapid coordinated planning of both path and velocity. The DMPs algorithm is based on the lane change trajectories of human drivers. Therefore, this paper first collected lane change trajectory samples from on-road vehicle experiments.

Recently, several datasets have become available for occupant monitoring algorithm development, including real and synthetic datasets. However, real data acquisition is expensive and labeling is complex, while virtual data may not accurately reflect actual human physiology. To address these issues and obtain high-fidelity data for training intelligent driving monitoring systems, we have constructed a hybrid dataset that combines real driving image data with corresponding virtual data generated from 3D driving scenarios. We have also taken into account individual anthropometric measures and driving postures. Our approach not only greatly enriches the dataset by using virtual data to augment the sample size, but it also saves the need for extensive annotation efforts. Besides, we can enhance the authenticity of the virtual data by applying ergonomics techniques based on RAMSIS, which is crucial in dataset construction.

The software installed in Electronic Control Units (ECUs) has witnessed a significant scale expansion as the functionality of Intelligent Connected Vehicles (ICVs) has become more sophisticated. To seek convenient long-term functional maintenance, stakeholders want to access ECUs data or update software from anywhere via diagnostic. Accordingly, as one of the external interfaces, Diagnostics over Internet Protocol (DoIP) is inevitably prone to malicious attacks. It is essential to note that cybersecurity threats not only arise from inherent protocol defects but also consider software implementation vulnerabilities. When implementing a specification, developers have considerable freedom to decide how to proceed. Differences between protocol specifications and implementations are often unavoidable, which can result in security vulnerabilities and potential attacks exploiting them.

Accurate and reliable localization in GNSS-denied environments is critical for autonomous driving. Nevertheless, LiDAR-based and camera-based methods are easily affected by adverse weather conditions such as rain, snow, and fog. The 4D Radar with all-weather performance and high resolution has attracted more interest. Currently, there are few localization algorithms based on 4D Radar, so there is an urgent need to develop reliable and accurate positioning solutions. This paper introduces RIO-Vehicle, a novel tightly coupled 4D Radar/IMU/vehicle dynamics within the factor graph framework. RIO-Vehicle aims to achieve reliable and accurate vehicle state estimation, encompassing position, velocity, and attitude. To enhance the accuracy of relative constraints, we introduce a new integrated IMU/Dynamics pre-integration model that combines a 2D vehicle dynamics model with a 3D kinematics model.

This paper focuses on lane-changing trajectory planning and trajectory tracking control in autonomous vehicle technology. Aiming at the lane-changing behavior of autonomous vehicles, this paper proposes a new lane-changing trajectory planning method based on particle swarm optimization (PSO) improved third-order Bezier curve path planning and polynomial curve speed planning. The position of Bezier curve control points is optimized by the particle swarm optimization algorithm, and the lane-changing trajectory is optimized to improve the comfort of lane changing process. Under the constraints of no-collision and vehicle dynamics, the proposed method can ensure that the optimal lane-changing trajectory can be found in different lane-changing scenarios. To verify the feasibility of the above planning algorithm, this paper designs the lateral and longitudinal controllers for trajectory tracking control based on the vehicle dynamic tracking error model.

Radar is playing more and important role in multiple object detection and tracking system due to the fact that Radar can not only determine the velocity instantly but also it is less influenced by environment conditions. However, Radar faces the problem that it has many detection clutter，false alarms and detection results are easily affected by the reflected echoes of road boundary in traffic scenes. Besides this, With the increase of the number of targets and the number of effective echoes, the number of interconnection matrices increases exponentially in joint probability data association, which will seriously affect the real-time and accuracy of high-speed scene algorithms.in the tracking system. So, A method of using millimeter wave radar to detect and fit the boundary guardrail of high-speed road is proposed, and the fitting results are applied to the vehicle detection and tracking system to improve the tracking accuracy.

In order to improve the efficiency of safety performance test for intelligent vehicles and construct the test case set quickly, critical scenarios based on graded hazard disposal model of human drivers are proposed, which can be used for extraction of test cases for safety performance. Based on the natural driving data in China Field Operational Test (China-FOT), the four-stage collision avoidance process of human drivers is obtained, including steady driving stage, risk judgment stage, collision reaction stage and collision avoidance stage. And there are two human driver states: general state and alert state. Then the graded hazard disposal model of human drivers is constructed.

Fuel cells’ soft output characteristics and mismatched voltage levels with subordinate electrical devices necessitate the use of DC/DC converters, which are an important part of the power electronic subsystem of the fuel cell system. The staggered parallel Boost topology is commonly employed in fuel cell DC/DC converters. This paper focuses on the control characteristics of the two-phase interleaved parallel Boost topology in the context of a fuel cell system. Specifically, we derive the small-signal model and output-control transfer function of the topology, and design a controller based on frequency characteristic analysis. Our proposed controller uses a cascaded double-ring structure and supports both constant current and constant voltage switching modes. To evaluate the effectiveness of our proposed control strategy, we conduct simulation and prototype testing.

The driver monitoring system (DMS) plays an essential role in reducing traffic accidents caused by human errors due to driver distraction and fatigue. The vision-based DMS has been the most widely used because of its advantages of non-contact and high recognition accuracy. However, the traditional RGB camera-based DMS has poor recognition accuracy under complex lighting conditions, while the IR-based DMS has a high cost. In order to improve the recognition accuracy of conventional RGB camera-based DMS under complicated illumination conditions, this paper proposes a lightweight low-illumination image enhancement network inspired by the Retinex theory. The lightweight aspect of the network structure is realized by introducing a pixel-wise adjustment function. In addition, the optimization bottleneck problem is solved by introducing the shortcut mechanism.

To improve the maneuverability and energy consumption of an electrical vehicle, a two-level speed control method based on model predictive control (MPC) is proposed for accurate control of the vehicle during downhill coasting. The targeted acceleration is planned using the anti-interference speed filter and MPC algorithm in the upper-level controller and executed using the integrated algorithm with the inverse vehicle dynamics and proportional-integral-derivative control model (PID) in the lower-level controller, improving the algorithm’s anti-interference performance and road adaptability. Simulations and vehicle road tests showed that the proposed method could realize accurate real-time speed control of the vehicle during downhill coasting. It can also achieve a smaller derivation between the actual and targeted speeds, as well as more stable speeds when the road resistance changes abruptly, compared with the conventional PID method.

Harmony-with-traffic refers to the ability of autonomous vehicles to maximize the driving benefits such as comfort, efficiency, and energy consumption of themselves and the surrounding traffic during interactive driving under traffic rules. In the test of harmony-with-traffic, one or more background vehicles that can respond to the driving behavior of the vehicle under test are required. For this purpose, the functional requirements of car-following model for harmony-with-traffic evaluation are analyzed from the dimensions of test conditions, constraints, steady state and dynamic response. Based on them, an interactive car-following model (ICFM) is developed. In this model, the concept of equivalent distance is proposed to transfer lateral influence to longitudinal. The calculation methods of expected speed are designed according to the different car-following modes divided by interaction object, reaction distance and equivalent distance.

The research and development of data-driven highly automated driving system components such as trajectory prediction, motion planning, driving test scenario generation, and safety validation all require large amounts of naturalistic vehicle trajectory data. Therefore, a variety of data collection methods have emerged to meet the growing demand. Among these, camera-equipped drones are gaining more and more attention because of their obvious advantages. Specifically, compared to others, drones have a wider field of bird's eye view, which is less likely to be blocked, and they could collect more complete and natural vehicle trajectory data. Besides, they are not easily observed by traffic participants and ensure that the human driver behavior data collected is realistic and natural. In this paper, we present a complete vehicle trajectory data extraction framework based on aerial videos. It consists of three parts: 1) objects detection, 2) data association, and 3) data cleaning.

Low-frequency vibration caused by road roughness while driving is transmitted to the human body through tires, suspension, and seats. Prolonged exposure of the human body to the vibratory environment will have an impact on ride comfort or even health issues. In order to investigate the vibration response of various segments of occupants while driving, a 15-DOF multi-body dynamic model depicting the shanks with feet, thighs, pelvis, torso with arms, and the head of occupants is established in the two-dimensional sagittal plane, which considers the contact between the occupant and the cushion, backrest headrest, and the vehicle floor simultaneously. The biodynamic parameters are obtained by fitting the published vibration experimental data based on an optimization algorithm. The previously proposed half-car model is incorporated into the human model to construct an integrated vehicle-human model for further ride comfort analysis.

Multiple object detection and tracking are central aspects of modeling the environment of autonomous vehicles. Lidar is a necessary component in the autonomous driving system. Without Lidar sensors, we will most probably not see fully self-driving cars become a reality. Lidar sensing gives us high-resolution data by sending out thousands of laser signals. In advanced driver assistance systems or automated driving systems, 3-D point clouds from lidar scans are typically used to measure physical surfaces. Lidar is a powerful sensor that you can use in challenging environments where other sensors might prove inadequate. Lidar can provide a complete 360-degree view of a scene. This paper designs Lidar based multi-target detection and tracking system based on the traditional point cloud processing method including down-sampling, denoising, segmentation, and clustering objects.

With the widespread application of autonomous driving technology, occupant comfort has become a key topic. Occupant comfort of autonomous vehicles depends on the driving system’s performance, so studying the causes of occupant discomfort will help design driving systems. In addition to the discomfort in NVH and thermal comfort, occupant comfort is also affected by other factors such as safety perception. To study the impact of safety perception on comfort, this paper designed a road experiment and focused on the overtaking scenarios. Because the interaction between the ego vehicle and others is strong during overtaking, the occupants are more likely to receive visual stimuli, resulting in discomfort caused by safety perception. In the experiment, occupant discomfort scores were collected in real-time by the tool developed in this paper.

A formal gesture recognition based on optics has limitations, but millimeter-wave (MMW) radar has shown significant advantages in gesture recognition. Therefore, the MMW radar has become the most promising human-computer interaction equipment, which can be used for human-computer interaction of vehicle personnel. This paper proposes a multi-branch network based on a residual neural network (ResNet) to solve the problems of insufficient feature extraction and fusion of the MMW radar and immense algorithm complexity. By constructing the gesture sample library of six gestures, the MMW radar signal is processed and coupled to establish the relationship between the motion parameters of the distance, speed, and angle of the gesture information and time, and the depth features are extracted. Then the three depth features are fused. Finally, the classification and recognition of MMW radar gesture signals are realized through the full connection layer.

Recent researches in autonomous driving mainly consider the uncertainty in perception and prediction modules for safety enhancement. However, obstacles which block the field-of-view (FOV) of sensors could generate blind areas and leaves environmental uncertainty a remaining challenge for autonomous vehicles. Current solutions mainly rely on passive obstacles avoidance in path planning instead of active perception to deal with unexplored high-risky areas. In view of the problem, this paper introduces the concept of information entropy, which quantifies uncertain information in the blind area, into the motion planning module of autonomous vehicles. Based on model predictive control (MPC) scheme, the proposed algorithm can plan collision-free trajectories while actively explore unknown areas to minimize environmental uncertainty. Simulation results under various challenging scenarios demonstrate the improvement in safety and comfort with the proposed perception-aware planning scheme.