SLAM (Simultaneous Localization and Mapping) plays a key role in autonomous driving. Recently, 4D Radar has attracted widespread attention because it breaks through the limitations of 3D millimeter wave radar and can simultaneously detect the distance, velocity, horizontal azimuth and elevation azimuth of the target with high resolution. However, there are few studies on 4D Radar in SLAM. In this paper, RI-FGO, a 4D Radar-Inertial SLAM method based on Factor Graph Optimization, is proposed. The RANSAC (Random Sample Consensus) method is used to eliminate the dynamic obstacle points from a single scan, and the ego-motion velocity is estimated from the static point cloud. A 4D Radar velocity factor is constructed in GTSAM to receive the estimated velocity in a single scan as a measurement and directly integrated into the factor graph. The 4D Radar point clouds of consecutive frames are matched as the odometry factor.
The on-ramp merging driving scenario is challenging for achieving the highest-level autonomous driving. Current research using reinforcement learning methods to address the on-ramp merging problem of automated vehicles (AVs) is mainly designed for a single AV, treating other vehicles as part of the environment. This paper proposes a control framework for cooperative on-ramp merging of multiple AVs based on multi-agent deep reinforcement learning (MADRL). This framework facilitates AVs on the ramp and adjacent mainline to learn a coordinate control policy for their longitudinal and lateral motions based on the environment observations. Unlike the hierarchical architecture, this paper integrates decision and control into a unified optimal control problem to solve an on-ramp merging strategy through MADRL.
This paper presents an integrated modeling approach for real-time discretionary lane-changing decisions by autonomous vehicles, aiming to achieve human-like behavior. The approach incorporates a two-player normal-form game and a novel risk field method. The normal-form game represents the strategic interactions among traffic participants. It captures the trade-offs between lane-changing benefits and risks based on vehicle motion states during a lane change. By continuously determining the Nash equilibrium of the game at each time step, the model decides when it is appropriate to change the lane. A novel risk field method is integrated with the game to model risks in the game pay-offs. The risk field introduces regions along the desired target lane with different time headway ranges and risk weights, capturing traffic participants' complex risk perceptions and considerations in lane-changing scenarios.
Lane change obstacle avoidance is a common driving scenario for autonomous vehicles. However, existing methods for lane change obstacle avoidance in vehicles decouple path and velocity planning, neglecting the coupling relationship between the path and velocity. Additionally, these methods often do not sufficiently consider the lane change behaviors characteristic of human drivers. In response to these challenges, this paper innovatively applies the Dynamic Movement Primitives (DMPs) algorithm to vehicle trajectory planning and proposes a real-time trajectory planning method that integrates DMPs and Artificial Potential Fields (APFs) algorithm (DMP-Fs) for lane change obstacle avoidance, enabling rapid coordinated planning of both path and velocity. The DMPs algorithm is based on the lane change trajectories of human drivers. Therefore, this paper first collected lane change trajectory samples from on-road vehicle experiments.
Accurate and reliable localization in GNSS-denied environments is critical for autonomous driving. Nevertheless, LiDAR-based and camera-based methods are easily affected by adverse weather conditions such as rain, snow, and fog. The 4D Radar with all-weather performance and high resolution has attracted more interest. Currently, there are few localization algorithms based on 4D Radar, so there is an urgent need to develop reliable and accurate positioning solutions. This paper introduces RIO-Vehicle, a novel tightly coupled 4D Radar/IMU/vehicle dynamics within the factor graph framework. RIO-Vehicle aims to achieve reliable and accurate vehicle state estimation, encompassing position, velocity, and attitude. To enhance the accuracy of relative constraints, we introduce a new integrated IMU/Dynamics pre-integration model that combines a 2D vehicle dynamics model with a 3D kinematics model.
In recent years, the burgeoning applications of hydrogen fuel cells have ignited a growing trend in their integration within the transportation sector, with a particular focus on their potential use in multi-rotor drones. The heightened mass-based energy density of fuel cells positions them as promising alternatives to current lithium battery-powered drones, especially as the demand for extended flight durations increases. This article undertakes a comprehensive exploration, comparing the performance of lithium batteries against air-cooled fuel cells, specifically within the context of multi-rotor drones with a 3.5kW power requirement. The study reveals that, for the specified power demand, air-cooled fuel cells outperform lithium batteries, establishing them as a more efficient solution.
This paper focuses on lane-changing trajectory planning and trajectory tracking control in autonomous vehicle technology. Aiming at the lane-changing behavior of autonomous vehicles, this paper proposes a new lane-changing trajectory planning method based on particle swarm optimization (PSO) improved third-order Bezier curve path planning and polynomial curve speed planning. The position of Bezier curve control points is optimized by the particle swarm optimization algorithm, and the lane-changing trajectory is optimized to improve the comfort of lane changing process. Under the constraints of no-collision and vehicle dynamics, the proposed method can ensure that the optimal lane-changing trajectory can be found in different lane-changing scenarios. To verify the feasibility of the above planning algorithm, this paper designs the lateral and longitudinal controllers for trajectory tracking control based on the vehicle dynamic tracking error model.
LiDAR and camera fusion have emerged as a promising approach for improving place recognition in robotics and autonomous vehicles. However, most existing approaches often treat sensors separately, overlooking the potential benefits of correlation between them. In this paper, we propose a Cross- Modality Module (CMM) to leverage the potential correlation of LiDAR and camera features for place recognition. Besides, to fully exploit potential of each modality, we propose a Local-Global Fusion Module to supplement global coarse-grained features with local fine-grained features. The experiment results on public datasets demonstrate that our approach effectively improves the average recall by 2.3%, reaching 98.7%, compared with simply stacking of LiDAR and camera.
Radar is playing more and important role in multiple object detection and tracking system due to the fact that Radar can not only determine the velocity instantly but also it is less influenced by environment conditions. However, Radar faces the problem that it has many detection clutter,false alarms and detection results are easily affected by the reflected echoes of road boundary in traffic scenes. Besides this, With the increase of the number of targets and the number of effective echoes, the number of interconnection matrices increases exponentially in joint probability data association, which will seriously affect the real-time and accuracy of high-speed scene algorithms.in the tracking system. So, A method of using millimeter wave radar to detect and fit the boundary guardrail of high-speed road is proposed, and the fitting results are applied to the vehicle detection and tracking system to improve the tracking accuracy.
On account of the insufficient lane-changing scenario test cases and the inability to conduct graded evaluation testing in current autonomous driving system field testing, this paper proposed an approach that combined data-driven and knowledge-driven methods to extract lane-changing test concrete scenarios with graded risk levels for field testing. Firstly, an analysis of the potentially hazardous areas in lane-changing scenarios was conducted to derive key functional lane-changing scenarios. Three typical key functional lane-changing scenarios were selected, namely, lane-changing with a preceding vehicle braking, lane-changing with a preceding vehicle in the same direction, and lane-changing with a rear cruising vehicle in the adjacent lane, and their corresponding safety goals were respectively analyzed. Secondly, the GAMAB criterion was introduced as an evaluation standard for autonomous driving systems.
Positioning system is a key module of autonomous driving. As for LiDAR SLAM system, it faces great challenges in scenarios where there are repetitive and sparse features. Without loop closure or measurements from other sensors, odometry match errors or accumulated errors cannot be corrected. This paper proposes a construction method of LiDAR anchor constraints to improve the robustness of the SLAM system in the above challenging environment. We propose a robust anchor extraction method that adaptively extracts suitable cylindrical anchors in the environment, such as tree trunks, light poles, etc. Skewed tree trunks are detected by feature differences between laser lines. Boundary points on cylinders are removed to avoid misleading. After the appropriate anchors are detected, a factor graph-based anchor constraint construction method is designed. Where direct scans are made to anchor, direct constraints are constructed.
To study the cold start of muti-stack fuel cell system (MFCS), a novel thermal management subsystem structure and corresponding cold start strategies are proposed. Firstly, leveraging the distinctive configuration of the MFCS that can be sequentially initiated, we augmented the existing thermal management subsystem with the incorporation of two additional collection valves and two bypass diverter valves, which affords an increased degree of flexibility in the formulation of cold-start strategies. Secondly, we innovatively propose a hierarchical auxiliary heating cold start strategy and an average auxiliary heating cold start tailored for MFCS consisting of power levels of 20 kW, 70 kW, and 120 kW. Furthermore, we have developed a controller to address temperature control challenges during the start-up process.
With the increase of motor speed and the deterioration of operating environment, it is more difficult to predict the transient temperature field (TTF). Meanwhile, it is difficult to obtain the temperature test dataset of key nodes under various complete road conditions, so the cost of bench test or real vehicle test is high. Therefore, it is of great significance to establish a high fidelity, lightweight temperature prediction model which can be applied to real vehicle thermal management for ensuring the safe and stable operation of motor. In this paper, a physical model simulating electromagnetic-heat-flow multi-physical coupling of permanent magnet synchronous motor (PMSM) in electric drive gearbox (EDG) is established, and the correctness of the model is verified by the actual EDG bench test.
Harmony-with-traffic refers to the ability of autonomous vehicles to maximize the driving benefits such as comfort, efficiency, and energy consumption of themselves and the surrounding traffic during interactive driving under traffic rules. In the test of harmony-with-traffic, one or more background vehicles that can respond to the driving behavior of the vehicle under test are required. For this purpose, the functional requirements of car-following model for harmony-with-traffic evaluation are analyzed from the dimensions of test conditions, constraints, steady state and dynamic response. Based on them, an interactive car-following model (ICFM) is developed. In this model, the concept of equivalent distance is proposed to transfer lateral influence to longitudinal. The calculation methods of expected speed are designed according to the different car-following modes divided by interaction object, reaction distance and equivalent distance.
With the popularity of automated vehicles, the future mixed traffic flow contains automated vehicles with different degrees of intelligence developed by other manufacturers. Therefore, simulating the interaction behavior of automated vehicles with varying levels of intelligence is crucial for testing and evaluating autonomous driving systems. Since the algorithm of traffic vehicles with various intelligence levels is difficult to obtain, it leads to hardships in quantitatively characterizing their interaction behaviors. Therefore, this paper designs a new automated vehicle test platform to solve the problem. The intelligent vehicle testbed with multiple personalized in-vehicle control units in the loop consists of three parts: 1. Multiple controllers in the loop to simulate the behavior of traffic vehicles;2. The central console applies digital twin technology to share the same traffic scenario between the tested vehicle and the traffic vehicle, creating a mixed traffic flow. 3.
High-speed vehicles in low illumination environments severely blur the images used in object detectors, which poses a potential threat to object detector-based advanced driver assistance systems (ADAS) and autonomous driving systems. Augmenting the training images for object detectors is an efficient way to mitigate the threat from motion blur. However, little attention has been paid to the motion of the vehicle and the position of objects in the traffic scene, which limits the consistence between the resulting augmented images and traffic scenes. In this paper, we present a vehicle kinematics-based image augmentation algorithm by modeling and analyzing the traffic scenes to generate more realistic augmented images and achieve higher robustness improvement on object detectors against motion blur. Firstly, we propose a traffic scene model considering vehicle motion and the relationship between the vehicle and the object in the traffic scene.
Image corruptions due to noise, blur, contrast change, etc., could lead to a significant performance decline of Deep Neural Networks (DNN), which poses a potential threat to DNN-based autonomous vehicles. Previous works attempted to explain corruption from a Fourier perspective. By comparing the absolute Fourier spectrum difference between corrupted images and clean images in the RGB color space, they regard the noise from some corruptions (Gaussian noise, defocus blur, etc.) as concentrating on the high-frequency components while others (contrast, fog, etc.) concentrate on the low-frequency components. In this work, we present a new perspective that unifies corruptions as noise from high frequency and thus propose an image augmentation algorithm to achieve a more robust performance against common corruptions. First, we notice the 1/fα statistical rule of the natural image's spectrum and the channels-wise differential sensitivity on the YCbCr color space of the Human Visual System.
The research and development of data-driven highly automated driving system components such as trajectory prediction, motion planning, driving test scenario generation, and safety validation all require large amounts of naturalistic vehicle trajectory data. Therefore, a variety of data collection methods have emerged to meet the growing demand. Among these, camera-equipped drones are gaining more and more attention because of their obvious advantages. Specifically, compared to others, drones have a wider field of bird's eye view, which is less likely to be blocked, and they could collect more complete and natural vehicle trajectory data. Besides, they are not easily observed by traffic participants and ensure that the human driver behavior data collected is realistic and natural. In this paper, we present a complete vehicle trajectory data extraction framework based on aerial videos. It consists of three parts: 1) objects detection, 2) data association, and 3) data cleaning.
Autonomous driving related technologies have become a hot topic in academia and industry. Planning control is one of the core technologies of autonomous driving, which is conducive to vehicles safe and efficient driving. This paper proposes a novel optimal speed control algorithm, which considers the power system's energy consumption, the speed limit on the road, and the safe distance of the vehicle in front. An optimal speed control model of “From battery to wheel” energy consumption is established by constructing a performance index function based on the best-fitting formula of motor power, motor speed and torque. Based on the optimal control principle, the fourth-order ordinary differential equation of the speed control model is established, based on the indirect adjoining approach, the speed control model under the restriction of the road speed limit and safe distance of the preceding vehicle is derived and the analytical expression is obtained.