Search Results

Speech enhancement can extract clean speech from noise interference, enhancing its perceptual quality and intelligibility. This technology has significant applications in in-car intelligent voice interaction. However, the complex noise environment inside the vehicle, especially the human voice interference is very prominent, which brings great challenges to the vehicle speech interaction system. In this paper, we propose a speech enhancement method based on target speech features, which can better extract clean speech and improve the perceptual quality and intelligibility of enhanced speech in the environment of human noise interference. To this end, we propose a design method for the middle layer of the U-Net architecture based on Long Short-Term Memory (LSTM), which can automatically extract the target speech features that are highly distinguishable from the noise signal and human voice interference features in noisy speech, and realize the targeted extraction of clean speech.

The on-ramp merging driving scenario is challenging for achieving the highest-level autonomous driving. Current research using reinforcement learning methods to address the on-ramp merging problem of automated vehicles (AVs) is mainly designed for a single AV, treating other vehicles as part of the environment. This paper proposes a control framework for cooperative on-ramp merging of multiple AVs based on multi-agent deep reinforcement learning (MADRL). This framework facilitates AVs on the ramp and adjacent mainline to learn a coordinate control policy for their longitudinal and lateral motions based on the environment observations. Unlike the hierarchical architecture, this paper integrates decision and control into a unified optimal control problem to solve an on-ramp merging strategy through MADRL.

This paper presents an integrated modeling approach for real-time discretionary lane-changing decisions by autonomous vehicles, aiming to achieve human-like behavior. The approach incorporates a two-player normal-form game and a novel risk field method. The normal-form game represents the strategic interactions among traffic participants. It captures the trade-offs between lane-changing benefits and risks based on vehicle motion states during a lane change. By continuously determining the Nash equilibrium of the game at each time step, the model decides when it is appropriate to change the lane. A novel risk field method is integrated with the game to model risks in the game pay-offs. The risk field introduces regions along the desired target lane with different time headway ranges and risk weights, capturing traffic participants' complex risk perceptions and considerations in lane-changing scenarios.

Lane change obstacle avoidance is a common driving scenario for autonomous vehicles. However, existing methods for lane change obstacle avoidance in vehicles decouple path and velocity planning, neglecting the coupling relationship between the path and velocity. Additionally, these methods often do not sufficiently consider the lane change behaviors characteristic of human drivers. In response to these challenges, this paper innovatively applies the Dynamic Movement Primitives (DMPs) algorithm to vehicle trajectory planning and proposes a real-time trajectory planning method that integrates DMPs and Artificial Potential Fields (APFs) algorithm (DMP-Fs) for lane change obstacle avoidance, enabling rapid coordinated planning of both path and velocity. The DMPs algorithm is based on the lane change trajectories of human drivers. Therefore, this paper first collected lane change trajectory samples from on-road vehicle experiments.

In the field of vehicle aerodynamic simulation, Reynold Averaged Navier-Stokes (RANS) model is widely used due to its high efficiency. However, it has some limitations in capturing complex flow features and simulating large separated flows. In order to improve the computational accuracy within a suitable cost, the Field Inversion and Machine Learning (FIML) method, based on a data-driven approach, has received increasing attention in recent years. In this paper, the optimal coefficients of the Generalized k-ω (GEKO) model are firstly obtained by the discrete adjoint method of FIML, utilizing the results of wind tunnel experiments. Then, the mapping relationship between the flow field characteristics and the optimal coefficients is established by a neural network to augment the turbulence model.

Recently, several datasets have become available for occupant monitoring algorithm development, including real and synthetic datasets. However, real data acquisition is expensive and labeling is complex, while virtual data may not accurately reflect actual human physiology. To address these issues and obtain high-fidelity data for training intelligent driving monitoring systems, we have constructed a hybrid dataset that combines real driving image data with corresponding virtual data generated from 3D driving scenarios. We have also taken into account individual anthropometric measures and driving postures. Our approach not only greatly enriches the dataset by using virtual data to augment the sample size, but it also saves the need for extensive annotation efforts. Besides, we can enhance the authenticity of the virtual data by applying ergonomics techniques based on RAMSIS, which is crucial in dataset construction.

This paper focuses on lane-changing trajectory planning and trajectory tracking control in autonomous vehicle technology. Aiming at the lane-changing behavior of autonomous vehicles, this paper proposes a new lane-changing trajectory planning method based on particle swarm optimization (PSO) improved third-order Bezier curve path planning and polynomial curve speed planning. The position of Bezier curve control points is optimized by the particle swarm optimization algorithm, and the lane-changing trajectory is optimized to improve the comfort of lane changing process. Under the constraints of no-collision and vehicle dynamics, the proposed method can ensure that the optimal lane-changing trajectory can be found in different lane-changing scenarios. To verify the feasibility of the above planning algorithm, this paper designs the lateral and longitudinal controllers for trajectory tracking control based on the vehicle dynamic tracking error model.

In order to improve the efficiency of safety performance test for intelligent vehicles and construct the test case set quickly, critical scenarios based on graded hazard disposal model of human drivers are proposed, which can be used for extraction of test cases for safety performance. Based on the natural driving data in China Field Operational Test (China-FOT), the four-stage collision avoidance process of human drivers is obtained, including steady driving stage, risk judgment stage, collision reaction stage and collision avoidance stage. And there are two human driver states: general state and alert state. Then the graded hazard disposal model of human drivers is constructed.

Reinforcement learning is a promising approach to solve the energy management for hybrid electric vehicles. In this paper, based on the DQN (Deep Q-Network) reinforcement learning algorithm which is widely used at present, double DQN, dueling DQN and learning from demonstration are integrated; states, actions, rewards and the experience pool based on the characteristics of series-parallel multi-speed hybrid powertrain are designed; the hybrid energy management strategy based on D4QN (Double Dueling Deep Q-Network with Demonstrations) algorithm is established. Based on the training results of D4QN algorithm, multi-parameter analysis under state and action space, HCU (Hybrid control unit) application and MIL (Model in-loop) test research are conducted.

The driver monitoring system (DMS) plays an essential role in reducing traffic accidents caused by human errors due to driver distraction and fatigue. The vision-based DMS has been the most widely used because of its advantages of non-contact and high recognition accuracy. However, the traditional RGB camera-based DMS has poor recognition accuracy under complex lighting conditions, while the IR-based DMS has a high cost. In order to improve the recognition accuracy of conventional RGB camera-based DMS under complicated illumination conditions, this paper proposes a lightweight low-illumination image enhancement network inspired by the Retinex theory. The lightweight aspect of the network structure is realized by introducing a pixel-wise adjustment function. In addition, the optimization bottleneck problem is solved by introducing the shortcut mechanism.

To improve the maneuverability and energy consumption of an electrical vehicle, a two-level speed control method based on model predictive control (MPC) is proposed for accurate control of the vehicle during downhill coasting. The targeted acceleration is planned using the anti-interference speed filter and MPC algorithm in the upper-level controller and executed using the integrated algorithm with the inverse vehicle dynamics and proportional-integral-derivative control model (PID) in the lower-level controller, improving the algorithm’s anti-interference performance and road adaptability. Simulations and vehicle road tests showed that the proposed method could realize accurate real-time speed control of the vehicle during downhill coasting. It can also achieve a smaller derivation between the actual and targeted speeds, as well as more stable speeds when the road resistance changes abruptly, compared with the conventional PID method.

Harmony-with-traffic refers to the ability of autonomous vehicles to maximize the driving benefits such as comfort, efficiency, and energy consumption of themselves and the surrounding traffic during interactive driving under traffic rules. In the test of harmony-with-traffic, one or more background vehicles that can respond to the driving behavior of the vehicle under test are required. For this purpose, the functional requirements of car-following model for harmony-with-traffic evaluation are analyzed from the dimensions of test conditions, constraints, steady state and dynamic response. Based on them, an interactive car-following model (ICFM) is developed. In this model, the concept of equivalent distance is proposed to transfer lateral influence to longitudinal. The calculation methods of expected speed are designed according to the different car-following modes divided by interaction object, reaction distance and equivalent distance.

The intersection is recognized as the most dangerous area because of the restricted road structures and indeterminate traffic regulations. Therefore, according to the Vehicle-to-everything (V2X) communication, Intelligent Transportation Systems (ITS), and Digital Twin data, we present a potential energy field method to establish the general characteristics of intersection traffic safety, evaluate the safety situation of intersection and assist intersection traffic participants in passing through the intersection safer and more efficient. The resulting potential energy field method is established by the contour line of traffic participants' potential energy, which is constructed as a superposition of disparate energies, such as boundary potential energy, body potential energy, and velocity potential energy. The intersection traffic safety is evaluated by the potential energy field characteristic of simultaneous intersection traffic participants.

With the popularity of automated vehicles, the future mixed traffic flow contains automated vehicles with different degrees of intelligence developed by other manufacturers. Therefore, simulating the interaction behavior of automated vehicles with varying levels of intelligence is crucial for testing and evaluating autonomous driving systems. Since the algorithm of traffic vehicles with various intelligence levels is difficult to obtain, it leads to hardships in quantitatively characterizing their interaction behaviors. Therefore, this paper designs a new automated vehicle test platform to solve the problem. The intelligent vehicle testbed with multiple personalized in-vehicle control units in the loop consists of three parts: 1. Multiple controllers in the loop to simulate the behavior of traffic vehicles；2. The central console applies digital twin technology to share the same traffic scenario between the tested vehicle and the traffic vehicle, creating a mixed traffic flow. 3.

High-speed vehicles in low illumination environments severely blur the images used in object detectors, which poses a potential threat to object detector-based advanced driver assistance systems (ADAS) and autonomous driving systems. Augmenting the training images for object detectors is an efficient way to mitigate the threat from motion blur. However, little attention has been paid to the motion of the vehicle and the position of objects in the traffic scene, which limits the consistence between the resulting augmented images and traffic scenes. In this paper, we present a vehicle kinematics-based image augmentation algorithm by modeling and analyzing the traffic scenes to generate more realistic augmented images and achieve higher robustness improvement on object detectors against motion blur. Firstly, we propose a traffic scene model considering vehicle motion and the relationship between the vehicle and the object in the traffic scene.

The research and development of data-driven highly automated driving system components such as trajectory prediction, motion planning, driving test scenario generation, and safety validation all require large amounts of naturalistic vehicle trajectory data. Therefore, a variety of data collection methods have emerged to meet the growing demand. Among these, camera-equipped drones are gaining more and more attention because of their obvious advantages. Specifically, compared to others, drones have a wider field of bird's eye view, which is less likely to be blocked, and they could collect more complete and natural vehicle trajectory data. Besides, they are not easily observed by traffic participants and ensure that the human driver behavior data collected is realistic and natural. In this paper, we present a complete vehicle trajectory data extraction framework based on aerial videos. It consists of three parts: 1) objects detection, 2) data association, and 3) data cleaning.

Low-frequency vibration caused by road roughness while driving is transmitted to the human body through tires, suspension, and seats. Prolonged exposure of the human body to the vibratory environment will have an impact on ride comfort or even health issues. In order to investigate the vibration response of various segments of occupants while driving, a 15-DOF multi-body dynamic model depicting the shanks with feet, thighs, pelvis, torso with arms, and the head of occupants is established in the two-dimensional sagittal plane, which considers the contact between the occupant and the cushion, backrest headrest, and the vehicle floor simultaneously. The biodynamic parameters are obtained by fitting the published vibration experimental data based on an optimization algorithm. The previously proposed half-car model is incorporated into the human model to construct an integrated vehicle-human model for further ride comfort analysis.

With the widespread application of autonomous driving technology, occupant comfort has become a key topic. Occupant comfort of autonomous vehicles depends on the driving system’s performance, so studying the causes of occupant discomfort will help design driving systems. In addition to the discomfort in NVH and thermal comfort, occupant comfort is also affected by other factors such as safety perception. To study the impact of safety perception on comfort, this paper designed a road experiment and focused on the overtaking scenarios. Because the interaction between the ego vehicle and others is strong during overtaking, the occupants are more likely to receive visual stimuli, resulting in discomfort caused by safety perception. In the experiment, occupant discomfort scores were collected in real-time by the tool developed in this paper.

A formal gesture recognition based on optics has limitations, but millimeter-wave (MMW) radar has shown significant advantages in gesture recognition. Therefore, the MMW radar has become the most promising human-computer interaction equipment, which can be used for human-computer interaction of vehicle personnel. This paper proposes a multi-branch network based on a residual neural network (ResNet) to solve the problems of insufficient feature extraction and fusion of the MMW radar and immense algorithm complexity. By constructing the gesture sample library of six gestures, the MMW radar signal is processed and coupled to establish the relationship between the motion parameters of the distance, speed, and angle of the gesture information and time, and the depth features are extracted. Then the three depth features are fused. Finally, the classification and recognition of MMW radar gesture signals are realized through the full connection layer.

Recent researches in autonomous driving mainly consider the uncertainty in perception and prediction modules for safety enhancement. However, obstacles which block the field-of-view (FOV) of sensors could generate blind areas and leaves environmental uncertainty a remaining challenge for autonomous vehicles. Current solutions mainly rely on passive obstacles avoidance in path planning instead of active perception to deal with unexplored high-risky areas. In view of the problem, this paper introduces the concept of information entropy, which quantifies uncertain information in the blind area, into the motion planning module of autonomous vehicles. Based on model predictive control (MPC) scheme, the proposed algorithm can plan collision-free trajectories while actively explore unknown areas to minimize environmental uncertainty. Simulation results under various challenging scenarios demonstrate the improvement in safety and comfort with the proposed perception-aware planning scheme.