Search Results

Roundabouts are one of the most complex traffic environments in urban roads, and a key challenge for intelligent driving decision-making. Deep reinforcement learning, as an emerging solution for intelligent driving decisions, has the advantage of avoiding complex algorithm design and sustainable iteration. For the decision difficulty in roundabout scenarios, this paper proposes an artificial potential field based Soft Actor-Critic (APF-SAC) algorithm. Firstly, based on the Carla simulator and Gym framework, a reinforcement learning simulation system for roundabout driving is built. Secondly, to reduce reinforcement learning exploration difficulty, global path planning and path smoothing algorithms are designed to generate and optimize the path to guide the agent.

Autonomous driving in real-world urban traffic must cope with dynamic environments. This presents a challenging decision-making problem, e.g. deciding when to perform an overtaking maneuver or how to safely merge into traffic. The traditional autonomous driving algorithm framework decouples prediction and decision-making, which means that the decision-making and planning tasks will be carried out after the prediction task is over. The disadvantage of this approach is that it does not consider the possible impact of ego vehicle decisions on the future states of other agents. In this article, a decision-making and planning method which considers longitudinal interaction is represented. The method’s architecture is mainly composed of the following parts: trajectory sampling, forward simulation, trajectory scoring and trajectory selection. For trajectory sampling, a lattice planner is used to sample three-dimensionally in both the time horizon and the space horizon.