Search Results

The utilization of the SLAM (Simultaneous Localization and Mapping) technique was extended from the robotics to the autonomous vehicles for achieving the positioning. However, SLAM cannot obtain the global position of the vehicle but a relative one to the start. For sake of this, a fast and accurate system was proposed to obtain both the local position and the global position of vehicles based on mono-SLAM which realized the SLAM by using monocular camera with a lower cost and power consumption. Firstly, the rough latitude and longitude of current position was obtained by using common GPS without differential signal. Then, the Mono-SLAM operated on the consecutive video frames to generate the localization and local trajectory and its accuracy was further improved by utilizing the IMU information. After that, a piece of Map centered in the rough position obtained by common GPS was downloaded from the Open Street Map.

Target detection is essential to the advanced driving assistance system (ADAS) and automatic driving. And the data fusion of millimeter wave radar and camera could provide more accurate and complete information of targets and enhance the environmental perception performance. In this paper, a method of vehicle and pedestrian detection based on the data fusion of millimeter wave radar and camera is proposed to improve the target distance estimation accuracy. The first step is the targets data acquisition. A deep learning model called Single Shot MultiBox Detector (SSD) is utilized for targets detection in consecutive video frames captured by camera and further optimized for high real-time performance and accuracy. Secondly, the coordinate system of camera and radar are unified by coordinate transformation matrix. Then, the parallel Kalman filter is used to track the targets detected by radar and camera respectively.

Real-time and reliable perception of the surrounding environment is an important prerequisite for advanced driving assistance system (ADAS) and automatic driving. And vision-based detection plays a significant role in environment perception for automatic vehicles. Although deep convolutional neural networks enable efficient recognition of various objects, it has difficulty in accurately detecting special vehicles, rocks, road pile, construction site, fence and so on. In this work, we address the task of traffic scene understanding with semantic image segmentation. Both driveable area and the classification of object can be attained from the segmentation result. First, we define 29 classes of objects in traffic scenarios with different labels and modify the Deeplab V2 network. Then in order to reduce the running time, MobileNet architecture is applied to generate the feature map instead of the original models.