Search Results

The main challenge for future autonomous vehicles is to identify their location and body pose in real time during driving, that is, “where am I? and how will I go?”. We address the problems of pose estimation and scene perception from continuous visual frames in intelligent vehicle. Recent advanced technology in the domain of deep learning proposes to train some learning models for vehicle’s series detection tasks in a supervised or unsupervised manner, which has numerous advances over traditional approaches, mainly reflected in the absence of manual calibration and synchronization of the camera and IMU. In the paper, we propose a novel approach for pose estimation and scene recognition with a deep fusion of multi-modal neural features in the manner of unsupervised. Firstly, low-cost camera and IMU are used to extract original visual and inertial data, then the visual and inertial encoders are utilized to encoder the feature of the two modes.