Search Results

The around view monitor (AVM) system for vehicles usually suffers from the distortion of surrounding objects caused by incomplete rectification and stitching, which seriously affects the driver's judgment of the surrounding environment during the reversing process. In response to solve this problem, an augmented around view monitor (AAVM) system fusing image and depth information is proposed, which highlights the point clouds of persons or vehicles at the rear of the vehicle. First, an around view image is generated from four fisheye cameras. Then, the calibration of multi TOF cameras is conducted to improve their accuracy of depth estimation and obtain extrinsic camera positions. Next, the 2D-driven object point cloud detection method is proposed to localize and segment object point clouds like vehicles or persons.

The around view monitor (AVM) system for the long-body road vehicle with multiple articulated carriages usually suffers from the incomplete distortion rectification of fisheye cameras and the irregular image stitching area caused by the change of relative position of the cameras on different carriages while the vehicle is in motion. In response to these problems, a set of calibration and stitching methods of AVM are proposed. First, a radial-distortion-based rectification method is adopted and improved. This method establishes two lost functions and solves the model parameters with the two-step optimization method. Then, AVM system calibration is conducted, and the perspective transformation matrix is calculated. After that, a static basic look-up table is generated based on the distortion rectification model and perspective transformation matrix.

As one of the most challenging driving tasks, parking is a common but particularly troublesome problem in large cities. Recently, an excellent solution-automated valet parking (AVP) has become a hot research topic, which allows the driver to leave the vehicle in a drop-off area, while the vehicle driving into the parking slot by itself. For AVP, the precise localization is an indispensable module. However, the global positioning system (GPS) cannot be used in the underground parking lot and the localization method based on lidar is too expensive. In response to solve this problem, we propose a simultaneous localization and mapping system with the semantic information of parking slots (PS-SLAM), which is based on visual-inertial and around view images. First, the calibration of multi-sensors is conducted to obtain their intrinsic and extrinsic parameters. In this way, the around view image and transformation matrices between sensors can be acquired.