Search Results

In this paper, we present an end-to-end real-time detection and collision avoidance framework in an autonomous vehicle using a monocular RGB camera. The proposed system is able to run on embedded hardware in the vehicle to perform real-time detection of small objects. RetinaNet architecture with ResNet50 backbone is used to develop the object detection model using RGB images. A quantized version of the object detection inference model is implemented in the vehicle using NVIDIA Jetson AGX Xavier. A geometric method is used to estimate the distance to the detected object which is forwarded to a MicroAutoBox device that implements the control system of the vehicle and is responsible for maneuvering around the detected objects. The pipeline is implemented on a passenger vehicle and demonstrated in challenging conditions using different obstacles on a predefined set of waypoints.