Search Results

This work presents a method for estimating human body orientation using a combination of convolutional neural network (CNN) and stereo camera in real time. The approach uses the CNN model to predict certain human body keypoints then transforms these points into a 3D space using the stereo vision system to estimate the body orientations. The CNN module is trained to estimate the shoulders, the neck and the nose positions, detecting of three points is required to confirm human detection and provided enough data to translate the points into 3D space.

This work presents a method to estimate the human body orientation using 2D images from a person view; the challenge comes from the variety of human body poses and appearances. The method utilizes OpenPose neural network as a human pose detector module and depth sensing module. The modules work together to extract the body orientation from 2D stereo images. OpenPose is proven to be efficient in detecting human body joints, defined by COCO dataset, OpenPose can detect the visible body joints without being affected by backgrounds or other challenging factors. Adding the depth data for each point can produce rich information to the process of 3D construction for the detected humans. This 3D point’s setup can tell more about the body orientation and walking direction for example. The depth module used in this work is the ZED camera stereo system which uses CUDA for high performance depth computation.

Future fully autonomous and partially autonomous cars equipped with Advanced Driver Assistant Systems (ADAS) should assure safety for the pedestrian. One of the critical tasks is to determine if the pedestrian is crossing the road in the path of the ego-vehicle, in order to issue the required alerts for the driver or even safety breaking action. In this paper, we investigate the use of 2D pose estimators to determine the direction and speed of the pedestrian crossing the road in front of a vehicle. Pose estimation of body parts, such as right eye, left knee, right foot, etc… is used for determining the pedestrian orientation while tracking these key points between frames is used to determine the pedestrian speed. The pedestrian orientation and speed are the two required elements for the basic path estimation.