Search Results

This work presents a method to estimate the human body orientation using 2D images from a person view; the challenge comes from the variety of human body poses and appearances. The method utilizes OpenPose neural network as a human pose detector module and depth sensing module. The modules work together to extract the body orientation from 2D stereo images. OpenPose is proven to be efficient in detecting human body joints, defined by COCO dataset, OpenPose can detect the visible body joints without being affected by backgrounds or other challenging factors. Adding the depth data for each point can produce rich information to the process of 3D construction for the detected humans. This 3D point’s setup can tell more about the body orientation and walking direction for example. The depth module used in this work is the ZED camera stereo system which uses CUDA for high performance depth computation.

This work presents a method for estimating human body orientation using a combination of convolutional neural network (CNN) and stereo camera in real time. The approach uses the CNN model to predict certain human body keypoints then transforms these points into a 3D space using the stereo vision system to estimate the body orientations. The CNN module is trained to estimate the shoulders, the neck and the nose positions, detecting of three points is required to confirm human detection and provided enough data to translate the points into 3D space.