Search Results

An existing challenge in current state-of-the-art autonomous vehicles is the process of safely transferring control from autonomous driving mode to manual mode because the driver may be distracted with secondary tasks. Such distractions may impair a driver’s situational awareness of the driving environment which will lead to fatal outcomes during a handover. Current state-of-the-art vehicles notify a user of an imminent handover via auditory, visual, and physical alerts but are unable to improve a driver’s situational awareness before a handover is executed. The overall goal of our research team is to address the challenge of providing a driver with relevant information to regain situational awareness of the driving task. In this paper, we introduce a novel approach to estimating a driver’s visual focus of attention using a 2D RGB camera as input to a Multi-Input Convolutional Neural Network with shared weights. The system was validated in a realistic driving scenario.

Current implementations of vision-based Advanced Driver Assistance Systems (ADAS) are largely dependent on real-time vehicle camera data along with other sensory data available on-board such as radar, ultrasonic, and GPS data. This data, when accurately reported and processed, helps the vehicle avoid collisions using established ADAS applications such as Forward Collision Avoidance (FCA), Autonomous Cruise Control (ACC), Pedestrian Detection, etc. Vehicle to Vehicle (V2V) and Vehicle to Infrastructure (V2I) over Dedicated Short Range Communication (DSRC) provides basic sensory data from other vehicles or roadside infrastructure including position information of surrounding traffic. Exchanging rich data such as vision data between multiple vehicles, and between vehicles and infrastructure provides a unique opportunity to advance driver assistance applications and Intelligent Transportation Systems (ITS).

Lane line detection is a very critical element for Advanced Driver Assistance Systems (ADAS). Although, there has been significant amount of research dedicated to the detection and localization of lane lines in the past decade, there is still a gap in the robustness of the implemented systems. A major challenge to the existing lane line detection algorithms stems from coping with bad weather conditions (e.g. rain, snow, fog, haze, etc.). Snow offers an especially challenging environment, where lane marks and road boundaries are completely covered by snow. In these scenarios, on-board sensors such as cameras, LiDAR, and radars are of very limited benefit. In this research, the focus is on solving the problem of improving robustness of lane line detection in adverse weather conditions, especially snow. A framework is proposed that relies on using Vehicle-to-Infrastructure (V2I) communication to access reference images stored in the cloud.

Digital Image Correlation (DIC) technology is a powerful tool in the field of experimental mechanics to obtain the full-field deformation/strain information of an object. It has been rapidly applied in industry in recent years. However, for the large-angle full-field strain measurement of small-sized cylindrical objects, it’s still a challenge to the DIC accurate measurement due to its small size and curved surface. In this paper, a measurement method based on the multi-camera DIC system is proposed to study the compressive performance of small-sized cylindrical materials. Three cameras form two stereo DIC measurement systems (1 and 2 cameras, and 2 and 3 cameras), each of which measures a part of the object. By calibrating three cameras at the same time, two stereos DIC coordinate systems can be unified to one coordinate system. Then match the two sets of DIC measurement data together to achieve large-angle measurement of the cylindrical surface.

Future fully autonomous and partially autonomous cars equipped with Advanced Driver Assistant Systems (ADAS) should assure safety for the pedestrian. One of the critical tasks is to determine if the pedestrian is crossing the road in the path of the ego-vehicle, in order to issue the required alerts for the driver or even safety breaking action. In this paper, we investigate the use of 2D pose estimators to determine the direction and speed of the pedestrian crossing the road in front of a vehicle. Pose estimation of body parts, such as right eye, left knee, right foot, etc… is used for determining the pedestrian orientation while tracking these key points between frames is used to determine the pedestrian speed. The pedestrian orientation and speed are the two required elements for the basic path estimation.

The development of efficient algorithms has been the focus of automobile engineers since self-driving cars become popular. This is due to the potential benefits we can get from self-driving cars and how they can improve safety on our roads. Despite the good promises that come with self-driving cars development, it is way behind being a perfect system because of the complexity of our environment. A self-driving car must understand its environment before it makes decisions on how to navigate, and this might be difficult because the changes in our environment is non-deterministic. With the development of computer vision, some key problems in intelligent driving have been active research areas. The advances made in the field of artificial intelligence made it possible for researchers to try solving these problems with artificial intelligence. Lane detection and tracking is one of the critical problems that need to be effectively implemented.

Vacuum suction cups are used as transforming handles in stamping lines, which are essential in developing automation and mechanization. However, the vacuum suction cup will crack due to fatigue or long-term operation or installation angle, which directly affects production productivity and safety. The better design will help increase the cups' service life. If the location of stress concentration can be predicted, this can prevent the occurrence of cracks in advance and effectively increase the service life. However, the traditional strain measurement technology cannot meet the requirements of tracking large-field stains and precise point tracking simultaneously in the same area, especially for stacking or narrow parts of the suction cups. The application must allow multiple measurements of hidden component strain information in different fields of view, which would add cost.

Digital shearography has many advantages, such as full-field, non-contact, high sensitivity, and good robustness. It was widely used to measure the deformation and strain of materials, also to the application of nondestructive testing (NDT). However, most digital sherography applications can only work in one field of view per measurement, and some small defects may not be detected as a result. Multiple measurements of different fields of view are needed to solve this issue, which will increase the measurement time and cost. The difficulty in performing multiple measurements may also increase for cases where the loading is not repeatable. Therefore, a system capable of measuring dual fields of view at the same time is necessary. The carrier frequency spatial phase shift method may be a good candidate to reach this goal because it can simultaneously record phase information of multiple images, e.g. two speckle interferograms with different fields of view.

In the dense fabric of urban areas, electric scooters have rapidly become a preferred mode of transportation. As they cater to modern mobility demands, they present significant safety challenges, especially when interacting with pedestrians. In general, e-scooters are suggested to be ridden in bike lanes/sidewalks or share the road with cars at the maximum speed of about 15-20 mph, which is more flexible and much faster than pedestrians and bicyclists. Accurate prediction of pedestrian movement, coupled with assistant motion control of scooters, is essential in minimizing collision risks and seamlessly integrating scooters in areas dense with pedestrians. Addressing these safety concerns, our research introduces a novel e-Scooter collision avoidance system (eCAS) with a method for predicting pedestrian trajectories, employing an advanced Long short-term memory (LSTM) network integrated with a state refinement module.