Search Results

In the United States and worldwide, 38,824 and 1.35 million people were killed in vehicle crashes during 2020. These statistics are tragic and indicative of an on-going public health crisis centered on automobiles and other ground transportation solutions. Although the long-term US vehicle fatality rate is slowly declining, it continues to be elevated compared to European countries. The introduction of vehicle safety systems and re-designed roadways has improved survivability and driving environment, but driver behavior has not been fully addressed. A non-confrontational approach is the evaluation of driver behavior using onboard sensors and computer algorithms to determine the vehicle’s “mistrust” level of the given operator and the safety of the individual operating the vehicle. This is an inversion of the classic human-machine trust paradigm in which the human evaluates whether the machine can safely operate in an automated fashion.

Since 1989, ISO has published procedures for developing and testing public information symbols (ISO 9186), while the SAE standard for in-vehicle icon comprehension testing (SAE J2830) was first published in 2008. Neither testing method was designed to evaluate the comprehension of symbols in modern vehicles that offer digital instrument cluster interfaces that afford new levels of flexibility to further improve drivers’ understanding of symbols. Using a driving simulator equipped with an eye tracker, this study investigated drivers’ understanding of six automotive symbols presented on in-vehicle displays. Participants included 24 teens, 24 adults, and 24 senior drivers. Symbols were presented in a symbol-only, symbol + short text descriptions, and symbol + long text description conditions. Participants’ symbol comprehension, driving performance, reaction times, and eye glance times were measured.

Passenger comfort is a critical factor in user acceptance of autonomous vehicles (AVs). Despite existing methods for passenger comfort assessment, new approaches to assessing passenger comfort in AVs may be valuable to the automotive industry. In this paper, continuous pressing-based and discrete smartphone-based approaches for comfort assessment were designed and implemented in a user study. Participants used the two approaches to evaluate their comfort levels in an experimental study based on a high-fidelity autonomous driving simulator. Performances of the two approaches in assessing comfort levels were analyzed and compared. In general, the discrete approach showed better measurement repeatability and lower measurement bias than the continuous approach. The performance gap of the continuous approach could be reduced with proper post-processing measures. Discussions on the potential uses of the approaches were also raised.

Autonomous vehicles have the potential to transform lives by providing transportation to a wider range of users. However, with this new method of transportation, user acceptance and comfort are critical for widespread adoption. This exploratory study aims to investigate what makes passengers uncomfortable in existing vehicles to inform the design of future autonomous vehicles. In order to predict what may impact user acceptance for a diverse rider population for future autonomous vehicles, it is important to understand what makes a broad range of passengers uncomfortable today. In this study, interviews were conducted for a total of 75 participants from three diverse groups, including 20 automotive engineering graduate students who are building an autonomous concept vehicle, 21 non-technical adults, and 34 senior citizens. The results revealed both topics which made different groups of passengers uncomfortable as well as how these varied between the groups.

In this paper, a reinforcement learning-based method is proposed to adapt autonomous vehicle passengers’ expectation of comfort through in-situ human-vehicle interaction. Ride comfort has a significant influence on the user’s experience and thus acceptance of autonomous vehicles. There is plenty of research about the motion planning and control of autonomous vehicles. However, limited studies have explicitly considered the comfort of passengers in autonomous vehicles. This paper studies the comfort of humans in autonomous vehicles longitudinal autonomous driving. The paper models and then improves passengers’ feelings about autonomous driving behaviors. This proposed approach builds a control and adaptation strategy based on reinforcement learning using human’s in-situ feedback on autonomous driving. It also proposes an adaptation of humans to autonomous vehicles to account for improper human driving expectations.

Driving inattention caused by drowsiness has been a significant reason for vehicle crash accidents, and there is a critical need to augment driving safety by monitoring driver drowsiness behaviors. For real-time drowsy driving awareness, we propose a vision-based driver drowsiness monitoring system (DDMS) for driver drowsiness behavior recognition and analysis. First, an infrared camera is deployed in-vehicle to capture the driver’s facial and head information in naturalistic driving scenarios, in which the driver may or may not wear glasses or sunglasses. Second, we propose and design a multi-modal features representation approach based on facial landmarks, and head pose which is retrieved in a convolutional neural network (CNN) regression model. Finally, an extreme learning machine (ELM) model is proposed to fuse the facial landmark, recognition model and pose orientation for drowsiness detection. The DDMS gives promptly warning to the driver once a drowsiness event is detected.

Collaborative robots are more and more used in smart manufacturing because of their capability to work beside and collaborate with human workers. With the deployment of these robots, manufacturing tasks are more inclined to be accomplished by multiple humans and multiple robots (MH-MR) through teaming effort. In such MH-MR collaboration scenarios, the task distribution among the multiple humans and multiple robots is very critical to efficiency. It is also more challenging due to the heterogeneity of different agents. Existing approaches in task distribution among multiple agents mostly consider humans with assumed or known capabilities. However human capabilities are always changing due to various factors, which may lead to suboptimal efficiency. Although some researches have studied several human factors in manufacturing and applied them to adjust the robot task and behaviors.

Modern turbocharged spark-ignition engines are being equipped with an increasing number of control actuators to meet fuel economy, emissions, and performance targets. The response time variations between engine control actuators tend to be significant during transients and necessitate highly complex actuator scheduling routines. Model Predictive Control (MPC) has the potential to significantly reduce control calibration effort as compared to the current methodologies that are based on decentralized feedback control strategies. MPC strategies simultaneously generate all actuator responses by using a combination of current engine conditions and optimization of a control-oriented plant model. To achieve real-time control, the engine model and optimization processes must be computationally efficient without sacrificing effectiveness. Most MPC systems intended for real-time control utilize a linearized model that can be quickly evaluated using a sub-optimal optimization methodology.

The deployment of autonomous vehicles in real-world scenarios requires thorough testing to ensure sufficient safety levels. Driving simulators have proven to be useful testbeds for assisted and autonomous driving functionalities but may fail to capture all the nuances of real-world conditions. In this paper, we present a snapshot of the design and evaluation using a Cooperative Adaptive Cruise Control application of virtual reality platform currently in development at our institution. The platform is designed so to: allow for incorporating live real-world driving data into the simulation, enabling Vehicle-in-the-Loop testing of autonomous driving behaviors and providing us with a useful mean to evaluate the human factor in the autonomous vehicle context.

Automotive drive-by-wire systems have enabled greater mobility options for individuals with physical disabilities. To further expand the driving paradigm, a need exists to consider an alternative vehicle steering mechanism to meet specific needs and constraints. In this study, a cellphone steering controller was investigated using a fixed-base driving simulator. The cellphone incorporated the direction control of the vehicle through roll motion, as well as the brake and throttle functionality through pitch motion, a design that can assist disabled drivers by excluding extensive arm and leg movements. Human test subjects evaluated the cellphone with conventional vehicle control strategy through a series of roadway maneuvers. Specifically, two distinctive driving situations were studied: a) obstacle avoidance test, and b) city road traveling test. A conventional steering wheel with self-centering force feedback tuning was used for all the driving events for comparison.

It’s important to predict human actions in the industry assembly process. Foreseeing future actions before they happened is an essential part for flexible human-robot collaboration and crucial to safety issues. Vision-based human action prediction from videos provides intuitive and adequate knowledge for many complex applications. This problem can be interpreted as deducing the next action of people from a short video clip. The history information needs to be considered to learn these relations among time steps for predicting the future steps. However, it is difficult to extract the history information and use it to infer the future situation with traditional methods. In this scenario, a model is needed to handle the spatial and temporal details stored in the past human motions and construct the future action based on limited accessible human demonstrations.

The Deep Orange program is a concept vehicle development program focused on providing hands-on experience in design, engineering, prototyping and production planning as part of students’ two-year MS graduate education. Throughout this project, the team was challenged to create innovative concepts during the ideation phase as part of building the running vehicle. This paper describes the usability studies performed on two of the vehicle concepts that require driver interaction. One concept is a human machine interface (HMI) that uses a holographic companion that can act as a concierge for all functions of the vehicle. After creating a prototype using existing technologies and developing a user interface controlled by hand gestures, a usability study was completed with older adults. The results suggest the input method was not intuitive. Participants demonstrated better performance with tasks using discrete hand motions in comparison to those that required continuous motions.

This paper describes the development and simulation of a voice and pointing gesture interaction system for on-route update of autonomous vehicles’ path. The objective of this research is to provide users of autonomous vehicles a human vehicle interaction mode that enables them to make and communicate spontaneous decisions to the autonomous car, modifying its pre-defined autonomous route in real-time. For example, similar to giving directions to a taxi driver, a user will be able to tell the car «Stop there» or «Take that exit». In this way, the user control/spontaneity vs interaction flexibility dilemma that current autonomous vehicle concepts have, could be solved, potentially increasing the user acceptance of this technology. The system was designed following a level structured state machine approach. The simulations were developed using MATLAB and VREP, a robotics simulation platform, which has accurate vehicle and sensor models.

Capacitance sensing is the technology that detects the presence of nearby objects by measuring the change in capacitance. A change in capacitance is triggered either by a change in dielectric constant, area of overlap or distance of separation between the electrodes of the capacitor. It is a technology that finds wide use in applications such as touch screens, proximity sensing etc. Drawing motivation from such applications, this paper investigates how capacitive sensing can be employed to detect the presence and posture of occupants inside vehicles. Compared to existing solutions, the proposed approach is low-cost, easy to deploy and highly efficient. The sensing system consists of a capacitance-sensing mat that is embedded with copper foils and an associated sensing circuitry. Inside the mat the foils are arranged in rows and columns to form several touch-nodes across the surface of the mat.

Emerging autonomous driving technologies, with emergency navigating capabilities, necessitates innovative vehicle steering methods for operators during unanticipated scenarios. A reconfigurable “plug and play” steering system paradigm enables lateral control from any seating position in the vehicle’s interior. When required, drivers may access a stowed steering input device, establish communications with the vehicle steering subsystem, and provide direct wheel commands. Accordingly, the provision of haptic steering cues and lane keeping assistance to navigate roadways will be helpful. In this study, various steering devices have been investigated which offer reconfigurability and haptic feedback to create a flexible driving environment. A joystick and a robotic arm that offer multiple degrees of freedom were compared to a conventional steering wheel.

This study was driven by the prevalence of older drivers’ overrepresentation in crashes caused by pedal application errors. Previous research has shown tasks prone to pedal errors, which include emergency braking, parking lot maneuvers and reaching out of the driver’s window. However, pedal usage characteristics of older drivers while performing on-road driving tasks are unknown. The objective of this research was to understand pedal usage characteristics of older drivers during on-road driving tasks in an instrumented vehicle. Twenty-six drivers over the age of 60 completed 10 stopping tasks as the baseline for stopping performance, a startle-braking task, two forward parking tasks and two reaching out of the vehicle tasks. Results for this instrumented vehicle study showed significantly positive correlations between stature and the percent of foot pivoting, and between shoe length and percent of foot pivoting in the baseline stopping tasks.

Improper fit in a vehicle will affect a driver’s ability to reach the steering wheel and pedals, view the roadway and instrument gauges, and allow vehicle safety features to protect the driver during a crash. CarFit® is a community outreach program to educate older drivers on proper “fit” within their personal vehicle. A subset of measurements from CarFit® were used to quantify the “fit” of 97 older drivers over 60 and 20 younger drivers, ages 30-39, in their personal vehicles. Binary, logistic regression was used to assess the likelihood of drivers meeting the CarFit® measurement criteria prior to and after CarFit® education. The results showed older drivers were five times more likely than younger drivers to meet the CarFit® criteria for line of sight above the steering wheel, suggesting that younger drivers would also benefit from CarFit® education.

The ability to independently transfer into and out of a vehicle is essential for many wheelchair users to achieve driving independence. The purpose of the current study is to build upon the previous exploratory study that investigated the transfer strategies of wheelchair users by observing YouTube videos. This observational study videotaped five wheelchair users transferring from their wheelchairs into two research vehicles, a small and mid-size sedan that were equipped with a 50mm grid. The goal of this study was to use these videos and vehicle grids to precisely identify ingress and egress motions as well as “touch points” in a controlled setting with a small sample of five male wheelchair users. Using the videos from multiple different camera perspectives, the participants’ ingress and egress transfers were coded, documenting the touch points and step-by-step action sequences.

Autonomous vehicles have the potential to provide mobility to individuals who experience transportation disadvantages due to the inability to drive as a result of physical, cognitive or visual limitations/impairments as well as able-bodied individuals with no/limited desire to drive. Individuals who do not have easy access to transportation have social, academic, health, and career disadvantages in comparison to their peers. Fully autonomous vehicles have the potential to offer mobility solutions to these individuals. A user-centered design approach was utilized by a multidisciplinary team of engineers, human factors specialists, and designers to develop future vehicle features for a broad range of users.

In the next 20 years fully autonomous vehicles are expected to be in the market. The advance on their development is creating paradigm shifts on different automotive related research areas. Vehicle interiors design and human vehicle interaction are evolving to enable interaction flexibility inside the cars. However, most of today’s vehicle manufacturers’ autonomous car concepts maintain the steering wheel as a control element. While this approach allows the driver to take over the vehicle route if needed, it causes a constraint in the previously mentioned interaction flexibility. Other approaches, such as the one proposed by Google, enable interaction flexibility by removing the steering wheel and accelerator and brake pedals. However, this prevents the users to take control over the vehicle route if needed, not allowing them to make on-route spontaneous decisions, such as stopping at a specific point of interest.