Search Results

In intelligent surveillance and reconnaissance (ISR) missions, multiple autonomous vehicles, such as unmanned ground vehicles (UGVs) or unmanned aerial vehicles (UAVs), coordinate with each other for efficient information gathering. These vehicles are usually battery-powered and require periodic charging when deployed for continuous monitoring that spans multiple hours or days. In this paper, we consider a mobile host charging vehicle that carries distributed sources, such as a generator, solar PV and battery, and is deployed in the area where the UAVs and UGVs operate. However, due to uncertainties, the state of charge of UAV and UGV batteries, their arrival time at the charging location and the charging duration cannot be predicted accurately.

Robust communications are crucial for autonomous military fleets. Ground vehicles function as mobile local area networks utilizing Controller Area Network (CAN) backbones. Fleet coordination between autonomous platforms relies on the Robot Operating System (ROS) publish/subscribe robotic middleware for effective operation. To bridge communications between the CAN and ROS network segments, the CAN2ROS bridge software supports bidirectional data flow with message mapping and node translation. Fuzzing, a software testing technique, involves injecting randomized data inputs into the target system. This method plays a pivotal role in identifying vulnerabilities. It has proven effective in discovering vulnerabilities in online systems, such as the integrated CAN/ROS system. In our study, we consider ROS implementing zero-trust access control policies, running on a Gazebo test-bed connected to a CAN bus.

Access control enforces security policies for controlling critical resources. For V2X (Vehicle to Everything) autonomous military vehicle fleets, network middleware systems such as ROS (Robotic Operating System) expose system resources through networked publisher/subscriber and client/server paradigms. Without proper access control, these systems are vulnerable to attacks from compromised network nodes, which may perform data poisoning attacks, flood packets on a network, or attempt to gain lateral control of other resources. Access control for robotic middleware systems has been investigated in both ROS1 and ROS2. Still, these implementations do not have mechanisms for evaluating a policy's consistency and completeness or writing expressive policies for distributed fleets. We explore an RBAC (Role-Based Access Control) mechanism layered onto ROS environments that uses local permission caches with precomputed truth tables for fast policy evaluation.

Autonomous vehicles (AV) are sophisticated systems comprising various sensors, powerful processors, and complex data processing algorithms that navigate autonomously to their respective goals. Out of several functions performed by an AV, one of the most important is developing situational intelligence to predict collision-free future trajectories. As an AV operates in environments consisting of various entities, such as other AVs, human-driven vehicles, and static obstacles, developing situational intelligence will require a collaborative approach. The recent developments in artificial intelligence (AI) and deep learning (DL) relating to AVs have shown that DL-based models can take advantage of information sharing and collaboration to develop such intelligence.

In the United States and worldwide, 38,824 and 1.35 million people were killed in vehicle crashes during 2020. These statistics are tragic and indicative of an on-going public health crisis centered on automobiles and other ground transportation solutions. Although the long-term US vehicle fatality rate is slowly declining, it continues to be elevated compared to European countries. The introduction of vehicle safety systems and re-designed roadways has improved survivability and driving environment, but driver behavior has not been fully addressed. A non-confrontational approach is the evaluation of driver behavior using onboard sensors and computer algorithms to determine the vehicle’s “mistrust” level of the given operator and the safety of the individual operating the vehicle. This is an inversion of the classic human-machine trust paradigm in which the human evaluates whether the machine can safely operate in an automated fashion.

Since 1989, ISO has published procedures for developing and testing public information symbols (ISO 9186), while the SAE standard for in-vehicle icon comprehension testing (SAE J2830) was first published in 2008. Neither testing method was designed to evaluate the comprehension of symbols in modern vehicles that offer digital instrument cluster interfaces that afford new levels of flexibility to further improve drivers’ understanding of symbols. Using a driving simulator equipped with an eye tracker, this study investigated drivers’ understanding of six automotive symbols presented on in-vehicle displays. Participants included 24 teens, 24 adults, and 24 senior drivers. Symbols were presented in a symbol-only, symbol + short text descriptions, and symbol + long text description conditions. Participants’ symbol comprehension, driving performance, reaction times, and eye glance times were measured.

Autonomous vehicles have the potential to transform lives by providing transportation to a wider range of users. However, with this new method of transportation, user acceptance and comfort are critical for widespread adoption. This exploratory study aims to investigate what makes passengers uncomfortable in existing vehicles to inform the design of future autonomous vehicles. In order to predict what may impact user acceptance for a diverse rider population for future autonomous vehicles, it is important to understand what makes a broad range of passengers uncomfortable today. In this study, interviews were conducted for a total of 75 participants from three diverse groups, including 20 automotive engineering graduate students who are building an autonomous concept vehicle, 21 non-technical adults, and 34 senior citizens. The results revealed both topics which made different groups of passengers uncomfortable as well as how these varied between the groups.

In this paper, a reinforcement learning-based method is proposed to adapt autonomous vehicle passengers’ expectation of comfort through in-situ human-vehicle interaction. Ride comfort has a significant influence on the user’s experience and thus acceptance of autonomous vehicles. There is plenty of research about the motion planning and control of autonomous vehicles. However, limited studies have explicitly considered the comfort of passengers in autonomous vehicles. This paper studies the comfort of humans in autonomous vehicles longitudinal autonomous driving. The paper models and then improves passengers’ feelings about autonomous driving behaviors. This proposed approach builds a control and adaptation strategy based on reinforcement learning using human’s in-situ feedback on autonomous driving. It also proposes an adaptation of humans to autonomous vehicles to account for improper human driving expectations.

Driving inattention caused by drowsiness has been a significant reason for vehicle crash accidents, and there is a critical need to augment driving safety by monitoring driver drowsiness behaviors. For real-time drowsy driving awareness, we propose a vision-based driver drowsiness monitoring system (DDMS) for driver drowsiness behavior recognition and analysis. First, an infrared camera is deployed in-vehicle to capture the driver’s facial and head information in naturalistic driving scenarios, in which the driver may or may not wear glasses or sunglasses. Second, we propose and design a multi-modal features representation approach based on facial landmarks, and head pose which is retrieved in a convolutional neural network (CNN) regression model. Finally, an extreme learning machine (ELM) model is proposed to fuse the facial landmark, recognition model and pose orientation for drowsiness detection. The DDMS gives promptly warning to the driver once a drowsiness event is detected.

This paper presents a hierarchical control architecture to coordinate a group of connected vehicles on signalized intersection roads, where vehicles are allowed to change lane to follow a prescribed path. The proposed hierarchical control strategy consists of two control levels: a high level controller at the intersection and a decentralized low level controller in each car. In the hierarchical control architecture, the centralized intersection controller estimates the target velocity for each approaching connected vehicle to avoid red light stop based on the signal phase and timing (SPAT) information. Each connected vehicle as a decentralized controller utilizes model predictive control (MPC) to track the target velocity in a fuel efficient manner. The main objective in this paper is to consider mandatory lane changes. As in the realistic scenarios, vehicles are not required to drive in single lane. More specifically, they more likely change their lanes prior to signals.

Unmanned ground vehicles (UGVs) may encounter difficulties accommodating environmental uncertainties and system degradations during harsh conditions. However, human experience and onboard intelligence can may help mitigate such cases. Unfortunately, human operators have cognition limits when directly supervising multiple UGVs. Ideally, an automated decision aid can be designed that empowers the human operator to supervise the UGVs. In this paper, we consider a connected UGV platoon under cyber attacks that may disrupt safety and degrade performance. An observer-based resilient control strategy is designed to mitigate the effects of vehicle-to-vehicle (V2V) cyber attacks. In addition, each UGV generates both internal and external evaluations based on the platoons performance metrics. A cloud-based trust-based information management system collects these evaluations to detect abnormal UGV platoon behaviors.

Automotive drive-by-wire systems have enabled greater mobility options for individuals with physical disabilities. To further expand the driving paradigm, a need exists to consider an alternative vehicle steering mechanism to meet specific needs and constraints. In this study, a cellphone steering controller was investigated using a fixed-base driving simulator. The cellphone incorporated the direction control of the vehicle through roll motion, as well as the brake and throttle functionality through pitch motion, a design that can assist disabled drivers by excluding extensive arm and leg movements. Human test subjects evaluated the cellphone with conventional vehicle control strategy through a series of roadway maneuvers. Specifically, two distinctive driving situations were studied: a) obstacle avoidance test, and b) city road traveling test. A conventional steering wheel with self-centering force feedback tuning was used for all the driving events for comparison.

This paper describes the development and simulation of a voice and pointing gesture interaction system for on-route update of autonomous vehicles’ path. The objective of this research is to provide users of autonomous vehicles a human vehicle interaction mode that enables them to make and communicate spontaneous decisions to the autonomous car, modifying its pre-defined autonomous route in real-time. For example, similar to giving directions to a taxi driver, a user will be able to tell the car «Stop there» or «Take that exit». In this way, the user control/spontaneity vs interaction flexibility dilemma that current autonomous vehicle concepts have, could be solved, potentially increasing the user acceptance of this technology. The system was designed following a level structured state machine approach. The simulations were developed using MATLAB and VREP, a robotics simulation platform, which has accurate vehicle and sensor models.

Capacitance sensing is the technology that detects the presence of nearby objects by measuring the change in capacitance. A change in capacitance is triggered either by a change in dielectric constant, area of overlap or distance of separation between the electrodes of the capacitor. It is a technology that finds wide use in applications such as touch screens, proximity sensing etc. Drawing motivation from such applications, this paper investigates how capacitive sensing can be employed to detect the presence and posture of occupants inside vehicles. Compared to existing solutions, the proposed approach is low-cost, easy to deploy and highly efficient. The sensing system consists of a capacitance-sensing mat that is embedded with copper foils and an associated sensing circuitry. Inside the mat the foils are arranged in rows and columns to form several touch-nodes across the surface of the mat.

Emerging autonomous driving technologies, with emergency navigating capabilities, necessitates innovative vehicle steering methods for operators during unanticipated scenarios. A reconfigurable “plug and play” steering system paradigm enables lateral control from any seating position in the vehicle’s interior. When required, drivers may access a stowed steering input device, establish communications with the vehicle steering subsystem, and provide direct wheel commands. Accordingly, the provision of haptic steering cues and lane keeping assistance to navigate roadways will be helpful. In this study, various steering devices have been investigated which offer reconfigurability and haptic feedback to create a flexible driving environment. A joystick and a robotic arm that offer multiple degrees of freedom were compared to a conventional steering wheel.

This study was driven by the prevalence of older drivers’ overrepresentation in crashes caused by pedal application errors. Previous research has shown tasks prone to pedal errors, which include emergency braking, parking lot maneuvers and reaching out of the driver’s window. However, pedal usage characteristics of older drivers while performing on-road driving tasks are unknown. The objective of this research was to understand pedal usage characteristics of older drivers during on-road driving tasks in an instrumented vehicle. Twenty-six drivers over the age of 60 completed 10 stopping tasks as the baseline for stopping performance, a startle-braking task, two forward parking tasks and two reaching out of the vehicle tasks. Results for this instrumented vehicle study showed significantly positive correlations between stature and the percent of foot pivoting, and between shoe length and percent of foot pivoting in the baseline stopping tasks.

Improper fit in a vehicle will affect a driver’s ability to reach the steering wheel and pedals, view the roadway and instrument gauges, and allow vehicle safety features to protect the driver during a crash. CarFit® is a community outreach program to educate older drivers on proper “fit” within their personal vehicle. A subset of measurements from CarFit® were used to quantify the “fit” of 97 older drivers over 60 and 20 younger drivers, ages 30-39, in their personal vehicles. Binary, logistic regression was used to assess the likelihood of drivers meeting the CarFit® measurement criteria prior to and after CarFit® education. The results showed older drivers were five times more likely than younger drivers to meet the CarFit® criteria for line of sight above the steering wheel, suggesting that younger drivers would also benefit from CarFit® education.

The ability to independently transfer into and out of a vehicle is essential for many wheelchair users to achieve driving independence. The purpose of the current study is to build upon the previous exploratory study that investigated the transfer strategies of wheelchair users by observing YouTube videos. This observational study videotaped five wheelchair users transferring from their wheelchairs into two research vehicles, a small and mid-size sedan that were equipped with a 50mm grid. The goal of this study was to use these videos and vehicle grids to precisely identify ingress and egress motions as well as “touch points” in a controlled setting with a small sample of five male wheelchair users. Using the videos from multiple different camera perspectives, the participants’ ingress and egress transfers were coded, documenting the touch points and step-by-step action sequences.

In the next 20 years fully autonomous vehicles are expected to be in the market. The advance on their development is creating paradigm shifts on different automotive related research areas. Vehicle interiors design and human vehicle interaction are evolving to enable interaction flexibility inside the cars. However, most of today’s vehicle manufacturers’ autonomous car concepts maintain the steering wheel as a control element. While this approach allows the driver to take over the vehicle route if needed, it causes a constraint in the previously mentioned interaction flexibility. Other approaches, such as the one proposed by Google, enable interaction flexibility by removing the steering wheel and accelerator and brake pedals. However, this prevents the users to take control over the vehicle route if needed, not allowing them to make on-route spontaneous decisions, such as stopping at a specific point of interest.

Autonomous driving technologies can provide better safety, comfort and efficiency for future transportation systems. Most research in this area has mainly been focused on developing sensing and control approaches to achieve various autonomous driving functions. Very little of this research, however, has studied how to efficiently handle sensing exceptions. A simple exception measured by any of the sensors may lead to failures in autonomous driving functions. The autonomous vehicles are then supposed to be sent back to manufacturers for repair, which takes both time and money. This paper introduces an efficient approach to make human drivers able to online teach autonomous vehicles to drive under sensing exceptions. A human-vehicle teaching-and-learning framework for autonomous driving is proposed and the human teaching and vehicle learning processes for handling sensing exceptions in autonomous vehicles are designed in detail.