Search Results

Traditional autonomous vehicle perception subsystems that use onboard sensors have the drawbacks of high computational load and data duplication. Infrastructure-based sensors, which can provide high quality information without the computational burden and data duplication, are an alternative to traditional autonomous vehicle perception subsystems. However, these technologies are still in the early stages of development and have not been extensively evaluated for lane detection system performance. Therefore, there is a lack of quantitative data on their performance relative to traditional perception methods, especially during hazardous scenarios, such as lane line occlusion, sensor failure, and environmental obstructions.

Lane detection plays a critical role in autonomous vehicles for safe and reliable navigation. Lane detection is traditionally accomplished using a camera sensor and computer vision processing. The downside of this traditional technique is that it can be computationally intensive when high quality images at a fast frame rate are used and has reliability issues from occlusion such as, glare, shadows, active road construction, and more. This study addresses these issues by exploring alternative methods for lane detection in specific scenarios caused from road construction-induced lane shift and sun glare. Specifically, a U-Net, a convolutional network used for image segmentation, camera-based lane detection method is compared with a radar-based approach using a new type of sensor previously unused in the autonomous vehicle space: radar retro-reflectors.

Evaluating real-world hazards associated with perception subsystems is critical in enhancing the performance of autonomous vehicles. The reliability of autonomous vehicles perception subsystems are paramount for safe and efficient operation. While current studies employ different metrics to evaluate perception subsystem failures in autonomous vehicles, there still exists a gap in the development and emphasis on engineering requirements. To address this gap, this study proposes the establishment of engineering requirements that specifically target real-world hazards and resilience factors important to AV operation, using High-Definition Maps, Global Navigation Satellite System, and weather sensors. The findings include the need for engineering requirements to establish clear criteria for a high-definition maps functionality in the presence of erroneous perception subsystem inputs which enhances the overall safety and reliability of the autonomous vehicles.

Accurate perception of the driving environment and a highly accurate position of the vehicle are paramount to safe Autonomous Vehicle (AV) operation. AVs gather data about the environment using various sensors. For a robust perception and localization system, incoming data from multiple sensors is usually fused together using advanced computational algorithms, which historically requires a high-compute load. To reduce AV compute load and its negative effects on vehicle energy efficiency, we propose a new infrastructure information source (IIS) to provide environmental data to the AV. The new energy–efficient IIS, chip–enabled raised pavement markers are mounted along road lane lines and are able to communicate a unique identifier and their global navigation satellite system position to the AV. This new IIS is incorporated into an energy efficient sensor fusion strategy that combines its information with that from traditional sensor.

Contemporary ADS and ADAS localization technology utilizes real-time perception sensors such as visible light cameras, radar sensors, and lidar sensors, greatly improving transportation safety in sufficiently clear environmental conditions. However, when lane lines are completely occluded, the reliability of on-board automated perception systems breaks down, and vehicle control must be returned to the human driver. This limits the operational design domain of automated vehicles significantly, as occlusion can be caused by shadows, leaves, or snow, which all occur in many regions. High-definition map data, which contains a high level of detail about road features, is an alternative source of the required lane line information. This study details a novel method where high-definition map data are processed to locate fully occluded lane lines, allowing for automated path planning in scenarios where it would otherwise be impossible.

Modern vehicles use automated driving assistance systems (ADAS) products to automate certain aspects of driving, which improves operational safety. In the U.S. in 2020, 38,824 fatalities occurred due to automotive accidents, and typically about 25% of these are associated with inclement weather. ADAS features have been shown to reduce potential collisions by up to 21%, thus reducing overall accidents. But ADAS typically utilize camera sensors that rely on lane visibility and the absence of obstructions in order to function, rendering them ineffective in inclement weather. To address this research gap, we propose a new technique to estimate snow coverage so that existing and new ADAS features can be used during inclement weather. In this study, we use a single camera sensor and historical weather data to estimate snow coverage on the road. Camera data was collected over 6 miles of arterial roadways in Kalamazoo, MI.

Practical applications of recently developed sensor fusion algorithms perform poorly in the real world due to a lack of proper evaluation during development. Existing evaluation metrics do not properly address a wide variety of testing scenarios. This issue can be addressed using proactive performance measurements such as the tools of resilience engineering theory rather than reactive performance measurements such as root mean square error. Resilience engineering is an established discipline for evaluating proactive performance on complex socio-technical systems which has been underutilized for automated vehicle development and evaluation. In this study, we use resilience engineering metrics to assess the performance of a sensor fusion algorithm for vehicle localization. A Kalman Filter is used to fuse GPS, IMU and LiDAR data for vehicle localization in the CARLA simulator.

Robust sensor fusion is a key technology for enabling the safe operation of automated vehicles. Sensor fusion typically utilizes inputs of cameras, radars, lidar, inertial measurement unit, and global navigation satellite systems, process them, and then output object detection or positioning data. This paper will focus on sensor fusion between the camera, radar, and vehicle wheel speed sensors which is a critical need for near-term realization of sensor fusion benefits. The camera is an off-the-shelf computer vision product from MobilEye and the radar is a Delphi/Aptive electronically scanning radar (ESR) both of which are connected to a drive-by-wire capable vehicle platform. We utilize the MobilEye and wheel speed sensors to create a dynamic region of interest (DROI) of the drivable region that changes as the vehicle moves through the environment.

Heavy-duty commercial vehicles consume a significant amount of energy due to their large size and mass, directly leading to vehicle operators prioritizing energy efficiency to reduce operational costs and comply with environmental regulations. One tool that can be used for the evaluation of energy efficiency in heavy-duty vehicles is the evaluation of energy efficiency using vehicle modeling and simulation. Simulation provides a path for energy efficiency improvement by allowing rapid experimentation of different vehicle characteristics on fuel consumption without the need for costly physical prototyping. The research presented in this paper focuses on using real-world, sparsely sampled telematics data from a large fleet of heavy-duty vehicles to create high-fidelity models for simulation. Samples in the telematics dataset are collected sporadically, resulting in sparse data with an infrequent and irregular sampling rate.

A path tracking controller is essential for an autonomous vehicle to navigate a complex environment while avoiding obstacles. Many research studies have proposed new controller designs and strategies. However, it is often unclear which control strategy is the most suitable for a specific Autonomous / ADAS user application. This study proposes a benchmark workflow by comparing different control observer models and their control strategies integration for an autonomous parking lot sweeper in a complex and dense environment at low-speed utilizing model-in-the-loop simulation. The systematic procedure consists of the following steps: (1) vehicle observer model validation (2) control strategy development (3) model-in-the-loop simulation benchmark for specific user scenarios. The kinematic and dynamic vehicle models were used to validate the truck’s behavior using physical data.

Development of autonomous vehicle technology is expensive and perhaps more complicated than initially thought, as evidenced by the recent rollback of anticipated delivery dates from companies such as Tesla, Waymo, GM, and more. One of the most effective techniques to reduce research and development costs and speed up implementation is rigorous analysis through simulation. In this paper, we present multiple autonomous vehicle perception and control strategies that are rigorously investigated in the user friendly, free, and open-source simulation environment, CARLA. Overall, we successfully formulated potential solutions to the autonomous navigation problem and assessed their advantages and disadvantages in simulation at no cost. First, a lane finding method utilizing polynomial fitting and machine learning is proposed. Then, the waypoint navigation strategy is described, along with route planning. Object detection is then implemented using pre-trained convolutional neural networks.

The transportation sector contributes significantly to emissions and air pollution globally. Emission models of modern vehicles are important tools to estimate the impact of technologies or controls on vehicle emission reductions, but developing a simple and high-fidelity model is challenging due to the variety of vehicle classes, driving conditions, driver behaviors, and other physical and operational constraints. Recent literature indicates that neural network-based models may be able to address these concerns due to their high computation speed and high-accuracy of predicted emissions. In this study, we seek to expand upon this initial research by utilizing several deep neural networks (DNN) architectures such as a recurrent neural network (RNN) and a convolutional neural network (CNN). These DNN algorithms are developed specific to the vehicle-out emissions prediction application, and a comprehensive assessment of their performances is done.

While machine learning in autonomous vehicles development has increased significantly in the past few years, the use of reinforcement learning (RL) methods has only recently been applied. Convolutional Neural Networks (CNNs) became common for their powerful object detection and identification and even provided end-to-end control of an autonomous vehicle. However, one of the requirements of a CNN is a large amount of labeled data to inform and train the neural network. While data is becoming more accessible, these networks are still sensitive to the format and collection environment which makes the use of others’ data more difficult. In contrast, RL develops solutions in a simulation environment through trial and error without labeled data. Our research expands upon previous research in RL and Proximal Policy Optimization (PPO) and the application of these algorithms to 1/18th scale cars by expanding the application of this control strategy to a full-sized passenger vehicle.

Operation of an autonomous vehicle (AV) carries risk if it acts on inaccurate information about itself or the environment. The perception system is responsible for interpreting the world and providing the results to the path planning and other decision systems. The perception system performance is a result of the operating state of the sensors, e.g. is a sensor in fault or being adversely affected by the weather or environmental conditions, and approach to sensor measurement interpretation. We propose a trailing horizon switched system observer that minimizes the difference between reference tracking values developed from sensor fusion performed at an upper level and the values from a potentially faulty sensor based upon the convex combination of different sensor observation model outputs; the sensor observations models are associated with different sensor operating errors.

Prediction of vehicle velocity is important since it can realize improvements in the fuel economy/energy efficiency, drivability, and safety. Velocity prediction has been addressed in many publications. Several references considered deterministic and stochastic approaches such as Markov chain, autoregressive models, and artificial neural networks. There are numerous new sensor and signal technologies like vehicle-to-vehicle and vehicle-to-infrastructure communication that can be used to obtain inclusive datasets. Using these inclusive datasets of sensors in deep neural networks, high accuracy velocity predictions can be achieved. This research builds upon previous findings that Long Short-Term Memory (LSTM) deep neural networks provide low error velocity prediction. We developed an LSTM deep neural network that uses different groups of datasets collected in Fort Collins, Colorado.

Autonomous vehicle technology has the potential to improve the safety, efficiency, and cost of our current transportation system by removing human error. With sensors available today, it is possible for the development of these vehicles, however, there are still issues with autonomous vehicle operations in adverse weather conditions (e.g. snow-covered roads, heavy rain, fog, etc.) due to the degradation of sensor data quality and insufficiently robust software algorithms. Since autonomous vehicles rely entirely on sensor data to perceive their surrounding environment, this becomes a significant issue in the performance of the autonomous system. The purpose of this study is to collect sensor data under various weather conditions to understand the effects of weather on sensor data. The sensors used in this study were one camera and one LiDAR. These sensors were connected to an NVIDIA Drive Px2 which operated in a 2019 Kia Niro.

There is a pressing need to develop accurate and robust approaches for predicting vehicle speed to enhance fuel economy/energy efficiency, drivability and safety of automotive vehicles. This paper details outcomes of research into various methods for the prediction of vehicle velocity. The focus is on short-term predictions over 1 to 10 second prediction horizon. Such short-term predictions can be integrated into a hybrid electric vehicle energy management strategy and have the potential to improve HEV energy efficiency. Several deterministic and stochastic models are considered in this paper for prediction of future vehicle velocity. Deterministic models include an Auto-Regressive Moving Average (ARMA) model, a Nonlinear Auto-Regressive with eXternal input (NARX) shallow neural network and a Long Short-Term Memory (LSTM) deep neural network. Stochastic models include a Markov Chain (MC) model and a Conditional Linear Gaussian (CLG) model.

Autonomous vehicle development has benefited from sanctioned competitions dating back to the original 2004 DARPA Grand Challenge. Since these competitions, fully autonomous vehicles have become much closer to significant real-world use with the majority of research focused on reliability, safety and cost reduction. Our research details the recent challenges experienced at the 2017 Self Racing Cars event where a team of international Udacity students worked together over a 6 week period, from team selection to race day. The team’s goal was to provide real-time vehicle control of steering, braking, and throttle through an end-to-end deep neural network. Multiple architectures were tested and used including convolutional neural networks (CNN) and recurrent neural networks (RNN). We began our work by modifying a Udacity driving simulator to collect data and develop training models which we implemented and trained on a laptop GPU.

The environmental implications of converting vehicles powered by Internal Combustion Engines (ICE) to battery powered and hybrid battery/ICE powered are evaluated for the case of Chile, one of the worldwide leaders in the production of lithium (Li) required for manufacturing of Li-ion batteries. The economic and environmental metrics were evaluated by techno-economic analysis (TEA) and Life Cycle Assessment (LCA) tools - SuperPro Designer and Gabi®/GREET® models. The system boundary includes both the renewable and nonrenewable energy sources available in Chile and well-to-pump energy consumptions and GHG emissions due to Li mining and Li-ion battery manufacturing. All the major input data required for TEA and LCA were generated using Autonomie vehicle modeling software. This study compares economic and environmental indicators of three vehicle models for the case of Chile including compact, mid-size, and a light duty truck.

The EcoCAR3 competition challenges student teams to redesign a 2016 Chevrolet Camaro to reduce environmental impacts and increase energy efficiency while maintaining performance and safety that consumers expect from a Camaro. Energy management of the new hybrid powertrain is an integral component of the overall efficiency of the car and is a prime focus of Colorado State University’s (CSU) Vehicle Innovation Team. Previous research has shown that error-less predictions about future driving characteristics can be used to more efficiently manage hybrid powertrains. In this study, a novel, real-world implementable energy management strategy is investigated for use in the EcoCAR3 Hybrid Camaro. This strategy uses a Nonlinear Autoregressive Artificial Neural Network with Exogenous inputs (NARX Artificial Neural Network) trained with real-world driving data from a selected drive cycle to predict future vehicle speeds along that drive cycle.