Search Results

Collaborative robots are more and more used in smart manufacturing because of their capability to work beside and collaborate with human workers. With the deployment of these robots, manufacturing tasks are more inclined to be accomplished by multiple humans and multiple robots (MH-MR) through teaming effort. In such MH-MR collaboration scenarios, the task distribution among the multiple humans and multiple robots is very critical to efficiency. It is also more challenging due to the heterogeneity of different agents. Existing approaches in task distribution among multiple agents mostly consider humans with assumed or known capabilities. However human capabilities are always changing due to various factors, which may lead to suboptimal efficiency. Although some researches have studied several human factors in manufacturing and applied them to adjust the robot task and behaviors.

Learning only from a small set of examples remains a huge challenge in machine learning. Despite recent breakthroughs in the applications of neural networks, the applicability of these techniques has been limited by the requirement for large amounts of training data. What’s more, the standard supervised machine learning method does not provide a satisfactory solution for learning new concepts from little data. However, the ability to learn enough information from few samples has been demonstrated in humans. This suggests that humans may make use of prior knowledge of a previously learned model when learning new ones on a small amount of training examples. In the area of autonomous driving, the model learns to drive the vehicle with training data from humans, and most machine learning based control algorithms require training on very large datasets. Collecting and constructing training data set takes a huge amount of time and needs specific knowledge to gather relevant information.

In this paper, we present a framework for the robot to learn how to place objects to a workpiece by learning from humans in smart manufacturing. In the proposed framework, the rational scene dictionary (RSD) corresponding to the keyframes of task (KFT) are used to identify the general object-action-location relationships. The Generalized Voronoi Diagrams (GVD) based contour is used to determine the relative position and orientation between the object and the corresponding workpiece at the final state. In the learning phase, we keep tracking the image segments in the human demonstration. For the moment when a spatial relation of some segments are changed in a discontinuous way, the state changes are recorded by the RSD. KFT is abstracted after traversing and searching in RSD, while the relative position and orientation of the object and the corresponding mount are presented by GVD-based contours for the keyframes.

This paper presents an approach for performing software in the loop testing of autonomous vehicle software developed in the Autoware framework. Autoware is an open source software for autonomous driving that includes modules such as localization, detection, prediction, planning and control [8]. Multitudes of autonomous driving frameworks exist today, each having its own pros and cons. Often, MATLAB-Simulink is used for rapid prototyping, system modeling and testing, specifically for the lower-level vehicle dynamics and powertrain control features. For the autonomous software, the Robotic Operating System (ROS) is more commonly used for integrating distributed software components so that they can easily share information through a publish and subscribe paradigm. Thorough testing and evaluation of such complex, distributed software, implemented on a physical vehicle poses significant challenges in terms of safety, time, and cost, especially when considering rare edge cases.

Improving passenger safety inside vehicle cabins requires continuously monitoring vehicle seat occupancy statuses. Monitoring a vehicle seat’s occupancy status includes detecting if the seat is occupied and classifying the seat’s occupancy type. This paper introduces an innovative non-intrusive technique that employs capacitive sensing and an occupancy classifier to monitor a vehicle seat’s occupancy status. Capacitive sensing is facilitated by a meticulously constructed capacitance-sensing mat that easily integrates with any vehicle seat. When a passenger or an inanimate object occupies a vehicle seat equipped with the mat, they will induce variations in the mat’s internal capacitances. The variations are, in turn, represented pictorially as grayscale capacitance-sensing images (CSI), which yield the feature vectors the classifier requires to classify the seat’s occupancy type.