Browse Publications Technical Papers 2020-01-0942

Using Polygot Persistence with NoSQL Databases for Streaming Multimedia, Sensor, and Messaging Services in Autonomous Vehicles 2020-01-0942

The explosion of big data has created challenges for both cloud-based systems and Autonomous Vehicles (AVs) in data collection and management. The same challenges are now being realized in developing databases for integrated sensors, streaming, real-time and on-demand services in AVs. With just one AV expecting to generate over 30 Terabytes of data a day, modern NoSQL databases provide opportunities to horizontally scale AV data seamlessly. NoSQL provides solutions designed to accommodate a wide variety of data models such as, key-value, document, column and graph databases. Key-value stores are by nature scalable, fast processing, and distribute horizontally. These databases are tasked with handling several data types including IoT, radar, lidar, ultra-sonic sensors, GPS, odometry, and sensor data while providing streaming and real-time services. NoSQL can store and utilize structured, semi-structured, and unstructured data necessary for multimedia storage needs. NoSQL databases such as Graph databases support big data necessary for the demands of modern software development. Graph databases can scale AV data by using geospatial and geolocation coordinates as entities for flexible queries and pattern recognition. This paper addresses the development of an autonomous platform to process structured, unstructured, semi-structured, and polymorphic data using NoSQL databases built on a hybrid framework. Using Polygot Persistence for processing multimedia, social media, GPS data, audio, fleet diagnostics, and messaging services will be incorporated into the Platform as a Services (PaaS). Integration of NoSQL’s toolboxes and horizontal scalability through cloud deployments will continue the development of an integrated database that’s scalable for the PaaS application.


Subscribers can view annotate, and download all of SAE's content. Learn More »


Members save up to 16% off list price.
Login to see discount.
Special Offer: Download multiple Technical Papers each year? TechSelect is a cost-effective subscription option to select and download 12-100 full-text Technical Papers per year. Find more information here.
We also recommend:

On Collecting High Quality Labeled Data for Automatic Transportation Mode Detection


View Details


Safety Assurance Concepts for Automated Driving Systems


View Details


Leading Edge Assembly Real Time Process Monitoring Using Industrial Internet of Things (IIoT)


View Details