Operational Safety Metrics for Verification and Validation (V&V) of Automated Driving Systems (ADS)
J3237
This SAE Information Report provides definitions and lexicon for describing operational safety metrics for quantifying the operational safety performance of ADS and ADS-operated vehicles. This document includes a literature review of operational safety metrics that have been proposed and, in some cases, used in previous studies. Characteristics of the identified metrics are listed, and include: 1. Definition, 2. Data Source, 3. Subjectivity (if applicable), 4. Observable Variables, 5. Formulation, 6. Subjective Assumptions and Thresholds, and 7. Origin. The commonalities between metrics are described where applicable, and a set of metrics that will provide input to an operational safety assessment methodology is proposed.
Rationale: As development of Automated Driving System (ADS) technologies progresses, the ability to assess the operational safety of an on-road, ADS-operated vehicle is an important subject. Further, this operational safety assessment must be quantified with well-defined metrics. Establishing a set of operational safety metrics can enable stakeholders, including the general public, to understand of the level of risk associated with any particular on-road, ADS-operated vehicle.
To address the need for operational safety metrics, this document provides a preliminary set of metrics for industry utilization to quantify system competency. The metrics were generated based on reviewing a variety of metrics obtained from various organizations and recognizing commonalities. In the future, material from this document is intended to be incorporated into documents regarding additional verification and validation (V&V) activities, specifically testing methodology documents.
