Evaluation of Operational Safety Assessment (OSA) Metrics for Automated Vehicles Using Real-World Data

Varun Chandra Jammula, Jeffrey Wishart, Yezhou Yang

Research output: Contribution to journalConference articlepeer-review


Assurance of the operational safety of automated vehicles (AVs) is crucial to enable commercialization and deployment on public roads. The operational safety must be quantified without ambiguity using well-defined metrics. Several efforts are in place to establish an appropriate set of metrics that can quantify the operational safety of AVs in a technology-neutral way, including the Operational Safety Assessment (OSA) metrics proposed by the Institute of Automated Mobility (IAM). The focus of this work is to compute real-world measurements of the relevant safety envelope OSA metrics in car-following scenarios. This allows for an analysis of the impact of different parameters and thresholds and for an evaluation of the individual usefulness of the safety envelope OSA metrics. The current work complements prior IAM work involving evaluating the safety envelope OSA metrics in car-following scenarios in simulation. Video data were collected from infrastructure-based cameras at a traffic intersection in Anthem, AZ. Pairs of vehicles that either interact with each other or influence each other's decision-making were identified. A methodology was developed using computer vision to localize the vehicles using the video data and fusing them with a map representation to obtain vehicle-vehicle relations and the maneuvers in which they are involved. Longitudinal conflicts in car-following scenarios were filtered to compute the safety envelope OSA metrics. Analysis of the safety envelope OSA metrics results were conducted to identify the usefulness of the various metrics in the car-following scenarios and to make a comparison to the observations from simulation.

Original languageEnglish (US)
JournalSAE Technical Papers
Issue number2022
StatePublished - Mar 29 2022
EventSAE 2022 Annual World Congress Experience, WCX 2022 - Virtual, Online, United States
Duration: Apr 5 2022Apr 7 2022

ASJC Scopus subject areas

  • Automotive Engineering
  • Safety, Risk, Reliability and Quality
  • Pollution
  • Industrial and Manufacturing Engineering


Dive into the research topics of 'Evaluation of Operational Safety Assessment (OSA) Metrics for Automated Vehicles Using Real-World Data'. Together they form a unique fingerprint.

Cite this