Reinforcement Learning Enabled Safety-Critical Tracking of Automated Vehicles with Uncertainties via Integrated Control-Dependent, Time-Varying Barrier Function, and Control Lyapunov Function

Jingxiong Meng, Junfeng Zhao, Yan Chen

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

Model uncertainties are considered in a learning-based control framework that combines control dependent barrier function (CDBF), time-varying control barrier function (TCBF), and control Lyapunov function (CLF). Tracking control is achieved by CLF, while safety-critical constraints during tracking are guaranteed by CDBF and TCBF. A reinforcement learning (RL) method is applied to jointly learn model uncertainties that related to CDBF, TCBF, and CLF. The learning-based framework eventually formulates a quadratic programming (QP) with different constraints of CDBF, TCBF and CLF involving model uncertainties. It is the first time to apply the proposed learning-based framework for safety-guaranteed tracking control of automated vehicles with uncertainties. The control performances are validated for two different single-lane change maneuvers via Simulink/CarSim® co-simulation and compared for the cases with and without learning. Moreover, the learning effects are discussed through explainable constraints in the QP formulation.

Original languageEnglish (US)
Title of host publicationIFAC-PapersOnLine
EditorsMarcello Canova
PublisherElsevier B.V.
Pages85-90
Number of pages6
Edition3
ISBN (Electronic)9781713872344
DOIs
StatePublished - Oct 1 2023
Event3rd Modeling, Estimation and Control Conference, MECC 2023 - Lake Tahoe, United States
Duration: Oct 2 2023Oct 5 2023

Publication series

NameIFAC-PapersOnLine
Number3
Volume56
ISSN (Electronic)2405-8963

Conference

Conference3rd Modeling, Estimation and Control Conference, MECC 2023
Country/TerritoryUnited States
CityLake Tahoe
Period10/2/2310/5/23

Keywords

  • Automated vehicles
  • control-dependent barrier function
  • reinforcement learning
  • safety-critical tracking
  • uncertainties

ASJC Scopus subject areas

  • Control and Systems Engineering

Fingerprint

Dive into the research topics of 'Reinforcement Learning Enabled Safety-Critical Tracking of Automated Vehicles with Uncertainties via Integrated Control-Dependent, Time-Varying Barrier Function, and Control Lyapunov Function'. Together they form a unique fingerprint.

Cite this