Dynamic exploration–exploitation trade-off in active learning regression with Bayesian hierarchical modeling

Upala Junaida Islam, Kamran Paynabar, George Runger, Ashif Sikandar Iquebal

Research output: Contribution to journalArticlepeer-review

1 Scopus citations

Abstract

Active learning provides a framework to adaptively query the most informative experiments towards learning an unknown black-box function. Various approaches of active learning have been proposed in the literature, however, they either focus on exploration or exploitation in the design space. Methods that do consider exploration–exploitation simultaneously employ fixed or ad-hoc measures to control the trade-off that may not be optimal. In this article, we develop a Bayesian hierarchical approach, referred to as BHEEM, to dynamically balance the exploration-exploitation trade-off as more data points are queried. To sample from the posterior distribution of the trade-off parameter, we subsequently formulate an approximate Bayesian computation approach based on the linear dependence of queried data in the feature space. Simulated and real-world examples show the proposed approach achieves at least 21% and 11% average improvement when compared to pure exploration and exploitation strategies, respectively. More importantly, we note that by optimally balancing the trade-off between exploration and exploitation, BHEEM performs better or at least as well as either pure exploration or pure exploitation.

Original languageEnglish (US)
Pages (from-to)393-407
Number of pages15
JournalIISE Transactions
Volume57
Issue number4
DOIs
StatePublished - 2025

Keywords

  • Active learning regression
  • Bayesian hierarchical model
  • approximate Bayesian computation
  • exploration-exploitation trade-off

ASJC Scopus subject areas

  • Industrial and Manufacturing Engineering

Fingerprint

Dive into the research topics of 'Dynamic exploration–exploitation trade-off in active learning regression with Bayesian hierarchical modeling'. Together they form a unique fingerprint.

Cite this