Empirically estimable classification bounds based on a nonparametric divergence measure

Visar Berisha, Alan Wisler, Alfred O. Hero, Andreas Spanias

Research output: Contribution to journalArticlepeer-review

66 Scopus citations


Information divergence functions play a critical role in statistics and information theory. In this paper we show that a nonparametric-divergence measure can be used to provide improvedboundsontheminimumbinaryclassificationprobabilityof error for the case when the training and test data are drawn from the same distribution and for the case where there exists some mismatch between training and test distributions. We confirm these theoretical results by designing feature selection algorithms using the criteria from these bounds and by evaluating the algorithms on a series of pathological speech classification tasks.

Original languageEnglish (US)
Article number7254229
Pages (from-to)580-591
Number of pages12
JournalIEEE Transactions on Signal Processing
Issue number3
StatePublished - Feb 1 2016


  • Bayes error rate
  • Classification
  • Divergence measures
  • Domain adaptation
  • Nonparametric divergence estimator

ASJC Scopus subject areas

  • Signal Processing
  • Electrical and Electronic Engineering


Dive into the research topics of 'Empirically estimable classification bounds based on a nonparametric divergence measure'. Together they form a unique fingerprint.

Cite this