Characterization of a family of algorithms for generalized discriminant analysis on undersampled problems

Jieping Ye

Research output: Contribution to journalArticlepeer-review

333 Scopus citations


A generalized discriminant analysis based on a new optimization criterion is presented. The criterion extends the optimization criteria of the classical Linear Discriminant Analysis (LDA) when the scatter matrices are singular. An efficient algorithm for the new optimization problem is presented. The solutions to the proposed criterion form a family of algorithms for generalized LDA, which can be characterized in a closed form. We study two specific algorithms, namely Uncorrelated LDA (ULDA) and Orthogonal LDA (OLDA). ULDA was previously proposed for feature extraction and dimension reduction, whereas OLDA is a novel algorithm proposed in this paper. The features in the reduced space of ULDA are uncorrelated, while the discriminant vectors of OLDA are orthogonal to each other. We have conducted a comparative study on a variety of real-world data sets to evaluate ULDA and OLDA in terms of classification accuracy.

Original languageEnglish (US)
JournalJournal of Machine Learning Research
StatePublished - 2005
Externally publishedYes


  • Dimension reduction
  • Linear discriminant analysis
  • Orthogonal LDA
  • Singular value decomposition
  • Uncorrelated LDA

ASJC Scopus subject areas

  • Software
  • Artificial Intelligence
  • Control and Systems Engineering
  • Statistics and Probability


Dive into the research topics of 'Characterization of a family of algorithms for generalized discriminant analysis on undersampled problems'. Together they form a unique fingerprint.

Cite this