Least squares problems with inequality constraints as quadratic constraints

Jodi L. Mead, Rosemary Renaut

Research output: Contribution to journalArticlepeer-review

23 Scopus citations

Abstract

Linear least squares problems with box constraints are commonly solved to find model parameters within bounds based on physical considerations. Common algorithms include Bounded Variable Least Squares (BVLS) and the Matlab function lsqlin. Here, the goal is to find solutions to ill-posed inverse problems that lie within box constraints. To do this, we formulate the box constraints as quadratic constraints, and solve the corresponding unconstrained regularized least squares problem. Using box constraints as quadratic constraints is an efficient approach because the optimization problem has a closed form solution. The effectiveness of the proposed algorithm is investigated through solving three benchmark problems and one from a hydrological application. Results are compared with solutions found by lsqlin, and the quadratically constrained formulation is solved using the L-curve, maximum a posteriori estimation (MAP), and the χ2 regularization method. The χ2 regularization method with quadratic constraints is the most effective method for solving least squares problems with box constraints.

Original languageEnglish (US)
Pages (from-to)1936-1949
Number of pages14
JournalLinear Algebra and Its Applications
Volume432
Issue number8
DOIs
StatePublished - Apr 1 2010

Keywords

  • Box constraints
  • Linear least squares
  • Regularization

ASJC Scopus subject areas

  • Algebra and Number Theory
  • Numerical Analysis
  • Geometry and Topology
  • Discrete Mathematics and Combinatorics

Fingerprint

Dive into the research topics of 'Least squares problems with inequality constraints as quadratic constraints'. Together they form a unique fingerprint.

Cite this