TY - JOUR

T1 - Unbiased predictive risk estimation of the Tikhonov regularization parameter

T2 - convergence with increasing rank approximations of the singular value decomposition

AU - Renaut, Rosemary A.

AU - Helmstetter, Anthony W.

AU - Vatankhah, Saeed

N1 - Publisher Copyright:
© 2019, Springer Nature B.V.

PY - 2019/12/1

Y1 - 2019/12/1

N2 - The truncated singular value decomposition may be used to find the solution of linear discrete ill-posed problems in conjunction with Tikhonov regularization and requires the estimation of a regularization parameter that balances between the sizes of the fit to data function and the regularization term. The unbiased predictive risk estimator is one suggested method for finding the regularization parameter when the noise in the measurements is normally distributed with known variance. In this paper we provide an algorithm using the unbiased predictive risk estimator that automatically finds both the regularization parameter and the number of terms to use from the singular value decomposition. Underlying the algorithm is a new result that proves that the regularization parameter converges with the number of terms from the singular value decomposition. For the analysis it is sufficient to assume that the discrete Picard condition is satisfied for exact data and that noise completely contaminates the measured data coefficients for a sufficiently large number of terms, dependent on both the noise level and the degree of ill-posedness of the system. A lower bound for the regularization parameter is provided leading to a computationally efficient algorithm. Supporting results are compared with those obtained using the method of generalized cross validation. Simulations for two-dimensional examples verify the theoretical analysis and the effectiveness of the algorithm for increasing noise levels, and demonstrate that the relative reconstruction errors obtained using the truncated singular value decomposition are less than those obtained using the singular value decomposition.

AB - The truncated singular value decomposition may be used to find the solution of linear discrete ill-posed problems in conjunction with Tikhonov regularization and requires the estimation of a regularization parameter that balances between the sizes of the fit to data function and the regularization term. The unbiased predictive risk estimator is one suggested method for finding the regularization parameter when the noise in the measurements is normally distributed with known variance. In this paper we provide an algorithm using the unbiased predictive risk estimator that automatically finds both the regularization parameter and the number of terms to use from the singular value decomposition. Underlying the algorithm is a new result that proves that the regularization parameter converges with the number of terms from the singular value decomposition. For the analysis it is sufficient to assume that the discrete Picard condition is satisfied for exact data and that noise completely contaminates the measured data coefficients for a sufficiently large number of terms, dependent on both the noise level and the degree of ill-posedness of the system. A lower bound for the regularization parameter is provided leading to a computationally efficient algorithm. Supporting results are compared with those obtained using the method of generalized cross validation. Simulations for two-dimensional examples verify the theoretical analysis and the effectiveness of the algorithm for increasing noise levels, and demonstrate that the relative reconstruction errors obtained using the truncated singular value decomposition are less than those obtained using the singular value decomposition.

KW - Inverse problems

KW - Regularization parameter

KW - Tikhonov regularization

KW - Unbiased predictive risk estimation

UR - http://www.scopus.com/inward/record.url?scp=85067945312&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85067945312&partnerID=8YFLogxK

U2 - 10.1007/s10543-019-00762-7

DO - 10.1007/s10543-019-00762-7

M3 - Article

AN - SCOPUS:85067945312

SN - 0006-3835

VL - 59

SP - 1031

EP - 1061

JO - BIT Numerical Mathematics

JF - BIT Numerical Mathematics

IS - 4

ER -