3.10 - Data Quality and Denoising: A Review

Research output: Chapter in Book/Report/Conference proceedingChapter

3 Scopus citations

Abstract

This article introduces the methods of Fourier and wavelet analysis for enhancing data quality in typical chemometric and process analytics applications. Fourier analysis has been popular for many decades but is best suited for enhancing signals where most features are localized in frequency. In contrast, wavelet analysis is appropriate for signals that contain features localized in both time and frequency domains. It also retains the benefits of Fourier analysis such as orthonormality and computational efficiency. Practical algorithms for off-line and on-line denoising are described and compared via simple examples. These algorithms can be used for off-line or on-line applications in order to mitigate the impact of additive Gaussian as well as non-Gaussian noise.

Original languageEnglish (US)
Title of host publicationComprehensive Chemometrics
Subtitle of host publicationChemical and Biochemical Data Analysis, Second Edition: Four Volume Set
PublisherElsevier
Pages179-204
Number of pages26
Volume3
ISBN (Electronic)9780444641656
DOIs
StatePublished - Jan 1 2020
Externally publishedYes

Keywords

  • Bayesian estimation
  • Data quality
  • Data rectification
  • Filtering
  • Fourier analysis
  • Gaussian and non-Gaussian noise
  • Kalman filtering
  • Model-based denoising
  • Multiscale analysis
  • Off-line and online denoising
  • Outliers
  • Smoothing
  • Wavelet analysis
  • Wavelet thresholding
  • Windowed Fourier analysis

ASJC Scopus subject areas

  • General Chemistry

Fingerprint

Dive into the research topics of '3.10 - Data Quality and Denoising: A Review'. Together they form a unique fingerprint.

Cite this