Data Analytics, Statistics, Chemometrics, and Artificial Intelligence

Latest News


Unsolved Problems in Spectroscopy - Part 5

This tutorial contrasts classical analytical error propagation with modern Bayesian and resampling approaches, including bootstrapping and jackknifing. Uncertainty estimation in multivariate calibration remains an unsolved problem in spectroscopy, as traditional, Bayesian, and resampling approaches yield differing error bars for chemometric models like PLS and PCR, highlighting the need for deeper theoretical and practical solutions.

Rear view of senior farmer standing in soybean field examining crop at sunset. | Image Credit: © Zoran Zeremski - stock.adobe.com

A new review article highlights how Explainable Artificial Intelligence (XAI) can enhance transparency, trust, and innovation in agricultural spectroscopy, paving the way for smarter and more sustainable food quality assessment.

Unsolved Problems in Spectroscopy, Part 4

This tutorial investigates the persistent issue of sample heterogeneity—chemical and physical—during spectroscopic analysis. Focus will be placed on understanding how spatial variation, surface texture, and particle interactions influence spectral features. Imaging spectroscopy, localized sampling strategies, and adaptive averaging algorithms will be reviewed as tools to manage this problem, as one of the remaining unsolved problems in spectroscopy.

Unsolved Problems in Spectroscopy - Part 1

Inter-instrument variability is a major obstacle in multivariate spectroscopic analysis, affecting the reliability and portability of calibration models. This tutorial addresses the theoretical and practical challenges of model transfer across instruments. It covers spectral variability sources—such as wavelength shifts, resolution differences, and line shape variations—and presents key standardization techniques including direct standardization (DS), piecewise direct standardization (PDS), and external parameter orthogonalization (EPO). We discuss the underlying mathematics of these approaches using matrix notation and highlight limitations that must be considered for reliable universal calibration.

Mini-Tutorial: Raman fingerprinting and machine learning classification of pesticides © marritch -chronicles-stock.adobe.com

Using a custom-built 785 nm Raman instrument, a recent study identified 14 pesticides and employed multivariate and machine learning techniques—particularly Random Forests (RF)—to automate classification. Readers will learn practical steps in spectral acquisition, spectral comparison across wavelengths, data preprocessing, and implementing machine learning models for real-world chemical monitoring (1).