Categories
Nevin Manimala Statistics

Knowledge-Based Feature Selection Substantially Enhances Data-Driven Wastewater Treatment Modeling

Environ Sci Technol. 2026 Jul 12. doi: 10.1021/acs.est.6c04963. Online ahead of print.

ABSTRACT

Data-driven modeling in wastewater treatment is increasingly constrained by the reality of small, high-dimensional data, where the abundant monitoring parameters in small-sized data sets obscure fundamental mechanistic understandings. This study proposes a knowledge-driven feature selection framework that integrates mechanistic insights with statistical correlations to identify the most informative predictive features. Using nitrous oxide (N2O) emission prediction at a full-scale plant as a case study, we compared classic deep-learning feature selection algorithms using attention mechanisms against two new knowledge-based approaches: (i) expert-guided feature selection and (ii) large language model (LLM)-augmented feature selection. Expert-knowledge-guided feature selection substantially enhances predictive accuracy, achieving a mean R2 of 0.723 and an MAE of 0.033, compared to R2 = 0.712 and MAE = 0.033 for the best-performing attention-based architecture. More importantly, the proposed framework markedly improves model generalizability: under out-of-distribution high-flow conditions where the attention-based model fails to capture N2O emission patterns, the expert-selected model continues to reproduce the dominant temporal dynamics of N2O emissions. The LLM-assisted approach also delivers competitive accuracy (mean R2 = 0.596, MAE = 0.041) and similarly preserves generalizability under an input distributional shift. By introducing mechanistic understanding into the feature selection process, this framework offers a generalizable pathway for addressing complex wastewater treatment challenges while maintaining a computational efficiency.

PMID:42437349 | DOI:10.1021/acs.est.6c04963

By Nevin Manimala

Portfolio Website for Nevin Manimala