TY - JOUR
T1 - Deep learning-based efficient drone-borne sensing of cyanobacterial blooms using a clique-based feature extraction approach
AU - Shin, Jihoon
AU - Lee, Gunhyeong
AU - Kim, Tae Ho
AU - Cho, Kyung Hwa
AU - Hong, Seok Min
AU - Kwon, Do Hyuck
AU - Pyo, Jong Cheol
AU - Cha, Yoon Kyung
N1 - Publisher Copyright:
© 2023 Elsevier B.V.
PY - 2024/2/20
Y1 - 2024/2/20
N2 - Recent advances in remote sensing techniques provide a new horizon for monitoring the spatiotemporal variations of harmful algal blooms (HABs) using hyperspectral data in inland water. In this study, a hierarchical concatenated variational autoencoder (HCVAE) is proposed as an efficient and accurate deep learning (DL) based bio-optical model. To demonstrate its usefulness in retrieving algal pigments, the HCVAE is applied to bloom-prone regions in Daecheong Lake, South Korea. By abstracting the similarity between highly related features using layer-wise clique-based latent-feature extraction, HCVAE reduces the computational loads in deriving outputs while preventing performance degradation. Graph-based clique-detection uses information theory-based criteria to group the related reflectance spectra. Consequently, six latent features were extracted from 79 spectral bands to consist of a multilevel hierarchy of HCVAE that can simultaneously estimate concentrations of chlorophyll-a (Chl-a) and phycocyanin (PC). Despite the parsimonious model architecture, the Chl-a and PC concentrations estimated by HCVAE closely agree with the measured concentrations, with test R2 values of 0.76 and 0.82, respectively. In addition, spatial distribution maps of algal pigments obtained from HCVAE using drone-borne reflectance successfully capture the blooming spots. Based on its multilevel hierarchical architecture, HCVAE can provide the importance of latent features along with their individual wavelengths using Shapley additive explanations. The most important latent features covered the spectral regions associated with both Chl-a and PC. The lightweight neural network DNNsel, which uses only the spectral bands of highest importance in latent-feature extraction, performed comparably to HCVAE. The study results demonstrate the utility of the multilevel hierarchical architecture as a comprehensive assessment model for near-real-time drone-borne sensing of HABs. Moreover, HCVAE is applicable to a wide range of environmental big data, as it can handle numerous sets of features.
AB - Recent advances in remote sensing techniques provide a new horizon for monitoring the spatiotemporal variations of harmful algal blooms (HABs) using hyperspectral data in inland water. In this study, a hierarchical concatenated variational autoencoder (HCVAE) is proposed as an efficient and accurate deep learning (DL) based bio-optical model. To demonstrate its usefulness in retrieving algal pigments, the HCVAE is applied to bloom-prone regions in Daecheong Lake, South Korea. By abstracting the similarity between highly related features using layer-wise clique-based latent-feature extraction, HCVAE reduces the computational loads in deriving outputs while preventing performance degradation. Graph-based clique-detection uses information theory-based criteria to group the related reflectance spectra. Consequently, six latent features were extracted from 79 spectral bands to consist of a multilevel hierarchy of HCVAE that can simultaneously estimate concentrations of chlorophyll-a (Chl-a) and phycocyanin (PC). Despite the parsimonious model architecture, the Chl-a and PC concentrations estimated by HCVAE closely agree with the measured concentrations, with test R2 values of 0.76 and 0.82, respectively. In addition, spatial distribution maps of algal pigments obtained from HCVAE using drone-borne reflectance successfully capture the blooming spots. Based on its multilevel hierarchical architecture, HCVAE can provide the importance of latent features along with their individual wavelengths using Shapley additive explanations. The most important latent features covered the spectral regions associated with both Chl-a and PC. The lightweight neural network DNNsel, which uses only the spectral bands of highest importance in latent-feature extraction, performed comparably to HCVAE. The study results demonstrate the utility of the multilevel hierarchical architecture as a comprehensive assessment model for near-real-time drone-borne sensing of HABs. Moreover, HCVAE is applicable to a wide range of environmental big data, as it can handle numerous sets of features.
KW - Algal pigment
KW - Drone-borne sensing
KW - Explainable artificial intelligence
KW - Hyperspectral imagery
KW - Latent-feature extraction
KW - Variational autoencoder
UR - http://www.scopus.com/inward/record.url?scp=85181108974&partnerID=8YFLogxK
U2 - 10.1016/j.scitotenv.2023.169540
DO - 10.1016/j.scitotenv.2023.169540
M3 - Article
C2 - 38145679
AN - SCOPUS:85181108974
SN - 0048-9697
VL - 912
JO - Science of the Total Environment
JF - Science of the Total Environment
M1 - 169540
ER -