A VMamba-Based Spatial–Spectral Fusion Network for Remote Sensing Image Classification

Lan Luo, Yanmei Zhang*, Yanbing Xu, Tingxuan Yue, Yuxi Wang

*此作品的通讯作者

科研成果: 期刊稿件文章同行评审

摘要

In hyperspectral (HS) and light detection and ranging (LiDAR) collaborative classification, HS provides rich spectral information, while LiDAR offers unique elevation data. However, existing methods often focus on feature extraction within individual modalities before fusion, which may bring about insufficient fusion due to a lack of intermodal complementarity and interaction. To address this, we propose a framework for HS and LiDAR fusion classification based on the VMamba model, called SSFN, which includes a dual supplement network (DSN) and a VMamba-based integration network (VMIN), modeling long-range dependencies and fully leveraging the correlation and complementarity of heterogeneous information. The DSN, comprising a spatial supplement network (Spa-SN) and a spectral supplement network (Spe-SN), is devised to supplement missing features for each modality. The Spa-SN complements the spatial features of HS by capturing spatial correlations between LiDAR and HS, and the Spe-SN employs spectral information from HS to compensate for the spectral features missing in LiDAR. Thus, both HS and LiDAR have a comprehensive spatial–spectral description. The VMIN is then utilized for augmentation and interaction of supplemented features, and discriminative features are adaptively selected for classification. Extensive experiments on three benchmark datasets demonstrate that our method outperforms multiple state-of-the-art methods and needs the fewest parameters.

源语言英语
页(从-至)14115-14131
页数17
期刊IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing
18
DOI
出版状态已出版 - 2025

指纹

探究 'A VMamba-Based Spatial–Spectral Fusion Network for Remote Sensing Image Classification' 的科研主题。它们共同构成独一无二的指纹。

引用此