Search engine for discovering works of Art, research articles, and books related to Art and Culture
ShareThis
Javascript must be enabled to continue!

KGE–SwinFpn: Knowledge Graph Embedding in Swin Feature Pyramid Networks for Accurate Landslide Segmentation in Remote Sensing Images

View through CrossRef
Landslide disasters are complex spatiotemporal phenomena. Existing deep learning (DL) models for remote sensing (RS) image analysis primarily exploit shallow visual features, inadequately incorporating critical geological, geographical, and environmental knowledge. This limitation impairs detection accuracy and generalization, especially in complex terrains and diverse vegetation conditions. We propose Knowledge Graph Embedding in Swin Feature Pyramid Networks (KGE–SwinFpn), a novel RS landslide segmentation framework that integrates explicit domain knowledge with deep features. First, a comprehensive landslide knowledge graph is constructed, organizing multi-source factors (e.g., lithology, topography, hydrology, rainfall, land cover, etc.) into entities and relations that characterize controlling, inducing, and indicative patterns. A dedicated KGE Block learns embeddings for these entities and discretized factor levels from the landslide knowledge graph, enabling their fusion with multi-scale RS features in SwinFpn. This approach preserves the efficiency of automatic feature learning while embedding prior knowledge guidance, enhancing data–knowledge–model coupling. Experiments demonstrate significant outperformance over classic segmentation networks: on the Yuan-yang dataset, KGE–SwinFpn achieved 96.85% pixel accuracy (PA), 88.46% mean pixel accuracy (MPA), and 82.01% mean intersection over union (MIoU); on the Bijie dataset, it attained 96.28% PA, 90.72% MPA, and 84.47% MIoU. Ablation studies confirm the complementary roles of different knowledge features and the KGE Block’s contribution to robustness in complex terrains. Notably, the KGE Block is architecture-agnostic, suggesting broad applicability for knowledge-guided RS landslide detection and promising enhanced technical support for disaster monitoring and risk assessment.
Title: KGE–SwinFpn: Knowledge Graph Embedding in Swin Feature Pyramid Networks for Accurate Landslide Segmentation in Remote Sensing Images
Description:
Landslide disasters are complex spatiotemporal phenomena.
Existing deep learning (DL) models for remote sensing (RS) image analysis primarily exploit shallow visual features, inadequately incorporating critical geological, geographical, and environmental knowledge.
This limitation impairs detection accuracy and generalization, especially in complex terrains and diverse vegetation conditions.
We propose Knowledge Graph Embedding in Swin Feature Pyramid Networks (KGE–SwinFpn), a novel RS landslide segmentation framework that integrates explicit domain knowledge with deep features.
First, a comprehensive landslide knowledge graph is constructed, organizing multi-source factors (e.
g.
, lithology, topography, hydrology, rainfall, land cover, etc.
) into entities and relations that characterize controlling, inducing, and indicative patterns.
A dedicated KGE Block learns embeddings for these entities and discretized factor levels from the landslide knowledge graph, enabling their fusion with multi-scale RS features in SwinFpn.
This approach preserves the efficiency of automatic feature learning while embedding prior knowledge guidance, enhancing data–knowledge–model coupling.
Experiments demonstrate significant outperformance over classic segmentation networks: on the Yuan-yang dataset, KGE–SwinFpn achieved 96.
85% pixel accuracy (PA), 88.
46% mean pixel accuracy (MPA), and 82.
01% mean intersection over union (MIoU); on the Bijie dataset, it attained 96.
28% PA, 90.
72% MPA, and 84.
47% MIoU.
Ablation studies confirm the complementary roles of different knowledge features and the KGE Block’s contribution to robustness in complex terrains.
Notably, the KGE Block is architecture-agnostic, suggesting broad applicability for knowledge-guided RS landslide detection and promising enhanced technical support for disaster monitoring and risk assessment.

Related Results

Multiple surface segmentation using novel deep learning and graph based methods
Multiple surface segmentation using novel deep learning and graph based methods
<p>The task of automatically segmenting 3-D surfaces representing object boundaries is important in quantitative analysis of volumetric images, which plays a vital role in nu...
Meteorological drivers of seasonal motion at the Barry Arm Landslide, Prince William Sound, Alaska
Meteorological drivers of seasonal motion at the Barry Arm Landslide, Prince William Sound, Alaska
Global climate change creates geologic hazard cascades as the cryosphere experiences warming. The rapid retreat of Barry Glacier, a tidewater glacier in Prince William Sound, Alask...
GCN Embedding Swin-Unet for Forest Remote Sensing Image Semantic Segmentation
GCN Embedding Swin-Unet for Forest Remote Sensing Image Semantic Segmentation
Forest resources are among the most important ecosystems on the earth. The semantic segmentation and accurate positioning of ground objects in forest remote sensing (RS) imagery ar...
“Fusion network with attention for landslide detection. Application to Bijie landslide open dataset”
“Fusion network with attention for landslide detection. Application to Bijie landslide open dataset”
Remote sensing techniques are now widely spread for the early detection of ground deformation, implementation of warning systems in case of imminent landslide triggering, and mediu...
Leveraging Near Real-Time Remote Sensing and Explainable AI for Rapid Landslide Detection: A Case Study in Greece
Leveraging Near Real-Time Remote Sensing and Explainable AI for Rapid Landslide Detection: A Case Study in Greece
Landslides, triggered by severe rainfall events, pose significant risks to both life and infrastructure. Timely and accurate detection of such landslides is crucial for effective d...
Comparing the performance of Machine Learning Methods in landslide susceptibility modelling
Comparing the performance of Machine Learning Methods in landslide susceptibility modelling
Landslide phenomena are considered as one of the most significant geohazards with a great impact on the man-made and natural environment. If one search the scientific literature, t...
Landslide hydro-meteorological thresholds in Rwanda
Landslide hydro-meteorological thresholds in Rwanda
&lt;p&gt;For the development of regional landslide early warning systems, empirical-statistical thresholds are of crucial importance. The thresholds indicate the meteorolog...

Back to Top