Javascript must be enabled to continue!
Heterogeneous Graph Contrastive Masked Autoencoder
View through CrossRef
Contrastive Learning (CL) and Masked Autoencoder (MAE) methods have been widely applied to Self-Supervised Learning (SSL) for Heterogeneous Graphs (HGs). However, existing graph MAE methods mainly focus on reconstructing node features and topological structures, while lacking the ability to perceive high-order semantic information, which limits the discriminative power of the learned representations. To address this issue, this paper proposes a novel SSL framework, termed Heterogeneous Graph Contrastive Masked Autoencoder (HGCMAE), to enhance the representational discriminability of traditional MAE-based methods. HGCMAE consists of four core modules, namely a hierarchical masking module, a generative branch, a contrastive branch, and a joint optimization module. Specifically, the hierarchical masking module applies controllable multi-level masking to node attributes and meta-path-based adjacency matrices, thereby simulating realistic data incompleteness while preserving sufficient local cues for reconstruction. Based on these masked views, the generative branch reconstructs masked node attributes and meta-path-induced subgraphs from adaptive semantic embeddings, thereby preserving relation-aware semantic feature interactions. Meanwhile, the contrastive branch leverages coherent structural embeddings to enforce cross-view consistency under topology-aware structural dependencies across meta-path-induced graphs. Finally, the joint optimization module jointly constrains the two branches under the guidance of cross-view high-order semantic correlations and dynamically balances the generative and contrastive objectives. Experimental results on four real-world HG datasets demonstrate that HGCMAE achieves competitive performance in node classification and clustering tasks.
Title: Heterogeneous Graph Contrastive Masked Autoencoder
Description:
Contrastive Learning (CL) and Masked Autoencoder (MAE) methods have been widely applied to Self-Supervised Learning (SSL) for Heterogeneous Graphs (HGs).
However, existing graph MAE methods mainly focus on reconstructing node features and topological structures, while lacking the ability to perceive high-order semantic information, which limits the discriminative power of the learned representations.
To address this issue, this paper proposes a novel SSL framework, termed Heterogeneous Graph Contrastive Masked Autoencoder (HGCMAE), to enhance the representational discriminability of traditional MAE-based methods.
HGCMAE consists of four core modules, namely a hierarchical masking module, a generative branch, a contrastive branch, and a joint optimization module.
Specifically, the hierarchical masking module applies controllable multi-level masking to node attributes and meta-path-based adjacency matrices, thereby simulating realistic data incompleteness while preserving sufficient local cues for reconstruction.
Based on these masked views, the generative branch reconstructs masked node attributes and meta-path-induced subgraphs from adaptive semantic embeddings, thereby preserving relation-aware semantic feature interactions.
Meanwhile, the contrastive branch leverages coherent structural embeddings to enforce cross-view consistency under topology-aware structural dependencies across meta-path-induced graphs.
Finally, the joint optimization module jointly constrains the two branches under the guidance of cross-view high-order semantic correlations and dynamically balances the generative and contrastive objectives.
Experimental results on four real-world HG datasets demonstrate that HGCMAE achieves competitive performance in node classification and clustering tasks.
Related Results
Graph convolutional neural networks for 3D data analysis
Graph convolutional neural networks for 3D data analysis
(English) Deep Learning allows the extraction of complex features directly from raw input data, eliminating the need for hand-crafted features from the classical Machine Learning p...
Graph data warehousing
Graph data warehousing
Over the last decade, we have witnessed the emergence of networks in a wide spectrum of application domains, ranging from social and information networks to biological and transpor...
Teoretyczne badania konfrontatywne
Teoretyczne badania konfrontatywne
Theoretical contrastive studiesThe contrastive studies criticism in the 60s – 70s of the 20th century was the only basis for quite a few researchers to formulate their opinion on t...
Bilangan Terhubung Titik Pelangi pada Graf Garis dan Graf Tengah dari Hasil Operasi Comb Graf Bintang C<sub>3</sub> dan Graf Bintang S<sub>n</sub>
Bilangan Terhubung Titik Pelangi pada Graf Garis dan Graf Tengah dari Hasil Operasi Comb Graf Bintang C<sub>3</sub> dan Graf Bintang S<sub>n</sub>
Penelitian ini bertujuan menentukan bilangan terhubung titik pelangi (rainbow vertex connection number) pada graf garis dan graf tengah yang diperoleh dari hasil operasi comb antar...
Hypertension-mediated organ damage in masked hypertension
Hypertension-mediated organ damage in masked hypertension
Objectives:
Masked hypertension – a blood pressure (BP) phenotype characterized by a clinic BP in the normal range but elevated BP outside the office – is associated wi...
Self-Supervised Heterogeneous Graph Neural Network with Multi-Scale Meta-Path Contrastive Learning
Self-Supervised Heterogeneous Graph Neural Network with Multi-Scale Meta-Path Contrastive Learning
Abstract
Heterogeneous graph neural networks (HGNNs) exhibit remarkable capabilities in modeling complex structures and multi-semantic information. However, existing method...
Dimensionality Reduction and Denoising of Spatial Transcriptomics Data Using Dual-Channel Masked Graph Autoencoder
Dimensionality Reduction and Denoising of Spatial Transcriptomics Data Using Dual-Channel Masked Graph Autoencoder
Abstract
Recent advances in spatial transcriptomics (ST) technology allow researchers to comprehensively measure gene expression patterns at the ...
Self-supervised pre-training with contrastive and masked autoencoder methods for dealing with small datasets in deep learning for medical imaging
Self-supervised pre-training with contrastive and masked autoencoder methods for dealing with small datasets in deep learning for medical imaging
AbstractDeep learning in medical imaging has the potential to minimize the risk of diagnostic errors, reduce radiologist workload, and accelerate diagnosis. Training such deep lear...

