Search engine for discovering works of Art, research articles, and books related to Art and Culture
ShareThis
Javascript must be enabled to continue!

Heterogeneous Graph Contrastive Masked Autoencoder

View through CrossRef
Contrastive Learning (CL) and Masked Autoencoder (MAE) methods have been widely applied to Self-Supervised Learning (SSL) for Heterogeneous Graphs (HGs). However, existing graph MAE methods mainly focus on reconstructing node features and topological structures, while lacking the ability to perceive high-order semantic information, which limits the discriminative power of the learned representations. To address this issue, this paper proposes a novel SSL framework, termed Heterogeneous Graph Contrastive Masked Autoencoder (HGCMAE), to enhance the representational discriminability of traditional MAE-based methods. HGCMAE consists of four core modules, namely a hierarchical masking module, a generative branch, a contrastive branch, and a joint optimization module. Specifically, the hierarchical masking module applies controllable multi-level masking to node attributes and meta-path-based adjacency matrices, thereby simulating realistic data incompleteness while preserving sufficient local cues for reconstruction. Based on these masked views, the generative branch reconstructs masked node attributes and meta-path-induced subgraphs from adaptive semantic embeddings, thereby preserving relation-aware semantic feature interactions. Meanwhile, the contrastive branch leverages coherent structural embeddings to enforce cross-view consistency under topology-aware structural dependencies across meta-path-induced graphs. Finally, the joint optimization module jointly constrains the two branches under the guidance of cross-view high-order semantic correlations and dynamically balances the generative and contrastive objectives. Experimental results on four real-world HG datasets demonstrate that HGCMAE achieves competitive performance in node classification and clustering tasks.
Title: Heterogeneous Graph Contrastive Masked Autoencoder
Description:
Contrastive Learning (CL) and Masked Autoencoder (MAE) methods have been widely applied to Self-Supervised Learning (SSL) for Heterogeneous Graphs (HGs).
However, existing graph MAE methods mainly focus on reconstructing node features and topological structures, while lacking the ability to perceive high-order semantic information, which limits the discriminative power of the learned representations.
To address this issue, this paper proposes a novel SSL framework, termed Heterogeneous Graph Contrastive Masked Autoencoder (HGCMAE), to enhance the representational discriminability of traditional MAE-based methods.
HGCMAE consists of four core modules, namely a hierarchical masking module, a generative branch, a contrastive branch, and a joint optimization module.
Specifically, the hierarchical masking module applies controllable multi-level masking to node attributes and meta-path-based adjacency matrices, thereby simulating realistic data incompleteness while preserving sufficient local cues for reconstruction.
Based on these masked views, the generative branch reconstructs masked node attributes and meta-path-induced subgraphs from adaptive semantic embeddings, thereby preserving relation-aware semantic feature interactions.
Meanwhile, the contrastive branch leverages coherent structural embeddings to enforce cross-view consistency under topology-aware structural dependencies across meta-path-induced graphs.
Finally, the joint optimization module jointly constrains the two branches under the guidance of cross-view high-order semantic correlations and dynamically balances the generative and contrastive objectives.
Experimental results on four real-world HG datasets demonstrate that HGCMAE achieves competitive performance in node classification and clustering tasks.

Related Results

Graph convolutional neural networks for 3D data analysis
Graph convolutional neural networks for 3D data analysis
(English) Deep Learning allows the extraction of complex features directly from raw input data, eliminating the need for hand-crafted features from the classical Machine Learning p...
Graph data warehousing
Graph data warehousing
Over the last decade, we have witnessed the emergence of networks in a wide spectrum of application domains, ranging from social and information networks to biological and transpor...
Teoretyczne badania konfrontatywne
Teoretyczne badania konfrontatywne
Theoretical contrastive studiesThe contrastive studies criticism in the 60s – 70s of the 20th century was the only basis for quite a few researchers to formulate their opinion on t...
Hypertension-mediated organ damage in masked hypertension
Hypertension-mediated organ damage in masked hypertension
Objectives: Masked hypertension – a blood pressure (BP) phenotype characterized by a clinic BP in the normal range but elevated BP outside the office – is associated wi...
Self-Supervised Heterogeneous Graph Neural Network with Multi-Scale Meta-Path Contrastive Learning
Self-Supervised Heterogeneous Graph Neural Network with Multi-Scale Meta-Path Contrastive Learning
Abstract Heterogeneous graph neural networks (HGNNs) exhibit remarkable capabilities in modeling complex structures and multi-semantic information. However, existing method...

Back to Top