Skip to main navigation Skip to search Skip to main content

GCL-GroW: Graph contrastive learning via group whitening

  • Beijing Institute of Technology
  • Jilin University

Research output: Contribution to journal › Article › peer-review

Abstract

Graph Neural Networks (GNNs) effectively learn from graph structures, but their performance is constrained by scarce labeled data. Graph contrastive learning (GCL) techniques address this limitation through maximizing the mutual information of two views of the input graph, effectively reducing reliance on labeled data. Nevertheless, existing GCL methods face two main drawbacks: the use of negative samples increases training burden, while relying solely on positive samples often compels the introduction of intricate architectures. To overcome these issues, we propose a novel approach called Graph Contrastive Learning via Group Whitening (GCL-GroW), which is the first to apply feature group whitening and consistency loss to address two fundamental goals in GCL: uniformity and alignment. To ensure uniformity, we apply Zero-Phase Component Analysis (ZCA) group whitening to the positive samples, aiming to reduce feature correlations and avoid dimension collapse, in which all sample representations converge to a single point. To achieve alignment, we use the consistency loss among positive samples, as it encourages the model to generate similar representations for these samples, thereby reducing their distance in the feature space. Notably, GCL-GroW delivers these achievements without relying on asymmetric networks, projection layers, gradient halting, or complex loss functions. Extensive experiments demonstrate that GCL-GroW not only achieves competitive accuracy in node and graph classification tasks across multiple datasets, but also reduces training time and memory, validating its superiority over existing state-of-the-art methods. The code is available at: https://github.com/zhangchunhui2024/GCL-GroW.

Original languageEnglish
Article number112757
JournalPattern Recognition
Volume172
DOIs
Publication statusPublished - Apr 2026

Keywords

  • Contrastive learning
  • Graph neural networks
  • Graph representation learning
  • Group whitening

Fingerprint

Dive into the research topics of 'GCL-GroW: Graph contrastive learning via group whitening'. Together they form a unique fingerprint.

Cite this

Baidu
map