TY - JOUR
T1 - GMMDA
T2 - Gaussian Mixture Model-Based Generative Domain Adaptive Semantic Segmentation for Remote Sensing Images
AU - Hu, Yongkang
AU - Yu, Xiaogang
AU - Wang, Yupei
AU - Chen, Liang
N1 - Publisher Copyright:
© 1980-2012 IEEE.
PY - 2026
Y1 - 2026
N2 - Unsupervised domain adaptation (UDA) for semantic segmentation transfers knowledge from an annotated source domain to an unlabeled target domain, reducing the cost of pixel-level annotation. Most existing methods rely on dense discriminative classifiers that estimate pixel-wise class posterior probabilities using a single weight vector per class. However, in remote sensing imagery, intraclass variability often gives rise to multipeaked feature distributions with multiple subclusters, which may not be adequately captured by a single weight vector, leading to intraclass confusion. Moreover, such discriminative classifiers primarily focus on learning class decision boundaries, while the consistency of same-class subclusters across domains is only weakly constrained. Under domain shift, these subclusters may drift inconsistently, thereby aggravating cross-domain structural mismatch. To this end, we propose GMMDA, a Gaussian mixture model (GMM)-based generative domain adaptation method that predicts pixel labels through Bayesian inference based on class-conditional feature likelihoods. Specifically, we fit a class-wise GMM using an online momentum Sinkhorn EM procedure to model class-conditional feature densities, where each Gaussian component corresponds to an intraclass subcluster, enabling a richer characterization of multipeaked distributions. Furthermore, component-aware contrastive learning (CCL) treats Gaussian components as fine-grained semantic References, pulling target-domain features toward their best-matched components using a variance-aware distance that accounts for component scales. In addition, we introduce componentwise distribution alignment (CDA) to align each source component with the corresponding source-guided target local statistics by jointly constraining their means and principal directions, aiming to reduce cross-domain structural mismatch. Experimental results show that GMMDA achieves competitive mean intersection over union (mIoU) scores on the international society for photogrammetry and remote sensing (ISPRS) and LoveDA benchmarks compared with existing methods.
AB - Unsupervised domain adaptation (UDA) for semantic segmentation transfers knowledge from an annotated source domain to an unlabeled target domain, reducing the cost of pixel-level annotation. Most existing methods rely on dense discriminative classifiers that estimate pixel-wise class posterior probabilities using a single weight vector per class. However, in remote sensing imagery, intraclass variability often gives rise to multipeaked feature distributions with multiple subclusters, which may not be adequately captured by a single weight vector, leading to intraclass confusion. Moreover, such discriminative classifiers primarily focus on learning class decision boundaries, while the consistency of same-class subclusters across domains is only weakly constrained. Under domain shift, these subclusters may drift inconsistently, thereby aggravating cross-domain structural mismatch. To this end, we propose GMMDA, a Gaussian mixture model (GMM)-based generative domain adaptation method that predicts pixel labels through Bayesian inference based on class-conditional feature likelihoods. Specifically, we fit a class-wise GMM using an online momentum Sinkhorn EM procedure to model class-conditional feature densities, where each Gaussian component corresponds to an intraclass subcluster, enabling a richer characterization of multipeaked distributions. Furthermore, component-aware contrastive learning (CCL) treats Gaussian components as fine-grained semantic References, pulling target-domain features toward their best-matched components using a variance-aware distance that accounts for component scales. In addition, we introduce componentwise distribution alignment (CDA) to align each source component with the corresponding source-guided target local statistics by jointly constraining their means and principal directions, aiming to reduce cross-domain structural mismatch. Experimental results show that GMMDA achieves competitive mean intersection over union (mIoU) scores on the international society for photogrammetry and remote sensing (ISPRS) and LoveDA benchmarks compared with existing methods.
KW - Contrastive learning
KW - distribution alignment
KW - generative model
KW - unsupervised domain adaptation (UDA) for semantic segmentation
UR - https://www.scopus.com/pages/publications/105045197889
U2 - 10.1109/TGRS.2026.3712559
DO - 10.1109/TGRS.2026.3712559
M3 - Article
AN - SCOPUS:105045197889
SN - 0196-2892
VL - 64
JO - IEEE Transactions on Geoscience and Remote Sensing
JF - IEEE Transactions on Geoscience and Remote Sensing
M1 - 5633118
ER -