Improving semantic segmentation accuracy in thin cloud interference scenarios by mixing simulated cloud-covered samples

Haoyu Wang, Junli Li, Zhanfeng Shen, Zihan Zhang, Linze Bai, Ruifeng Li, Chenghu Zhou, Philippe De Maeyer, Tim Van de Voorde

Research output: Contribution to journalArticlepeer-review

1 Citation (Scopus)
41 Downloads (Pure)

Abstract

Thin cloud interference presents a significant challenge for the semantic segmentation of optical satellite imagery, which directly degrades the model accuracy and causes difficulties in sample selection. This paper generated a dataset named Populus euphratica and Tamarix chinensis discrimination (PTD), containing both cloudless and thin cloud scenarios. Based on this PTD dataset, an enhanced Atmospheric Scattering Model with Nonlinear Optimization (ASM_NL) was proposed to simulate high-fidelity thin clouds by incorporating two vital nonlinear terms: the point spread function and the Perlin noise. Additionally, we adopt a strategy of mixing simulated thin cloud-covered images (STCI) into the training set at a certain proportion to improve the semantic segmentation accuracy in thin cloud-covered scenarios. The conclusions are as follows: 1) ASM_NL can simulate high-fidelity clouds at an average Jensen-Shannon distance of 0.0699. 2) When dealing with medium- and high-cloud density datasets, mixing STCI proved to be more effective than cloud removal in mitigating thin cloud interference, resulting in average macro F1 score improvements of 0.164 and 0.094, respectively. 3) The semantic segmentation accuracy improved significantly by mixing STCI with a minimal proportion of 1/60, demonstrating the activation of model transfer capabilities. This study provides a concise and efficient methodology for effectively mitigating thin cloud interference in deep learning-based optical satellite imagery analysis.

Original languageEnglish
Article number104087
Number of pages13
JournalInternational Journal of Applied Earth Observation and Geoinformation
Volume133
DOIs
Publication statusPublished - 13 Aug 2024

Bibliographical note

Publisher Copyright:
© 2024 The Author(s)

Keywords

  • Atmospheric scattering model
  • Cloud simulation
  • Data augmentation
  • Semantic segmentation
  • Thin cloud interference

Fingerprint

Dive into the research topics of 'Improving semantic segmentation accuracy in thin cloud interference scenarios by mixing simulated cloud-covered samples'. Together they form a unique fingerprint.

Cite this