Development of unsupervised or weakly supervised Deep Learning methods for cloud detection

M-GEO
M-SE
ACQUAL
Staff Involved
M-SE Core knowledge areas
Spatial Information Science (SIS)
Additional Remarks

Suggested elective courses: Advanced Image Analysis, Computer vision related courses

Required skills:

1) Programming skills in python.

2) Willingness to learn deep learning frameworks (TensorFlow, PyTorch)

3) Willingness to learn the manipulation of geographical data in Python (GDAL, geopandas, shapely, rasterio, etc)

Topic description

Clouds usually represent a big problem for optical remote sensing. A wide range of works have been developed in producing efficient cloud detection algorithms. However, most algorithms still depend on quality assurance data provided by image providers. In addition, most of those algorithms generate a considerable quantity of false positives. Those false positives make it harder to develop automated methods for analyzing cloudy regions, frequently generating misobservation problems on clear areas. One of the biggest challenges to generate an effective method for accurately detect clouds on a worldwide basis is the lack of accurate training data encompassing the wide range of land covers and atmospheric conditions. In that sense, unsupervised and weekly supervised Deep Learning methods have demonstrated a good potential to tackle these types of tasks with a suitable accuracy and requiring considerably less amounts of labeled samples. This MSc topic focus on designing and implementing efficient unsupervised or weekly supervised methods that are able to detect clouds in images from different sensors, acquired in different parts of the world, without the use of massive amounts of training labels.

Topic objectives and methodology

The student will initially revise the literature on unsupervised and weekly supervised deep networks, and on cloud detection methods. The main focus will be on methods that are able to compose an efficient end-to-end trained system, and potentially transferable for different regions and atmospheric conditions. Starting points are the weakly supervised methods, that are relatively easier to train, moving later for fully unsupervised methods.

References for further reading

[1] Xie, W.; Yang, J.; Li, Y.; Lei, J.; Zhong, J.; Li, J. Discriminative Feature Learning Constrained Unsupervised Network for Cloud Detection in Remote Sensing Imagery. Remote Sens. 2020, 12, 456 <https://www.mdpi.com/2072-4292/12/3/456>

[2] Li, Yansheng, et al. "Accurate cloud detection in high-resolution remote sensing imagery by weakly supervised deep learning." Remote Sensing of Environment 250 (2020): 112045. <https://www.sciencedirect.com/science/article/pii/S0034425720304156?casa_token=kV8XD8QIFMgAAAAA:U_QjtkbJ4ADAiHf2bSoiSZlxhfoU_EZvQa7bwizDQIzXofy0u1XMPaQctuQrgg-pzh7Klfp1KW0 >

[3] M. U. Rafique, H. Blanton and N. Jacobs, "Weakly Supervised Fusion of Multiple Overhead Images," 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW), Long Beach, CA, USA, 2019, pp. 1479-1486, doi: 10.1109/CVPRW.2019.00189. <http://urafique.com/publication/2019-Fusion-CVPRW>

[4] Meraner, Andrea, et al. "Cloud removal in Sentinel-2 imagery using a deep residual neural network and SAR-optical data fusion." ISPRS Journal of Photogrammetry and Remote Sensing 166 (2020): 333-346. <https://www.sciencedirect.com/science/article/pii/S0924271620301398>