Vision transformers to model land surface phenology

GIMA
M-GEO
M-SE
STAMP
M-SE Core knowledge areas
Spatial Information Science (SIS)
Technical Engineering (TE)
Additional Remarks

Good knowledge of Python programming language will be helpful for this MSc topic.

Staff Involved: Mahdi Farnaghi, Raul Zurita Milla, Mahdi Khodadadzadeh

Topic description

To develop a model to estimate the timing of phenological events over large areas from time series of earth observation data using vision transformers, a fierce alternative to traditional deep learning approaches.

Keywords

Land surface phenology, Deep Learning, Convolutional Neural Networks, Vision Transformers (ViT), Earth Observation

Topic objectives and methodology

Description

Climate change is modifying different aspects of life on the planet Earth. The continuous rise in global temperatures and weather patterns affects the distribution of plants and the timing of their main biological events (e.g., leafing and blooming). Phenology is the science that studies the timing of these events and their deriving forces in association with environmental phenomena. This project aims to exploit the power of state-of-the-art Deep Learning (DL) algorithms to facilitate the process of understanding phenological events from geospatial data gathered by Earth Observation (EO) satellites.

You will develop models to learn the relationships between phenological events and open-access EO data time series. Considering the complexity and diverse structure of phenological data, the direct adaptation of the existing DL models for analyzing such data is challenging. This topic aims at carefully selecting and modifying the state-of-the-art Vision Transformers (ViT) [1] and applying a suitable data representation. Your model will be checked against convolutional neural networks (CNNs) as the de-facto DL algorithm for EO-based information extraction [1]. You will also compare your model's output with the land surface phenology maps produced based on secondary EO products [2].

By estimating the timing of phenological events over large areas, you will contribute to a better understanding of (future) phenological changes and analyze the impact of climate change on plants.

Dataset

The following data sources will be used in this research

Workflow

The workflow of the MSc thesis will be as follows.

  1. A literature review
  2. Dataset generation
  3. Model development, validation and tuning
  4. Evaluation
References for further reading

[1]          Mai, G., Janowicz, K., Hu, Y., Gao, S., Yan, B., Zhu, R., Cai, L., and Lao, N. (2022). A review of location encoding for GeoAI: methods and applications. International Journal of Geographical Information Science, 36(4), 639-673.

[2]          Tian, F., Cai, Z., Jin, H., Hufkens, K., Scheifinger, H., Tagesson, T., Smets, B., Van Hoolst, R., Bonte, K., Ivits, E., Tong, X., Ardö, J., and Eklundh, L. (2021). Calibrating vegetation phenology from Sentinel-2 using eddy covariance, PhenoCam, and PEP725 networks across Europe. Remote Sensing of Environment, 260, 112456.

[3]          Kladny, K.-R., Milanta, M., Mraz, O., Hufkens, K., and Stocker, B. D. (2022). Deep learning for satellite image forecasting of vegetation greenness. Cold Spring Harbor Laboratory. Retrieved from https://dx.doi.org/10.1101/2022.08.16.504173

[4]          Bakayov, V., Goncalves, R., Zurita-Milla, R., and Izquierdo-Verdiguier, E. A Spark-Based Platform to Extract Phenological Information from Satellite Images.