Training link

Description

Remote sensing data is becoming crucial to solve some of the most important environmental problems, especially pertaining to agricultural applications and food security. Effectively working with this large data source requires different tools and processing, such as cloud computing and infrastructure. Participants will become familiar with data format and quality considerations, tools, and techniques to process remote sensing imagery at large scale from publicly available satellite sources, using cloud tools such as AWS S3, Databricks, and Parquet. Additionally, participants will learn how to analyze and train machine learning models for classification using this large source of data to solve environmental problems with a focus on agriculture. Participants will have a basic understanding of tools such as Pyspark and TensorFlow. We hope that participants in this course will walk away with the skills and tools to train algorithms using satellite imagery to solve environmental problems anywhere on the planet.

OPTIONAL: To follow along with the demonstrations for this training, please create an account to login to Databricks prior to the training start date.

Click here for AGENDA.

Registration for Session A

Registration for Session B

Objective

By the end of this training attendees will be able to:

  • Use recommended techniques to download and process remote sensing data from Sentinel-2 and the cropland data layer (CDL) at large scale (> 5GB) with cloud tools (Amazon Web Services [AWS] Simple Storage Service [S3], Databricks, Spark, Parquet)
  • Filter data from both the measured (satellite images) and target (CDL) domains to serve modeling objectives based on quality factors, land classification, area of interest [AOI] overlap, and geographical location.
  • Build training pipelines in TensorFlow to train machine learning algorithms on large scale remote sensing/geospatial datasets for agricultural monitoring
  • Utilize random sampling techniques to build robustness into a predictive algorithm while avoiding information leakage across training/validation/testing splits

Audience

Primary Target Audience: Remote sensing scientists, practitioners, and geospatial analysts from local, regional, federal, and non-governmental organizations who use remote sensing for agricultural applications.

Secondary Target Audience: Agronomists, data scientists/data engineers/ML engineers.

Other Potential Participants: Any practitioners of remote sensing data.

Course Format

Three parts, 1.5 hour each, held twice daily (2 sessions per part).

Sessions

Part 1: Data Preparation of Imagery for Large-Scale ML Modeling

Tuesday, March 5, 2024

Trainers: Sean McCartney

Guest Instructors: John Just (Deere & Co.), Erik Sorensen (Deere & Co.)

  • Identify different types of remote sensing data used in agricultural applications, such as irregular time series, Sentinel-2 tiling grid, CDL, and S3.
  • Apply correct procedure to run Python code in Databricks Community to download and process remote sensing data at large scale (> 5GB) with cloud tools.

Part 2: Data Loaders for Training ML Models on Irregularly-Spaced Time-Series of Imagery

Tuesday, March 12, 2024

Trainers: Sean McCartney

Guest Instructors: John Just (Deere & Co.), Erik Sorensen (Deere & Co.)

  • Follow the process to set up a Tensorflow data loader that works with Parquet files to create a training pipeline suitable for training a model on large-scale data
  • Perform steps to manipulate the imagery data stored in tables, normalize the values, and bucketize irregularly spaced time-series data to prep for modeling
  • Follow steps to parallelize/prefetch preprocessing for fast training
  • Apply the correct procedure to split time-series data into train/val/test sets to avoid data leakage

Part 3: Training & Testing ML Models for Irregularly-Spaced Time Series of Imagery

Tuesday, March 19, 2024

Trainers: Sean McCartney

Guest Instructors: John Just (Deere & Co.), Erik Sorensen (Deere & Co.)

  • Perform the process to set up and train a 1-D convolutional neural network (CNN) model that learns to detect crop-type from a satellite image
  • Follow steps to monitor model performance during training and how to choose appropriate hyperparameter adjustments
  • Plot predictions to validate performance after training

Prerequisites

Training link
Remote Sensing