Presenters-0555

From CSDMS


Image Segmentation using Deep Learning and Human-In-the-Loop Machine Learning



Daniel Buscombe

Marda Science, United States
daniel@mardascience.com
Evan Goldstein The University of North Carolina at Greensboro United States


Abstract
Segmentation, or the classification of pixels (grid cells) in imagery, is ubiquitously applied in the natural sciences. An example close to the CSDMS community might be translating images of earth surface into arrays of land cover to be used as model initial conditions, or to test model output. Manual segmentation is often prohibitively time-consuming, especially when images have significant spatial heterogeneity of colors or textures.

This Clinic is focused on demonstrating a machine learning method for image segmentation using two software tools: The first is “Doodler”, a fast, semi-automated, method for interactive segmentation of N-dimensional (x,y,N) images into two-dimensional (x,y) label images. It uses human-in-the-loop ML to achieve consensus between the labeler and a model in an iterative workflow. Second, we will demonstrate Segmentation Zoo, a python toolbox to segment imagery with a variety of deep learning models that uses output from Doodler with existing models, or train entirely new models.

Ideally the clinic will be divided into two separate days. Day 1 would be a short introductory lecture, a live code demo, and then homework — participants will doodle imagery to gain familiarity with the software and create training data for a segmentation model. Day 2 would be a short introductory lecture on machine learning, and a live code demo for how to use doodled images in Segmentation Zoo (i.e., the images that participants doodled).

There are two concrete goals for the clinic: 1) demonstrate how participants can use these two tools, and; 2) a group authored dataset of doodled images that will be placed in a Zenodo repository with all participants who contribute as coauthors.

Doodler preprint: https://doi.org/10.31223/X59K83

Doodler repository: https://github.com/dbuscombe-usgs/dash_doodler

Doodler Website: https://dbuscombe-usgs.github.io/dash_doodler/

Segmentation Zoo repository: https://github.com/dbuscombe-usgs/segmentation_zoo

Please acknowledge the original contributors when you are using this material. If there are any copyright issues, please let us know (CSDMSweb@colorado.edu) and we will respond as soon as possible.

Of interest for:
  • Terrestrial Working Group
  • Coastal Working Group
  • Marine Working Group
  • Education and Knowledge Transfer (EKT) Working Group
  • Cyberinformatics and Numerics Working Group
  • Hydrology Focus Research Group
  • Chesapeake Focus Research Group
  • Critical Zone Focus Research Group
  • Human Dimensions Focus Research Group
  • Geodynamics Focus Research Group
  • Ecosystem Dynamics Focus Research Group
  • Coastal Vulnerability Initiative
  • Continental Margin Initiative
  • Artificial Intelligence & Machine Learning Initiative
  • Modeling Platform Interoperability Initiative
  • River Network Modeling Initiative