segment-geospatial

A Python package for segmenting geospatial data with the Segment Anything Model (SAM)

Introduction

The segment-geospatial package draws its inspiration from segment-anything-eo repository authored by Aliaksandr Hancharenka. To facilitate the use of the Segment Anything Model (SAM) for geospatial data, I have developed the segment-anything-py and segment-geospatial Python packages, which are now available on PyPI and conda-forge. My primary objective is to simplify the process of leveraging SAM for geospatial data analysis by enabling users to achieve this with minimal coding effort. I have adapted the source code of segment-geospatial from the segment-anything-eo repository, and credit for its original version goes to Aliaksandr Hancharenka.

• Free software: MIT license
• Documentation: https://samgeo.gishub.org

Citations

• Qiusheng Wu, & Lucas Osco. (2023). samgeo: A Python package for segmenting geospatial data with the Segment Anything Model (SAM). Zenodo. https://doi.org/10.5281/zenodo.7966658

Features

• Download map tiles from Tile Map Service (TMS) servers and create GeoTIFF files
• Segment GeoTIFF files using the Segment Anything Model (SAM)
• Segment remote sensing imagery with text prompts
• Create foreground and background markers interactively
• Load existing markers from vector datasets
• Save segmentation results as common vector formats (GeoPackage, Shapefile, GeoJSON)
• Save input prompts as GeoJSON files
• Visualize segmentation results on interactive maps

Examples

• Segmenting satellite imagery
• Automatically generating object masks
• Segmenting satellite imagery with input prompts
• Segmenting imagery with text prompts
• Batch segmentation with text prompts
• Using segment-geospatial with ArcGIS Pro
• Segmenting swimming pools with text prompts

Demos

• Automatic mask generator

• Interactive segmentation with input prompts

• Input prompts from existing files

• Interactive segmentation with text prompts

Tutorials

Video tutorials are available on my YouTube Channel.

• Automatic mask generation

• Using SAM with ArcGIS Pro

• Interactive segmentation with text prompts

Using SAM with Desktop GIS

• QGIS: Check out the Geometric Attributes plugin for QGIS. Credit goes to Bjorn Nyberg.
• ArcGIS: Check out the Segment Anything Model (SAM) Toolbox for ArcGIS and the Resources for Unlocking the Power of Deep Learning Applications Using ArcGIS. Credit goes to Esri.

Computing Resources

The Segment Anything Model is computationally intensive, and a powerful GPU is recommended to process large datasets. It is recommended to have a GPU with at least 8 GB of GPU memory. You can utilize the free GPU resources provided by Google Colab. Alternatively, you can apply for AWS Cloud Credit for Research, which offers cloud credits to support academic research. If you are in the Greater China region, apply for the AWS Cloud Credit here.

Acknowledgements

This project is supported by Amazon Web Services (AWS). In addition, this package was made possible by the following open source projects. Credit goes to the developers of these projects.

• segment-anything
• segment-anything-eo
• tms2geotiff
• GroundingDINO
• lang-segment-anything