Skip to main content

Remove echosounder noise by identifying the ocean floor and entrained air at the ocean surface.

Project description

Latest Release

Latest PyPI release

License

AGPLv3 License

Documentation

Documentation

Build Status

Documentation Status GHA Status Coverage pre-commit.ci status

Code style

black pre-commit enabled

Citation

DOI

Echofilter is an application for segmenting an echogram. It takes as its input an Echoview .EV file, and produces as its output several lines and regions:

  • entrained air (turbulence) line

  • seafloor line

  • surface line

  • nearfield line

  • passive data regions

  • (unreliable) bad data regions for entirely removed periods of time, in the form of boxes covering the entire vertical depth

  • (unreliable) bad data regions for localised anomalies, in the form of polygonal contour patches

Echofilter uses a machine learning model to complete this task. The machine learning model was trained on upfacing stationary and downfacing mobile data provided by Fundy Ocean Research Centre for Energy (FORCE). The training and evaluation data is available for download. Queries regarding dataset access should be directed to FORCE, info@fundyforce.ca.

The experimental methodology and results can be found in our companion paper, published in Frontiers in Marine Science.

Full documentation of how to use echofilter can be viewed at readthedocs.

If you encounter a specific problem please open a new issue.

Usage

After installing, the model can be applied at the command prompt with:

echofilter PATH PATH2 ...

Any number of paths can be specified. Each path can either be a path to a single csv file to process (exported using the Echoview application), or a directory containing csv files. If a directory is given, all csv files within nested subfolders of the directory will be processed.

All optional parameters can be seen by running echofilter with the help argument.

echofilter --help

For more details, see the Usage Guide, and the command line interface (CLI) reference documentation.

Installation

Installing as a stand-alone executable

For your convenience, we provide a copy of Echofilter compiled as a stand-alone executable for Windows. To install this, download and unzip the echofilter-executable-M.N.P.zip file from the latest release in the releases tab. For example: echofilter-executable-1.2.0.zip

For more details, see the step-by-step instructions in the Usage Guide.

Note: The precompiled executable has only CPU support, and does not support running on GPU.

Installing in Python

Alternatively, the echofilter package can be installed for Python 3.6 or 3.7 using pip as follows.

First, install torch.

Either with CPU-only capabilities:

pip install torch==1.4.0+cpu torchvision==0.5.0+cpu -f https://download.pytorch.org/whl/torch_stable.html

Or with CUDA GPU support as well:

pip install torch==1.4.0 torchvision==0.5.0 -f https://download.pytorch.org/whl/torch_stable.html

Then install the rest of the requirements.

pip install -r frozen_requirements.txt
pip install echofilter

Citing Echofilter

For technical details about how the Echofilter model was trained, and our findings about its empirical results, please consult our companion paper:

SC Lowe, LP McGarry, J Douglas, J Newport, S Oore, C Whidden, DJ Hasselman (2022). Echofilter: A Deep Learning Segmention Model Improves the Automation, Standardization, and Timeliness for Post-Processing Echosounder Data in Tidal Energy Streams. Front. Mar. Sci., 9, 1–21. doi: 10.3389/fmars.2022.867857.

If you use Echofilter for your research, we would be grateful if you could cite this paper in any resulting publications.

For your convenience, we provide a copy of this citation in bibtex format.

You can browse papers which utilise Echofilter here.

License

Copyright (C) 2020-2022 Scott C. Lowe and Offshore Energy Research Association (OERA)

This program is free software: you can redistribute it and/or modify it under the terms of the GNU Affero General Public License as published by the Free Software Foundation, version 3.

This program is distributed in the hope that it will be useful, but WITHOUT ANY WARRANTY; without even the implied warranty of MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the GNU Affero General Public License for more details.

You should have received a copy of the GNU Affero General Public License along with this program. If not, see <https://www.gnu.org/licenses/>.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

echofilter-1.2.0.tar.gz (165.8 kB view hashes)

Uploaded Source

Built Distribution

echofilter-1.2.0-py3-none-any.whl (179.0 kB view hashes)

Uploaded Python 3

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page