Skip to main content

Cloudnet data submission tool

Project description

ACTRIS Cloudnet data submission tool

Tests

Installation

pip install cloudnet-submit

Getting started

Generate a configuration file:

cloudnet-submit-generate-config

This will generate a cloudnet-config.toml file in your working directory. Update your submission credentials in the user_account section, and update site, instrument, instrument_pid and path_fmt fields to match your instrument/model setup. Remove unnecessary instrument and model sections.

# cloudnet-config.toml
[user_account]
username       = "alice"
password       = "alicesSecretPassword"

[[instrument]]
site           = "hyytiala"
instrument     = "rpg-fmcw-94"
instrument_pid = "https://hdl.handle.net/21.12132/3.191564170f8a4686"
path_fmt       = "/home/alice/data/hyytiala/rpg-fmcw-94/%Y/%m/%Y%m%d_hyytiala.nc"

[[instrument]]
site           = "granada"
instrument     = "chm15k"
path_fmt       = "/home/alice/data/granada/chm/%Y-%m/chm_grandada_%Y-%m-%d-*.nc"

[[model]]
site           = "hyytiala"
model          = "ecmwf"
path_fmt       = "/home/alice/data/hyytiala/ecmwf/%Y/%Y%m%d_hyytiala_ecmwf.nc"

cloudnet-submit will look for files specified in the path_fmt field for a given measurement date.

Use the following format codes:

Directive Meaning Example
%Y Year with century 0001, ..., 2022
%y Year without century (zero-padded) 00, ..., 22
%m Month (zero-padded) 01, ..., 12
%d Day (zero-padded) 01, ..., 31

You can also use wildcard character * in path_fmt field.

By default, cloudnet-submit submits data from the past three days.

Use --dry-run to list files would be submitted:

cloudnet-submit --dry-run

Submit data to the Cloudnet dataportal:

cloudnet-submit

You can also set the number of days to be submitted (including today):

cloudnet-submit --last-ndays 5

You can also specify a date you want to submit:

cloudnet-submit --date 2022-06-21

Or a list of dates:

cloudnet-submit --date 2022-06-21 2022-05-1

Or a range of dates:

cloudnet-submit --from-date 2022-05-01 --to-date 2022-06-24

See all the options:

cloudnet-submit --help

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

cloudnet-submit-0.0.1.tar.gz (8.5 kB view hashes)

Uploaded Source

Built Distribution

cloudnet_submit-0.0.1-py3-none-any.whl (9.3 kB view hashes)

Uploaded Python 3

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page