Summarize LSF job properties by parsing log files.
Project description
lsf_stats
Summarize LSF job properties by parsing log files of workflows executed by Snakemake.
Installation
$ pip install lsf_stats
Usage
$ lsf_stats --help
Usage: lsf_stats [OPTIONS] COMMAND [ARGS]...
Summarize LSF job properties by parsing log files.
Options:
--help Show this message and exit.
Commands:
gather Aggregate information from log files in single dataframe.
summarize Summarize and visualize aggregated information.
Example
Assume that you executed your Snakemake workflow using the lsf-profile and all generated log files are stored in the directory ./logs/
:
$ snakemake --profile lsf
[..]
You can then quickly aggregate resource, rule and other types of information about the workflow execution into a single dataframe:
$ lsf_stats gather -o workflow_stats.csv.gz ./logs/
[..]
This dataframe can then be summarized in various ways:
$ lsf_stats summarize \
--query 'status == "Successfully completed."' \
--split-wildcards \
--grouping-variable category \
workflow_stats.csv.gz
[..]
For example, the following plots will be generated:
Job execution | Job resources |
---|---|
Project details
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
lsf_stats-0.2.2.tar.gz
(5.0 kB
view hashes)
Built Distribution
Close
Hashes for lsf_stats-0.2.2-py3-none-any.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | ef1ef5a9d7a58946a04f21dffb2fc892de0254afb50fecfbcadaf50bc56f6fe0 |
|
MD5 | 08267d57f1a045d464b0af68e4f806c8 |
|
BLAKE2b-256 | 0b9938534d756e44948419fef458441b3ad8b90dee44ca5d446b2517f650f42c |