Towards Sharing Tools, and Artifacts, for Reusable Simulation: a minimal model example

Overview

The materials and methods in this repository support work towards developing the S.T.A.R.S healthcare framework (Sharing Tools and Artifacts for Reusable Simulations in healthcare). The code and written materials here demonstrate the application of S.T.A.R.S' version 1 to sharing a SimPy discrete-event simulation model and associated research artifacts.

• All artifacts in this repository are linked to study researchers via ORCIDs;
• Model code is made available under an MIT license;
• Python dependencies are managed through conda;
• Documentation of the model is enhanced using a Jupyter notebook.
• The python code itself can be viewed and executed in Jupyter notebooks via Binder;
• The materials are deposited and made citable using Zenodo;
• The model is sharable with other researchers and the NHS without the need to install software.

Author ORCIDs

Funding

This code is part of independent research supported by the National Institute for Health Research Applied Research Collaboration South West Peninsula. The views expressed in this publication are those of the author(s) and not necessarily those of the National Institute for Health Research or the Department of Health and Social Care.

Instructions to run the model

Install from PyPI

If you do not wish to you the code or would like to use the model as part of your own work you can install the model as a python package.

pip install treat-sim

Online Notebooks via Binder

The python code for the model has been setup to run online in Jupyter notebooks via binder

mybinder.org is a free tier service. If it has not been used in a while Binder will need to re-containerise the code repository, and push to BinderHub. This will take several minutes. After that the online environment will be quick to load.

To download code and run locally

Downloading the code

Either clone the repository using git or click on the green "code" button and select "Download Zip".

git clone https://github.com/pythonhealthdatascience/stars-treat-sim

Installing dependencies

All dependencies can be found in binder/environment.yml and are pulled from conda-forge. To run the code locally, we recommend installing miniforge;

miniforge is FOSS alternative to Anaconda and miniconda that uses conda-forge as the default channel for packages. It installs both conda and mamba (a drop in replacement for conda) package managers. We recommend mamba for faster resolving of dependencies and installation of packages.

navigating your terminal (or cmd prompt) to the directory containing the repo and issuing the following command:

mamba env create -f binder/environment.yml

Activate the mamba environment using the following command:

mamba activate stars_treat_sim

Running the model

To run 50 multiple replications across a number of example experiments, use the following code:

from treat_sim.model import (get_scenarios, run_scenario_analysis,
                             scenario_summary_frame, 
                             DEFAULT_RESULTS_COLLECTION_PERIOD)

if __name__ == '__main__':

    results = run_scenario_analysis(get_scenarios(), 
                                    DEFAULT_RESULTS_COLLECTION_PERIOD,
                                    n_reps=50)

    results_summary = scenario_summary_frame(results)
    print(results_summary)

Alternative you can design and execute individual experiments by creating a Scenario object:

from treat_sim.model import Scenario, multiple_replications

if __name__ == '__main__':

    # use all default parameter values
    base_case = Scenario()

    results = multiple_replications(base_case).describe().round(2).T
    print(results)

Testing the model

See our online documentation for an overview of testing

To run tests activate the virtual environment and entre the following command:

pytest

Alternatively to recieve a test coverage estimate issue the following command

pytest --cov=treat_sim tests/

Repo overview

.
├── binder
│   └── environment.yml
├── CHANGES.md
├── CITATION.cff
├── LICENSE
├── notebooks
│   └── test_package.ipynb
├── pyproject.toml
├── README.md
├── tests
│   └── test_model.ipynb
└── treat_sim
    ├── data
    │   └── ed_arrivals.csv
    ├── distributions.py
    ├── __init__.py
    └── model.py

• binder/ - contains the environment.yml file (sim) and all dependencies managed via conda, used to set-up the notebooks on Binder.
• CHANGES.md - changelog with record of notable changes to project between versions.
• CITATION.cff - citation information for the package.
• LICENSE - details of the MIT permissive license of this work.
• notebooks/ - contains a notebook to run the model and provides basic enhanced model documentation.
• pyproject.toml - used to build and distribute python package inc. managing a list of package dependencies.
• README.md - what you are reading now!
• tests/ - contains automated testing code
• treat_sim/ - contains packaged version of the model.
  • data/ - directory containing data file used by package.
  • distributions.py - distribution classes.
  • __init__.py - required as part of package - contains author and version.
  • model.py - example SimPy model.

Citation

If you use the materials within this repository we would appreciate a citation.

Monks, T., Harper, A., & Heather, A. (2024). Towards Sharing Tools, and Artifacts, for Reusable Simulation: a minimal model example (v2.1.0). Zenodo. https://doi.org/10.5281//zenodo.10026326

@software{stars_treat_sim,
  author       = {Thomas Monks, Alison Harper and Amy Heather},
  title        = {{Towards Sharing Tools, and Artifacts, for Reusable 
                   Simulation: a minimal model example}},
  month        = May,
  year         = 2024,
  publisher    = {Zenodo},
  version      = {v2.0.0},
  doi          = {10.5281//zenodo.10026326.},
  url          = {https://doi.org/10.5281//zenodo.10026326}
}