Map Reduce for Notebooks
Project description
Papermill is map reduce for Jupyter notebooks.
Stepping away from the hyperbole, our goals for Papermill include simplifying and streamlining:
Parametrizing notebooks
Executing and collecting metrics across the notebooks
Summarize collections of notebooks
Installation
pip install papermill
Usage
Executing a parametrized notebook
import papermill as pm
pm.execute_notebook(
notebook="template.ipynb",
output="output.ipynb",
params=dict(alpha=0.1, ratio=0.001)
)
nb = pm.read_notebook("output.ipynb")Creating a parametrized notebook and record metrics
### template.ipynb
import papermill as pm
rmse = metrics.mean_squared_error(...)
pm.record_value("rmse", rmse)
plot() # Tag this cell as "results" for extraction later### run_and_summarize.ipynb
pm.execute_notebook(
notebook="template.ipynb",
output="output.ipynb",
params=dict(alpha=0.1, ratio=0.001)
)
# Print RMSE value saved in "output.ipynb"
nb = pm.read_notebook("output.ipynb")
nb_data = pm.fetch_notebook_data(nb)
print("rmse", nb_data["rmse"])
# Show plot found in "output.ipynb"
result_cell = pm.get_tagged_cell(nb, "results")
plot = pm.get_image_from_cell(result_cell)
pm.display_image(plot)Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
papermill-0.4.tar.gz
(22.7 kB
view hashes)
