Skip to main content

Just in time open files

Project description

This package provides a way to delay opening files until the something is written to the file handle. This can be convenient when opening a large number of files of which most of them will not be frequently used. To deal with resource limits a queue is used from which, when full, the least frequent file is closed.

Installation

The software is distributed via PyPI, it can be installed with pip:

pip install jit_open

From source

The source is hosted on GitHub, to install the latest development version, use the following commands.

git clone https://git.lumc.nl/j.f.j.laros/jit-open
cd jit_open
pip install .

Usage

In the following example, only the file used.txt is created.

>>> from jit_open import Handle, Queue
>>>
>>> queue = Queue()
>>> used = Handle("used.txt", queue)
>>> unused = Handle("unused.txt", queue)
>>>
>>> used.write("line 1\n")
>>> used.write("line 2\n")

Library

The library provides the Handle and Queue classes.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

jit_open-1.0.2.tar.gz (4.1 kB view hashes)

Uploaded Source

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page