Django app with common code and assets for Money to Prisoners services
Project description
A Django app containing utilities and assets common to all Prisoner Money applications. This version is only tested with Django 3.2.
Features
Build pipeline CLI with actions that can depend on others (inspired by invoke/fabric)
Base SCSS, JS and static assets
Base templates for staff and public apps
Build action to include GOV.UK Design System assets
Reusable templates for form fields and errors
Authentication utilities and views for connecting to money-to-prisoners-api
User account management forms and views
REST utilities for communicating with money-to-prisoners-api
Utility for communicating with HMPPS Prison API (NOMIS)
Integration and accessibility testing with selenium
Python code style testing
Log formatting for shipping to ELK
Cookie management tools to anonymise users and allow them to opt in
Prometheus metrics view providing app version information
Constants shared between apps
Email sending using GOV.UK Notify
Usage
This is not a standalone Django application and is included as a requirement of Prisoner Money apps.
Make code changes and add any tests necessary
Test using ./run.py test or python setup.py test
Bump the package version with ./run.py bump_version [--major | --minor | --patch]
Submit to PyPi by:
making a new release on Github (package version comes from the code, not Github release title)
or ./run.py upload locally (if release cannot be made on Github for some reason)
Add or update money-to-prisoners-common~=<major version>.<minor version>.0 to the app’s requirements base.txt. There is an additional variant installed as a setuptools extra: Use money-to-prisoners-common[testing]~=<major version>.<minor version>.0 for environments requiring testing; this is placed into the app’s requirements dev.txt. Incrementing the build/patch version is used to push minor fixes so these above requirements will automatically include them.
While making changes to this library, you can install it locally in “editable” mode. See python_dependencies --common-path … build task.
Translating
Update translation files with ./run.py make_messages – you need to do this every time any translatable text is updated.
Compile messages ./run.py compile_messages – only needed during local testing or development, it happens automatically during build or upload.
Requires [transifex cli tool](https://github.com/transifex/cli#installation) for synchronisation:
Pull updates from Transifex with ./run.py translations --pull. You’ll need to update translation files afterwards and manually check that the merges occurred correctly.
Push latest English to Transifex with ./run.py translations --push. NB: you should pull updates before pushing to merge correctly.
Assets
All shared assets used by Prisoner Money apps are kept in this package. Each app’s build scripts install this package automatically which also bring in the GOV.UK Design System.
Assets that need compiling are in mtp_common/assets-src/mtp_common. Static assets are in mtp_common/static/mtp_common.
Common templates used by the client apps are kept in mtp_common/templates/(govuk-frontend|mtp_common). The ones in govuk-frontend are essentially translated from the GOV.UK Design System whereas those in mtp_common are custom components or are heavily modified.
Local Development Environment
Prisoner Money apps can be run natively (i.e. directly by python on your machine) or using docker-compose. Using docker-compose is perhaps the easiest way to bring up all Prisoner Money apps in concert, but it requires access to the private money-to-prisoners-deploy infrastructure. However, when editing this common library, it’s easier to run them natively because this package can be installed in “editable” mode.
Check out each app and helper repository side-by-side in one directory using git:
money-to-prisoners-transaction-uploader – NB: this app does not expose a web interface
money-to-prisoners-deploy – NB: this is a private repository
Running natively (does not require access to the private deploy repository)
Each app describes its own installation in its read-me file, but here’s a quick guide:
Setup local postgres database server. There’s no need to create a user or database if using default settings.
Install python version 3.10.
Install nodejs version 20.
Setup a python virtual environment for each app. These are used to isolate python dependency libraries for each app.
You can either make one directly in each repository directory:
python3 -m venv venvOr install and use virtualenvwrapper which allows activating a virtual environment by name from any location. This option is particularly helpful for git hooks or when you normally run the apps in docker-compose. In the directory containing all repos:
for app in api cashbook bank-admin noms-ops transaction-uploader send-money start-page deploy; do cd money-to-prisoners-$app mkvirtualenv -a . money-to-prisoners-$app [[ -f requirements/dev.txt ]] && pip install -r requirements/dev.txt [[ -f requirements.txt ]] && pip install -r requirements.txt cd - done cd money-to-prisoners-common mkvirtualenv -a . money-to-prisoners-common pip install -e '.[testing]'Run the apps. The api always needs to be running when any of the other apps are used other than start-page.
cd <app repository root> # activate the virtual environment if one was made directly . venv/bin/activate # OR activate the virtual environment using virtualenvwrapper workon money-to-prisoners-<app name> # run the app ./run.py serve # OR if it’s the api, this automatically alternative also creates a fresh database with sample data ./run.py start --test-mode
After this has been done once, bringing up apps again only requires repeating step 5.
Running using docker-compose (requires access to the private deploy repository)
Get access to money-to-prisoners-deploy and see read-me inside to unlock it.
Setup local environment:
Get the docker registry address of ECR used for deployed environment in Cloud Platform. In the deploy repo:
./manage.py config docker-login # log docker into ECR ./manage.py app ci-settings [any mtp app name] # note the $ECR_REGISTRY valueAlternatively, this value can be derived from the ecr kubernetes secret in the production namespace in Cloud Platform. Use the value of repo_url up to the first /.
Create a .env file in this repository’s root directory adding this ECR_REGISTRY value:
ECR_REGISTRY=?????????.amazonaws.comPull images from private docker registry in Cloud Platform. In the deploy repo:
./manage.py config docker-login # only necessary if not done above
./manage.py image pull-ecrLaunch all apps in concert. In this repo:
docker-compose up
NB: The newer ``docker compose up`` form only works after the ``docker-compose up`` has already built the containers the first time!Create standard users and populate database with sample data. In this repo:
docker-compose exec api ./manage.py load_test_dataAfter this has been done once, bringing up the full stack in future only requires running docker-compose up or docker compose up in this repo. Deleting docker images, containers or volumes will require repeating steps 3 to 5.
If you run into issues with the dockerised development environment, the following troubleshooting steps should reset the state:
Shutdown existing docker-compose containers, and remove volumes/networks/images with docker-compose down -v --rmi all from this repo’s root directory (note this will wipe your local database, omit the -v to prevent this)
Pull fresh base images (step 3 above)
Rebuild the app images without cache via docker-compose build --no-cache from this repo’s root directory
Restart the apps in the background via docker-compose up -d from this repo’s root directory
Tail the logs at your leisure via docker-compose logs <app> from money-to-prisoners-common root directory
Accessing the apps
Irrespective of how the apps were run, those exposing a web interface will be accessible:
cashbook: http://localhost:3001/
bank-admin: http://localhost:3002/
noms-ops: http://localhost:3003/
send-money: http://localhost:3004/
start-page: http://localhost:8005/
You can find login details in load_test_data.py
Caveat: You can only log into one app at a time locally because the cookies within which the session is stored are namespaced to domain only.
Additional Bespoke Packages
There are several dependencies of the money-to-prisoners-common python library which are maintained by this team, so they may require code-changes when the dependencies (e.g. Django) of the money-to-prisoners-common python library, or any of the Prisoner Money apps, are incremented.
There are additional bespoke dependencies defined as python dependencies within the Prisoner Money apps.
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Hashes for money-to-prisoners-common-16.11.0.tar.gz
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 | 222816a4eb4c6e6af16b7489f39855e4470026689624505969a3a3002b4f38a3 |
|
| MD5 | 6930ab3822e21c5aa20b6317a88a8111 |
|
| BLAKE2b-256 | d6199078c0ba3f2dec82e0ef8ffea92b3efc63a9bd0fff9efdbee1e8cfb91530 |
Hashes for money_to_prisoners_common-16.11.0-py3-none-any.whl
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 | 199a76106d6c386c7a69ae63e5c6821e88aeee69eb2ab6e2ff0a8236148a54f8 |
|
| MD5 | 354eba2b392efff2149be8422fc45a38 |
|
| BLAKE2b-256 | 214bc05fba75ef235d824baa7e7985a6fe95748c3403224eb400bd2bd8f31fba |
