storm 0.20

Installing dependencies

The following instructions assume that you’re using Ubuntu. The same procedure will probably work without changes on a Debian system and with minimal changes on a non-Debian-based linux distribution. In order to run the test suite, and exercise all supported backends, you will need to install MySQL and PostgreSQL, along with the related Python database drivers:

$ sudo apt-get install

python-mysqldb mysql-server postgresql pgbouncer build-essential

These will take a few minutes to download (its a bit under 200MB all together). Once the download is complete, a screen called “configuring mysql-server-5.0” will be shown. When asked for a password for the root user leave the field blank and hit enter to continue. This is not a recommended setting for a production server, but makes life easier on a development machine. You may be asked to enter a password multiple times. Leave it blank in each case.

The Python dependencies for running tests can mostly be installed with apt-get:

$ apt-get install

python-django python-fixtures python-psycopg2 python-testresources python-transaction python-twisted python-zope.component python-zope.security

Two modules - pgbouncer and timeline - are not yet packaged in Ubuntu. These can be installed from PyPI:

http://pypi.python.org/pypi/pgbouncer http://pypi.python.org/pypi/timeline

Alternatively, dependencies can be downloaded as eggs into the current directory with:

$ make develop

This ensures that all dependencies are available, downloading from PyPI as appropriate.

Setting up database users and access security

PostgreSQL needs to be setup to allow TCP/IP connections from localhost. Edit /etc/postgresql/8.3/main/pg_hba.conf and make sure the following line is present:

host all all 127.0.0.1/32 trust

This will probably (with PostgresSQL 8.4) entail changing ‘md5’ to ‘trust’.

In order to run the two-phase commit tests, you will also need to change the max_prepared_transactions value in postgres.conf to something like

max_prepared_transactions = 200

Now save and close, then restart the server:

$ sudo /etc/init.d/postgresql-8.4 restart

Next, you probably noticed that, while MySQL asked us about a root user several times, PostgreSQL didn’t ask us at all. Lets create our PostgreSQL user now. As noted in the Ubuntu PostgreSQL documentation, the easiest thing is to create a user with the same name as your username. Run the following command to create a user for yourself (if prompted for a password, leave it blank):

$ sudo -u postgres createuser –superuser $USER

Despite having created our root user already, MySQL requires an extra step. First we start mysql as the root user (which, you may recall, has no password) with:

$ mysql -u root

Then we create a new user. Be sure to replace YOUR_USERNAME with your actual user name (leaving the quotes in place).

mysql> GRANT ALL PRIVILEGES ON . TO ‘YOUR_USERNAME’@’localhost’ IDENTIFIED BY ‘’ WITH GRANT OPTION;

Creating test databases

The test suite needs some local databases in place to exercise MySQL and PostgreSQL functionality. While still at the MySQL command prompt run:

mysql> CREATE DATABASE storm_test CHARACTER SET utf8;

Use Ctrl+D to exit, then, once back on the standard terminal, run the command for PostgreSQL:

$ createdb storm_test

Running the tests

Finally, its time to run the tests! Go into the base directory of the storm branch you want to test, and run:

$ make check

They’ll take a while to run. All tests should pass: failures mean there’s a problem with your environment or a bug in Storm.