Skip to main content

Cross-Compilation Environment Toolkit.

Project description

Crossroad is a command line tool to easily set up your shell environment for cross-compilation, on a GNU/Linux distribution.

Be aware that this is essentially a developer tool. Its target audience are developers working on UNIX systems (tested only under GNU/Linux systems: Linux Mint, and Mageia, but expected to work on other distributions), and wishing to cross-compile projects from the same platform. It is not for end-users, and is useless in running software, only building them.

Only 2 target environments are supported currently:

  • Windows (x86) 32-bit;

  • Windows (x86) 64-bit.

Note: no differences are made between Windows platforms other than 32/64-bit (in particular no software API versioning). This is up to you to make your code portable.

This is Free Software, under the license AGPL version 3.

If you liked this software, you are free to contact the author, or even support him.

Also you are more than welcome to propose patches: bugfixes, or new features, like support of more target environments, other shells than bash and zsh, etc. See the Contributing section below.

Installation

Crossroad is a typical python-style project, relying on Python 3.3 or above. You will also need either 7z or rpm2cpio installed.

To install from pypi, just run:

$ pip3 install crossroad

Or download from the archive:

$ ./setup.py install

Setting-UP

Crossroad does not need any particular cross-compilation tool to run at first, but it will tell you what you are missing to go further, and you won’t be able to enter a cross-compilation environment until this is installed.

List targets with:

$ crossroad --list-targets
crossroad, version 0.4.4
Available targets:
w64                  Windows 64-bit

Uninstalled targets:
w32                  Windows 32-bit

In the above example, I can compile for Windows 64-bit, not 32-bit.

To get details about a target’s missing dependencies, for instance Windows 32-bit:

$ crossroad -h w32
w32: Setups a cross-compilation environment for Microsoft Windows operating systems (32-bit).

Not available. Some requirements are missing:
- i686-w64-mingw32-gcc [package "gcc-mingw-w64-i686"] (missing)
- i686-w64-mingw32-ld [package "binutils-mingw-w64-i686"]

It will return a list of required binaries that crossroad cannot find. If you actually have them, the most likely reason is that you should update your $PATH with the right location. In the above example, crossroad could find your minGW linker, but not the compiler. It also informs you of a possible package name (based on a Linux Mint distribution. Your distribution may use a different name, but it would still give a useful hint for searching in your package manager).

Install the missing requirements and run crossroad again:

$ crossroad --list-targets
crossroad, version 0.4.4
Available targets:
w32                  Windows 32-bit
w64                  Windows 64-bit
$ crossroad -h w32
w32: Setups a cross-compilation environment for Microsoft Windows operating systems (32-bit).

Installed language list:
- C
Uninstalled language list:
- Ada                 Common package name providing the feature: gnat-mingw-w64-i686
- C++                 Common package name providing the feature: g++-mingw-w64-i686
- OCaml               Common package name providing the feature: mingw-ocaml
- Objective C         Common package name providing the feature: gobjc++-mingw-w64-i686
- fortran             Common package name providing the feature: gfortran-mingw-w64-i686

You will notice that now w32 is available in your list of target, but also the specific help is more complete and will also tell you a list of possible languages that MinGW can handle if you installed additional packages.

Note: crossroad has actually been tested only with C and C++ projects. But I welcome any usage report with other languages.

Usage

The full usage is available as a manual. Once installed, it is available with man crossroad. The below preview presents the main usage examples.

From a command line, run:

$ crossroad w64 myproject

This will set up a Windows 64-bit cross-compilation environment called “myproject”.

Your prompt will also be slightly modified (only adding information. Whatever custom prompt hack you may have — for instance displaying information on a code repository — will be untouched) to show you are in your working cross-compilation environment.

Note: only `bash` and`zsh` are supported right now.

All necessary environment variables for successful builds, like PATH, LD_LIBRARY_PATH, etc., are set for you. Moreover the crossroad command is modified once in a cross-compilation environment. You can crossroad -h or crossroad help to see the new list of commands.

You are now ready to configure and compile any project for your target platform.

Note that several projects, even for a same target, won’t share any data. For instance if you have a GIMP and Blender both using libpng, you would have to install it in both environments. This is because you usually don’t want to mix data from various projects and keep a clean slate. Nevertheless if you wish a holdall project for a given target, you can also do so.

Example: autotools

Let’s imagine you want to compile any software with a typical GNU compilation system, for Windows 64-bit.

  1. First enter crossroad:

    $ crossroad w64 myproject

    Normally here your shell prompt will be modified at this point.

  2. Enter your source code:

    $ cd /some/path/to/your/source/

    In a typical autotools project, you will have here access to a `configure` script, or with ways to build one, for instance by running an `autogen.sh` first.

  3. Configure your build:

    $ crossroad configure

    There is no need to add a –prefix, a –host, or a –build. These are automatically and appropriately set up for you.

    Of course you should add any other option as you would normally do to your `configure` step. For instance if your project had a libjpeg dependency that you want to deactivate:

    $ crossroad configure –without-libjpeg

    See the ./configure –help of a project for listing of its available options.

    Note: VPATH builds are also supported. You can run a configure from another directory this way:

    $ crossroad ../some/other/path/configure --without-libjpeg
  4. Here the configure may fail if you miss any dependency. You may install many dependencies easily through crossroad. Crossroad relies on the openSUSE cross-platform builds for this feature and provides basically a package manager for Windows cross-compiled packages (see the manual for more details on its features). Let’s say for instance that your project depends on glib. You could just run:

    $ crossroad install glib-devel

    Do this step as many times as necessary, until the configure step 3. succeeds. Then go to the next step.

  5. Build and install in the most common way possible:

    $ make
    $ make install
  6. Test:

    $ make check

    This one may seem weird, but actually if you have Wine installed and registered in binfmt_misc to execute win32 binaries, crossroad set up properly the Wine environment so that it can find the executables and DLLs you installed with make install. As a consequence, a make check might just work, even though there is no certaincy, since this is not exactly the same as running on the native win32 platform. For the records, I have been able to run successful make check on projects as complicated as GIMP.

  7. All done! Just exit your cross-compilation environment with ctrl-d or exit. To test your binaries on an actual Windows machine, crossroad provides 2 tools.

    1. Make a zip of your whole cross-compiled tree with the following:

      $ crossroad -c mysoftware.zip w64 myproject

      This will create a zip file mysoftware.zip that you can just move over to your test Windows OS. Then uncompress it, and set or update your PATH environment variable with the bin/ directory of this uncompressed prefix.

      Note: only zip format supported for the moment, since it is the most common compression format for Windows.

    2. If you are running Windows in a VM for instance, or are sharing partitions, you can just add a link in a shared directory. Just cd to the shared directory and run:

      $ crossroad -s w64 myproject

      This will create a symlink named crossroad-w64-myproject/ to the “myproject” project for the “w64” target. Since the directory is shared, it should be visible in Windows as a normal directory.

  8. Then run your app, and enjoy!

Note: this has been tested with success on many GNU projects, cross-compiled for Windows: cairo, babl, GEGL, glib, GTK+, libpng, pango, freetype2, gdk-pixbuf and GIMP.

Example: CMake

CMake uses toolchain files. Crossroad prepared one for you, so you don’t have to worry about it. Simply replace the step (3) of the autotools example with this command:

$ crossroad cmake .

A common cmake usage is to create a build/ directory and build there. You can do so with crossroad, of course:

$ mkdir build; cd build
$ crossroad cmake ..

Alternatively crossroad allows also to use the curses interface of cmake:

$ crossroad ccmake .

The rest should be the same, with make && make install, and you can add any options to your build the usual way.

This has been tested with success on allegro 5, and Exiv2 libraries, cross-compiled for Windows.

Example: SCons

A very basic support of scons build system has been added to crossroad, though there seems to be no actual standard there for cross-compilation. As a consequence, the support in crossroad is only following some common usage I saw in a few projects, but it may not work in your case.

Another issue is that scons does not even have standard for basic features either like prefix path. So you have to use the environment variable $CROSSROAD_PREFIX and use it were appropriate yourself.

For instance, assumins your scons scripts use –prefix option, running scons through crossroad could be done this way:

$ crossroad scons install –prefix=$CROSSROAD_PREFIX

Example: other

It has not been tested with any other compilation system up to now. So it all depends what they require for a cross-compilation. But since a crossroad environment prepares a bunch of environment variables for you, and helps you download dependencies, no doubt it will already make your life easier.

The configure, cmake and ccmake command are simple wrappers around any ./configure script, and the cmake/ccmake commands, adding some default options (which crossroad prepared) for successful cross-compilation.

For instance crossroad configure is the equivalent of running:

$ ./configure --prefix=$CROSSROAD_PREFIX --host=$CROSSROAD_HOST --build=$CROSSROAD_BUILD

And crossroad cmake /some/path is nothing more than:

$ cmake /some/path -DCMAKE_INSTALL_PREFIX:PATH=$CROSSROAD_PREFIX -DCMAKE_TOOLCHAIN_FILE=$CROSSROAD_CMAKE_TOOLCHAIN_FILE

Here is the list of useful, easy-to-remember and ready-to-use, environment variables, prepared by crossroad:

  • $CROSSROAD_PREFIX;

  • $CROSSROAD_HOST;

  • $CROSSROAD_BUILD;

  • $CROSSROAD_CMAKE_TOOLCHAIN_FILE.

  • $CROSSROAD_PLATFORM

  • $CROSSROAD_PLATFORM_NICENAME

  • $CROSSROAD_PROJECT

  • $CROSSROAD_WORD_SIZE

Do not modify these environment variables. They have been set-up for your builds to work successfully. If you modify these, you will get into trouble.

What it means though is that you can use these for other compilation systems. You can also use your crossroad prefix, even for systems which do not require any compilation. Let’s say for instance you wish to include a pure python project in your build. No per-platform compilation is needed, but you still want to carry all the files in the same prefix. So just run:

$ ./setup.py install –prefix=$CROSSROAD_PREFIX

and so on.

Note: as you may have guess `$CROSSROAD_PREFIX` encapsulates your new cross-build and all its dependencies. Though in most cases, you should not need to manually go there do anything, you still can (for instance to change software settings, etc.) with `cd $CROSSROAD_PREFIX`.

Special case: Wine

Some software have proved extremely hard to cross-compile, mostly because of weird custom build systems or strange designs. I had this case for Python, which even went as far as forbidding cross-builds for hosts they didn’t approve with specific configure tests. I have been therefore unable to crossbuild it. One solution could be to fix the build system (which I started to do for Python until I discovered bug reports with patches for specifically this, and opened for eons), or to install in Windows, and import the data (but then you lose the flexibility or building all on the same machine).

My other workaround has been to install with Wine. In my Python example, I have indeed been able to run the 32-bit installer (not the 64-bit one). When doing so in a crossroad environment, the data will be automatically installed under $CROSSROAD_PREFIX/wine/. Then you just have to update any necessary environment variable in order for your builds to discover any library/header if necessary (I don’t see how to do so automatically with a Windows tree being so “random”).

Configuration

Crossroad relies on XDG standards. Right now it does not need any configuration file, but it will soon probably. And these will be in $XDG_CONFIG_HOME/crossroad/ (defaults to $HOME/.config/crossroad/).

Cache is saved in $XDG_CACHE_HOME/crossroad/ and data in $XDG_DATA_HOME/crossroad/.

The only configuration right now is that in case you use a self-installed MinGW-w64 prefix of Windows libraries, if they are not in the same prefix as the MinGW-64 executables you run, you can set $CROSSROAD_CUSTOM_MINGW_W32_PREFIX and $CROSSROAD_CUSTOM_MINGW_W64_PREFIX respectively for your 32-bit and 64-bit installation of MinGW-w64.

Help

Crossroad provides inline help with crossroad -h but also by installing a man page in section 1:

$ man crossroad

Contributing

You can view the git branch on the web at: http://git.tuxfamily.org/crossroad/crossroad And clone it with:

$ git clone git://git.tuxfamily.org/gitroot/crossroad/crossroad.git

Then send your git-format-ed patches by email to crossroad <at> girinstud.io.

About the name

The name is a hommage to “cross road blues” by Robert Johnson, which spawned dozens, if not hundreds, of other versions by so many artists. I myself always play this song (or rather a version with modified lyrics adapted to my life) in concerts.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

crossroad-0.6.tar.gz (89.8 kB view hashes)

Uploaded Source

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page