javascripthon 0.3

Goal

JavaScripthon is a small and simple Python 3.5+ translator to JavaScript which aims to be able to translate most of the Python’s core semantics without providing a full python-in-js environment, as most existing translators do. It tries to emit code which is simple to read and check and it does so by switching to ES6 construct when necessary. This allows to simplify the needs of polyfills for many of the expected Python behaviors.

The interface with the js world is completely flat, import the modules or use the expected globals (window, document, etc…) as you would do in JavaScript.

The ES6 code is then converted (if requested) to ES5 code with the aid of the popular BabelJS library together with the fantastic dukpy embedded js interpreter.

Another goal is to just convert single modules or entire dir tree structures without emitting concatenated or minified files. This is left to the Javascript tooling of your choice. I use webpack which has BabelJS integration to getting this job done. Check out the bundled example.

JavaScripthon also generates SourceMap files with the higher detail possible in order to aid development. This means that while you are debugging some piece of translated JavaScript with the browser’s tools, you can actually choose to follow the flow of the code on the original Pyhton 3 source.

This project is far from complete, but it has achieved a good deal of features, please have a look at tests/test_evaljs.py file for the currently supported ones.

Installation

Python 3.5 is required because Python’s ast has changed between 3.4 and 3.5 and as of now supporting multiple Python versions is not one of my priorities.

To install the package execute the following command:

$ pip install javascripthon

Usage

To compile or transpile a python source module, use the commandline:

$ python -m metapensiero.pj source.py

or:

$ python -m metapensiero.pj -5 source.py

to transpile.

A pj console script is also automatically installed:

$ pj --help
usage: pj [-h] [--disable-es6] [--disable-stage3] [-5] [-o OUTPUT] [-d]
          [--pdb]
          file [file ...]

A Python 3.5+ to ES6 JavaScript compiler

positional arguments:
  file                  Python source file(s) or directory(ies) to convert.
                        When it is a directory it will be converted
                        recursively

optional arguments:
  -h, --help            show this help message and exit
  --disable-es6         Disable ES6 features during conversion (Ignored if
                        --es5 is specified)
  --disable-stage3      Disable ES7 stage3 features during conversion
  -5, --es5             Also transpile to ES5 using BabelJS.
  -o OUTPUT, --output OUTPUT
                        Output file/directory where to save the generated code
  -d, --debug           Enable error reporting
  --pdb                 Enter post-mortem debug when an error occurs

Conversions Rosetta Stone

Here are brief list of examples of the conversions the tool applies, just some, but not all.

x < y <= z < 5

def foo():
    return [True, False, None, 1729,
            "foo", r"foo\bar", {}]


while len(foo) > 0:
    print(foo.pop())


if foo > 0:
    ....
elif foo < 0:
    ....
else:
    ....




str(x)

((x < y) && (y <= z) && (z < 5))

function foo() {
    return [true, false, null, 1729,
            "foo", "foo\\bar", {}];
}

while ((foo.length > 0)) {
    console.log(foo.pop());
}

if ((foo > 0)) {
    ....
} else {
    if ((foo < 0)) {
        ....
    } else {
        ....
    }
}

x.toString()

==
!=
2**3
'docstring'

self
len(...)
print(...)
isinstance(x, y)
typeof(x)

FirstCharCapitalized(...)















foo in bar

foo[3:]
foo[:3]

===
!==
Math.pow(2, 3)
/* docstring */

this
(...).length
console.log(...)
(x instanceof y)
(typeof x)

new FirstCharCapitalized(...)

var _pj;
function _pj_snippets(container) {
    function _in(left, right) {
        if (((right instanceof Array) || ((typeof right) === "string"))) {
            return (right.indexOf(left) > (- 1));
        } else {
            return (left in right);
        }
    }
    container["_in"] = _in;
    return container;
}
_pj = {};
_pj_snippets(_pj);
_pj._in(foo, bar);

foo.slice(3);
foo.slice(0, 3);

for el in dict(a_dict):
    print(el)





for el in an_array:
    print(el)




for i in range(5):
    print(i)

var _pj_a = a_dict;
for (var el in _pj_a) {
    if (_pj_a.hasOwnProperty(el)) {
        console.log(el);
    }
}

for (var el, _pj_c = 0, _pj_a = an_array, _pj_b = _pj_a.length;
      (_pj_c < _pj_b); _pj_c += 1) {
    el = _pj_a[_pj_c];
    console.log(el);
}

for (var i = 0, _pj_a = 5; (i < _pj_a); i += 1) {
    console.log(i);
}

class Foo(bar):
    def __init__(self, zoo):
        super().__init__(zoo)


    def meth(self, zoo):
        super().meth(zoo)
        def cool(a, b, c):
            print(self.zoo)


    async def something(self, a_promise):
        result = await a_promise


    @property
    def foo(self):
        return self._foo


    @foo.setter
    def foo(self, value):
        self._foo = value


    @classmethod
    def bar(self, val):
        do_something()


    def __len__(self):
        return 1


    def __str__(self):
        return 'Foo instance'

class Foo extends bar {
    constructor(zoo) {
        super(zoo);
    }

    meth(zoo) {
        super.meth(zoo);
        var cool;
        cool = (a, b, c) => {
            console.log(this.zoo);
        };
    }

    async something(a_promise) {
        var result;
        result = await a_promise;
    }

    get foo() {
        return this._foo;
    }

    set foo(value) {
        self._foo = value;
    }

    static bar(val) {
        do_something()
    }

    get length() {
        return 1;
    }

    toString() {
        return "Foo instance";
    }
}

class MyError(Exception):
    pass

raise MyError("An error occurred")

function MyError(message) {
    this.name = "MyError";
    this.message = (message || "Custom error MyError");
    if (((typeof Error.captureStackTrace) === "function")) {
        Error.captureStackTrace(this, this.constructor);
    } else {
        this.stack = new Error(message).stack;
    }
}
MyError.prototype = Object.create(Error.prototype);
MyError.prototype.constructor = MyError;
throw new MyError("An error occurred");

try:
    foo.bar()
except MyError:
    recover()
except MyOtherError:
    recover_bad()
finally:
    foo.on_end()

try {
    foo.bar();
} catch(e) {
    if ((e instanceof MyError)) {
        recover();
    } else {
        if ((e instanceof MyOtherError)) {
            recover_bad()
        } else {
            throw e;
        }
    }
} finally {
    foo.on_end();
}

import foo, bar
import foo.bar as b
from foo.bar import hello as h, bye as bb
from ..foo.zoo import bar
from . import foo
from .foo import bar

from __globals__ import test_name

# this should not trigger variable definition
test_name = 2

# this instead should do it
test_foo = True

__all__ = ['test_name', 'test_foo']

var test_foo;

import * as foo from 'foo';
import * as bar from 'bar';
import * as b from 'foo/bar';
import {hello as h, bye as bb} from 'foo/bar';
import {bar} from '../foo/zoo';
import * as foo from './foo';
import {bar} from './foo';

test_name = 2;
test_foo = true;

export {test_name};
export {test_foo};

def foo(a=2, b=3, *args):
    pass

def bar(c, d, *, zoo=2):
    pass

foo(5, *a_list)

bar('a', 'b', zoo=5, another='c')

def zoo(e, **kwargs):
    print(kwargs['bar'])


zoo(4, bar=6)

function foo(a = 2, b = 3, ...args) {
}

function bar(c, d, {zoo = 2}={}) {
}

foo(5, ...a_list);

bar("a", "b", {zoo: 5, another: "c"});

function zoo(e, kwargs = {}) {
    console.log(kwargs['bar'])
}

zoo(4, {bar: 6})

Examples

Execute make inside the examples directory.

Testing

To run the tests you should run the following at the package root:

python setup.py test

How to contribute

So you like this project and want to contribute? Good!

These are the terse guidelines:

There are some TODO points in the readme, or even the issue #6 is
quite simple to fix. Feel free to pick what you like.

The guidelines are to follow PEP8 for coding where possible, so use
CamelCase for classes and snake_case for variables, functions and
members, and UPPERCASE for constants.

An exception to this rules are the function names inside
``metapensiero.pj.transformations`` subpackage. Those are matched
against names of the ast objects coming from the ``ast`` module in
standard lib, so they have to to match even in case.

Try to keep lines lengths under 79 chars, more or less ;-)

The workflow is to fork the project, do your stuff, maybe add a test
for it and then submit a pull request.

Have fun

Build status

Contributing

Any contribution is welcome, drop me a line or file a pull request.

Todo

This is a brief list of what needs to be done:

• refactor the comprehensions conversion to use the snippets facility;

• refactor snippets rendering to write them as a module and import them in the module when tree conversion is enabled;

• convert dict() calls to ES6 Map object creation. Also, update “foo in bar” to use bar.has(foo) for maps;

• convert set literals to ES6 Set objects. Also, update “foo in bar” to use bar.has(foo) for sets;

• multi-line strings to ES6 template strings (does this make any sense?);

• class and method decorators to ES7 class and method decorators;

• implement yield and generator functions;

• take advantage of new duckpy features to use a JS execution context that lasts multiple calls. This way the BabelJS bootstrap affects only the initial execution;

Done

Stuff that was previously in the todo:

• translate import statements to ES6;

• translate __all__ definition to ES6 module exports;

• write a command line interface to expose the api;

• make try…except work again and implement try…finally;

• convert async and await to the same proposed features for js (see BabelJS documentation);

• convert argument defaults on functions to ES6;

• convert call keyword arguments;

• convert *iterable syntax to ES6 destructuring;

• use arrow functions for functions created in functions;

• properties to ES6 properties (getter and setter);

External documentation

A good documentation and explanation of ES6 features can be found on the book Exploring ES6 by Axel Rauschmayer (donate if you can).

An extensive documentation about Python’s ast objects, very handy.

Tools

Have a look at ECMAScript 6 Tools by Addy Osmani.

To debug source maps have a look at source-map-visualization and its package on npm.

Still i found these links to be helpful:

• BASE64 VLQ CODEC (COder/DECoder)

• Testing Source Maps

Here is an example of the latter tool showing code generated by JavaScripthon, have fun!

Notes

• A post about proposed solutions to use ES6 classes with Backbone. See also the bug open on github.

• A benchmark of ES6 features and discussion about it on hacker’s news.

• A compatibility table of ES6 features showing completeness of support feature by feature.

• A story about ES6 crazyest stuff… symbols

Changes