skip to navigation
skip to content

pysqllike 0.1.168

An intent to write SQL like programs and to translate them in Python, SQL, Hive, PIG.

.. _l-README:


.. only:: html

.. image::
:alt: Build status

.. image::
:alt: Build Status Windows

.. image::

.. image::

.. image::
:alt: GitHub Issues

.. image::
:alt: MIT License

.. image::
:alt: Code Health

.. image::
:alt: Requirements Status

.. image::


* `GitHub/pysqllike <https:"" sdpython="" pysqllike="">`_
* `documentation <http:"" app="" pysqllike="" helpsphinx="" index.html="">`_
* `Blog <http:"" app="" pysqllike="" helpsphinx="" blog="" main_0000.html#ap-main-0="">`_


Writing a map/reduce job
(using `PIG <https:""/>`_ for example),
usually requires to switch from local files to remote files
(on `Hadoop <http:""/>`_).
On way to work is extract a small sample of the data which will be processed
by a map/reduce job. The job is then locally developped. And when it works,
it is run on a parallized environment.

The goal of this extension is allow the implementation of
this job using Python syntax as follows:


def myjob(input):
iter = (input.age, input.nom, age2 = input.age2*input.age2)
wher = iter.where( (iter.age > 60).Or(iter.age < 25))
return where

input = IterRow (None, [ {"nom": 10}, {"jean": 40} ] )
output = myjob(input)

When the job is ready, it can be translated into a `PIG <https:""/>`_

input = LOAD '...' USING PigStorage('\t') AS (nom, age);
iter = FOREACH input GENERATE age, nom, age*age AS age2 ;
wher = FILTER iter BY age > 60 or age < 25 ;
STORE wher INTO '...' USING PigStorage();

It should also be translated into
`SQL <http:"" wiki="" structured_query_language="">`_.


* not yet ready


This project contains various helper about logging functions, unit tests and help generation.
* a source folder: ``src``
* a unit test folder: ``_unittests``, go to this folder and run ````
* a _doc folder: ``_doc``, it will contains the documentation
* a file ```` to build and to install the module
* a file ```` to build the sphinx documentation
File Type Py Version Uploaded on Size
pysqllike-0.1.168-py3-none-any.whl (md5) Python Wheel 3.6 2017-10-05 23KB
pysqllike-0.1.168.tar.gz (md5) Source 2017-10-05 33KB