Skip to main content

Logging for Complex & Distributed Systems

Project description

Coveralls test coverage information Build Status

Eliot is a Python logging system designed not only for simple applications but for complex applications as well, including distributed systems. Eliot supports simple structured messages but can also record a causal chain of actions happening within and across process boundaries: a logical trace of the system’s operation.

Structured, action-oriented logging is a great help when debugging problems. For example, here are the combined logs of a request originating from a client process being sent to a server. Notice how easy it is to figure out the cause of the problem, even though it’s opaque to the client:

process='client' task_uuid='40be6df2' task_level=[1] action_type='main'
    action_status='started'

process='client' task_uuid='40be6df2' task_level=[2, 1] action_type='http_request'
    action_status='started' x=5 y=0

process='server' task_uuid='40be6df2' task_level=[2, 2, 1] action_type='eliot:remote_task'
    action_status='started'

process='server' task_uuid='40be6df2' task_level=[2, 2, 2, 1] action_type='divide'
    action_status='started' x=5 y=0

process='server' task_uuid='40be6df2' task_level=[2, 2, 2, 2] action_type='divide'
    action_status='failed' exception='exceptions.ZeroDivisionError' reason='integer division or modulo by zero'

process='server' task_uuid='40be6df2' task_level=[2, 2, 3] action_type='eliot:remote_task'
    action_status='failed' exception='exceptions.ZeroDivisionError' reason='integer division or modulo by zero'

process='client' task_uuid='40be6df2' task_level=[2, 3] action_type='http_request'
   action_status='failed' exception='requests.exception.HTTPError' reason='500 Server Error: INTERNAL SERVER ERROR'

process='client' task_uuid='40be6df2' task_level=[3] action_type='main'
   action_status='failed' exception='requests.exception.HTTPError' reason='500 Server Error: INTERNAL SERVER ERROR'

Features:

  • Structured, typed log messages.

  • Ability to log actions, not just point-in-time information: log messages become a trace of program execution.

  • Logged actions can span processes and threads.

  • Excellent support for unit testing your code’s logging.

  • Emphasis on performance, including no blocking I/O in logging code path.

  • Optional Twisted support.

  • Designed for JSON output, usable by Logstash/Elasticsearch.

  • Supports CPython 2.7, 3.3, 3.4 and PyPy.

  • Eliot APIs provide both PEP 8 style (e.g. write_traceback()) and Twisted (e.g. writeTraceback()) method and function names. The only exceptions are pyunit-style assertions (e.g. assertContainsFields()) and Twisted-specific APIs since both use camelCase by default.

Eliot is released by ClusterHQ under the Apache 2.0 License.

To install:

$ pip install eliot

Downloads are available on PyPI.

Documentation can be found on Read The Docs.

Bugs and feature requests should be filed at the project Github page.

You can ask for help on IRC at the #eliot channel on irc.freenode.net.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

eliot-0.6.0.tar.gz (86.1 kB view hashes)

Uploaded Source

Built Distribution

eliot-0.6.0-py2.py3-none-any.whl (61.3 kB view hashes)

Uploaded Python 2 Python 3

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page