Skip to main content

Very basic python logstash shipper

Project description

Description

This is very simple replacement for ElasticSearch filebeat.

Usage

install

pip install git+https://github.com/stavinsky/lsshipper

after that create config directory anywhere you want and put 2 config files there.

  1. log_config.ini - this is config for logging system. example with verbose logs

  2. config.ini - main config. Make sure that pattern and newline parameters is doublequotted. example with verbose logs

running

It can be started as a module:

python -m lsshipper --config_dir <dir with configs>

Why?

There is windows software that adds preallocated block of zeroes(\x00) to log file. Original filebeat skips such blocks. So big part of logs can be lost.

Speed

On my mac mini late 2003 it can write to network about 2Mb/s. I will test later on windows and linux. I believe on linux it should be much faster.

Problems

  1. On very fast server reconnects it can loose one log string. Please check test_connection.py

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

lsshipper-0.1.3.tar.gz (7.6 kB view hashes)

Uploaded Source

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page