Skip to main content

A Kafka based data acquisition and analysis framework

Project description

Dolosse - A Kafka based Data Acquisition System

master codecov

Copyright (c) 2018 - 2020, S. V. Paulauskas, Dolosse Collaboration.

Dolosse is a modern scientific data acquisition and analysis framework. We use Kafka as a messaging backend that allows synchronization between acquisition systems. Using Kafka's messaging interface we can create a feedback loops between analysis and acquisition systems. We're still working on developing the framework

Features

  • Digitizer interfaces (coming soon)
    • XIA
      • Pixie-16
      • XIA Pixie-Net
  • Decode digitizer data formats
    • XIA
      • Pixie-16 (released)
      • Pixie-4 and Pixie-Net (coming soon)
  • Runs on Linux and Windows Systems.
  • Unpacks binary data formats:
    • PLD (UTK)
    • LDF (ORNL) - coming soon

Documentation

Our documentation is sparse right now since we're still getting off the ground. You can read about the project motivation in this presentation. You can also checkout the wiki.

Support

Checkout the support page for more information.

Installation

There are a couple of ways to use the software. They depend on the goal that you're after.

For use in custom software

pip install dolosse

Now you'll have access to the packages and modules we use to build our components. Checkout the modules documentation to see what you can do out of the box.

NOTE: There's nothing that's ready for experiments just yet.

For development

Developers should read the development workflow.

git clone https://github.com/dolosse/dolosse.git
cd dolosse
python3 -m venv venv
pip install -r requirements.txt

Licensing

Apache License 2.0.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

dolosse-0.7.1.tar.gz (22.0 kB view hashes)

Uploaded Source

Built Distribution

dolosse-0.7.1-py3-none-any.whl (29.1 kB view hashes)

Uploaded Python 3

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page