A modular toolkit for analytics.
Project description
NewsLynx Core is an expandable open-source toolkit for building modular content analytics workflows. It provides a fully RESTful API as well as a comprehensive python client and command line interface.
NewsLynx Core was built to power `newslynx-app <http://github.com/newslynx/newslynx-app>`__ but is capable of powering a diverse range of potential applications, as well, including:
A Mention.net-like pipeline for your personal or company blog.
A Flexible timeseries store for content metrics which will automatically summarize and compare your data, as well as enable the additional of custom, computed metrics.
A framework for configuring, scheduling, and monitoring arbitrary python jobs via API.
A content-extraction API.
Installation
For most applications, refer to our installation guide. If you’d like to setup a development environment, following the instructions below for MacOS X. If you’d like to spin up a Virtual Machine, check out our automation guide.
Dependencies
Postgres
NOTE We recommend using Postgres APP. However, if you prefer the brew distribution, make sure to install it with plpythonu.
$ brew install postgresql --build-from-source --with-python
(Re)create a postgresql database
# If you already have a database called `newslynx`, delete it first
$ dropdb newslynx
$ createdb newslynxRedis
Install redis:
$ brew install redisOpen another tab in your shell and run:
$ redis-server
Installation / Initialization
NOTE we recommend that you install newslynx in a virtual environment.
First clone this repository and move into it’s root directory
$ git clone https://github.com/newslynx/newslynx-core.git
$ cd newslynx-coreOPTIONAL Set your configuration. If you don’t do this, we will fallback on the app’s default configuration file.
Initialize a bare install.
[Expert mode] don’t install the app’s default sous chefs, tags, or recipes.
$ git clone https://github.com/newslynx/newslynx-core.git $ cd newslynx-core $ make bare_install
Start the server
In debug mode: newslynx debug
Debug mode with errors: newslynx debug --raise-errors
Production gunicorn server: bin/run
Start the task workers
$ bin/start_workers
Stop the task workers
$ bin/stop_workers
Start the cron daemon
$ newslynx cron
Getting Started.
Application Structure
License
This work is licensed under a Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International License.
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Hashes for newslynx-1.1.2.macosx-10.10-intel.exe
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 | 5088405b947bd54a3c3aab9c838da5ee683df2c7fdde49f023bfea8891c968af |
|
| MD5 | e3289fcc028fdfd0fd9afccbe5b9ee40 |
|
| BLAKE2b-256 | 3ef253fb04f9dcae7c08dfc3f14d72a0a638cc3d76195d2faa5f7811f0ae1184 |
