Skip to main content

Python library to Integrate AI-powered features into your applications

Project description

Code style: black

Marie-AI

Integrate AI-powered document pipeline into your applications

Documentation

See the MarieAI docs.

Installation

You don't need this source code unless you want to modify the package. If you just want to use the package, just run:

pip install --upgrade marieai

Install from source with:

pip install -e .

Build docker container:

DOCKER_BUILDKIT=1 docker build . --build-arg PIP_TAG="standard" -f ./Dockerfiles/gpu.Dockerfile  -t marieai/marie:3.0-cuda 

Command-line interface

This library additionally provides an marie command-line utility which makes it easy to interact with the API from your terminal. Run marie -h for usage.

Example code

Examples of how to use this library to accomplish various tasks can be found in the MarieAI documentation. It contains code examples for:

  • Document cleanup
  • Optical character recognition (OCR)
  • Document Classification
  • Document Splitter
  • Named Entity Recognition
  • Form detection
  • And more

Run with default entrypoint

docker run --rm  -it marieai/marie:3.0.19-cuda

Run the server with custom entrypoint

docker run --rm  -it --entrypoint /bin/bash  marieai/marie:3.0.19-cuda  

Telemetry

https://telemetry.marieai.co/

TODO :MOVE TO DOCS

S3 Cloud Storage

docker compose -f  docker-compose.s3.yml --project-directory . up  --build --remove-orphans

CrossFTP

Configure AWS CLI Credentials.

vi ~/.aws/credentials
[marie] # this should be in the file
aws_access_key_id=your_access_key_id
aws_secret_access_key=your_secret_access_key

Pull the Docker image.

docker pull zenko/cloudserver

Create and start the container.

docker run --rm -it --name marie-s3-server -p 8000:8000 \
-e SCALITY_ACCESS_KEY_ID=MARIEACCESSKEY \
-e SCALITY_SECRET_ACCESS_KEY=MARIESECRETACCESSKEY \
-e S3DATA=multiple \
-e S3BACKEND=mem zenko/cloudserver
SCALITY_ACCESS_KEY_ID : Your AWS ACCESS KEY 
SCALITY_SECRET_ACCESS_KEY: Your AWS SECRET ACCESS KEY 
S3BACKEND: Currently using memory storage

Verify Installation.

aws s3 mb s3://mybucket  --profile marie --endpoint-url http://localhost:8000 --region us-west-2
aws s3 ls --profile marie --endpoint-url http://localhost:8000
aws s3 cp some_file.txt s3://mybucket  --profile marie --endpoint-url http://localhost:8000
aws s3 --profile marie --endpoint-url=http://127.0.0.1:8000 ls --recursive s3://

Production setup

Configuration for the S3 server will be stored in the following files: https://towardsdatascience.com/10-lessons-i-learned-training-generative-adversarial-networks-gans-for-a-year-c9071159628

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

marie-ai-3.0.24.tar.gz (27.2 MB view hashes)

Uploaded Source

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page