Skip to main content

Transformers based NLP models

Project description

PyPI - Package Version MIT License PyPI pyversions Python package Dependency Review

NLP Models

A repository for building transformer based nlp models

Installation

Install from PyPi

pip install nlp-models

Install from source

git clone git@github.com:minggnim/nlp-models.git
pip install -r requirements

Llama2 Quantization model on consumer CPU

Run Chat applications on CPU

  1. Streamlit UI

    cd apps
    streamlit run chat.py
    
  2. Command line

    llm_app chat -s 'hi there'
    

Run Q&A application on CPU

  1. Steamlit UI

    cd apps
    streamlit run qa.py
    

Models

  1. bert_classifier A wrapper package around BERT-based classification models

  2. multi_task_model An implementation of multi-tasking model built on encoder models

  3. GPT-2

  4. Falcon 7B

  5. Quantized Llama2 models

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

nlp-models-4.2.2.tar.gz (15.7 kB view hashes)

Uploaded Source

Built Distribution

nlp_models-4.2.2-py3-none-any.whl (19.2 kB view hashes)

Uploaded Python 3

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page