floret Python bindings

Navigation

Verified details

These details have been verified by PyPI
Maintainers
Avatar for explosion from gravatar.com explosion

Unverified details

These details have not been verified by PyPI
Project links
GitHub Statistics

View statistics for this project via Libraries.io, or by using our public dataset on Google BigQuery

Meta

License: MIT License (MIT)

Author: Explosion

Classifiers

Project description

floret: fastText + Bloom embeddings for compact, full-coverage vectors with spaCy

floret is an extended version of fastText that can produce word representations for any word from a compact vector table. It combines:

  • fastText's subwords to provide embeddings for any word
  • Bloom embeddings ("hashing trick") for a compact vector table

Installation

pip install floret

Usage

Train floret vectors using the options:

  • mode: "floret", storing both words and subwords in the same compact hash table
  • hashCount: store each entry in 1-4 rows in the hash table (recommended: 2)
  • bucket: in combination with hashCount>1, the size of the hash table can be greatly reduced (recommended: 25000--100000, reduced from the fastText default of 2000000)
  • minn: min length of char ngram (default: 3)
  • maxn: max length of char ngram (default: 6)
import floret

# train vectors
model = floret.train_unsupervised(
    "data.txt",
    model="cbow",
    mode="floret",
    hashCount=2,
    bucket=50000,
    minn=3,
    maxn=6,
)

# query vector
model.get_word_vector("broccoli")

# save full model
model.save_model("vectors.bin")

# export standard word-only vector table
model.save_vectors("vectors.vec")

# export floret vector table
model.save_floret_vectors("vectors.floret")

Note: with the default setting mode="fasttext", floret trains original fastText vectors.

Use floret vectors in spaCy

Import floret vectors into spaCy v3.2+:

spacy init vectors LANG vectors.floret spacy_vectors_model --mode floret

Notes

floret contains all features of the original fasttext module. See the fasttext docs for more information.

The fasttext and floret binary formats saved with model.save_model("model.bin") are not compatible.

Project details

Verified details

These details have been verified by PyPI
Maintainers
Avatar for explosion from gravatar.com explosion

Unverified details

These details have not been verified by PyPI
Project links
GitHub Statistics

View statistics for this project via Libraries.io, or by using our public dataset on Google BigQuery

Meta

License: MIT License (MIT)

Author: Explosion

Classifiers

Release history Release notifications | RSS feed

This version

0.10.5

0.10.4

0.10.3

0.10.2

0.10.1

0.10.0

0.10.0.dev2 pre-release

0.10.0.dev1 pre-release

0.10.0.dev0 pre-release

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

floret-0.10.5.tar.gz (70.9 kB view hashes)

Uploaded Source

Built Distributions

floret-0.10.5-cp312-cp312-win_amd64.whl (243.4 kB view hashes)

Uploaded CPython 3.12 Windows x86-64

floret-0.10.5-cp312-cp312-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (321.6 kB view hashes)

Uploaded CPython 3.12 manylinux: glibc 2.17+ x86-64

floret-0.10.5-cp312-cp312-manylinux_2_17_aarch64.manylinux2014_aarch64.whl (302.0 kB view hashes)

Uploaded CPython 3.12 manylinux: glibc 2.17+ ARM64

floret-0.10.5-cp312-cp312-macosx_11_0_x86_64.whl (373.2 kB view hashes)

Uploaded CPython 3.12 macOS 11.0+ x86-64

floret-0.10.5-cp312-cp312-macosx_11_0_arm64.whl (351.2 kB view hashes)

Uploaded CPython 3.12 macOS 11.0+ ARM64

floret-0.10.5-cp311-cp311-win_amd64.whl (242.6 kB view hashes)

Uploaded CPython 3.11 Windows x86-64

floret-0.10.5-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (321.6 kB view hashes)

Uploaded CPython 3.11 manylinux: glibc 2.17+ x86-64

floret-0.10.5-cp311-cp311-manylinux_2_17_aarch64.manylinux2014_aarch64.whl (302.8 kB view hashes)

Uploaded CPython 3.11 manylinux: glibc 2.17+ ARM64

floret-0.10.5-cp311-cp311-macosx_11_0_x86_64.whl (370.4 kB view hashes)

Uploaded CPython 3.11 macOS 11.0+ x86-64

floret-0.10.5-cp311-cp311-macosx_11_0_arm64.whl (351.4 kB view hashes)

Uploaded CPython 3.11 macOS 11.0+ ARM64

floret-0.10.5-cp310-cp310-win_amd64.whl (242.1 kB view hashes)

Uploaded CPython 3.10 Windows x86-64

floret-0.10.5-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (320.4 kB view hashes)

Uploaded CPython 3.10 manylinux: glibc 2.17+ x86-64

floret-0.10.5-cp310-cp310-manylinux_2_17_aarch64.manylinux2014_aarch64.whl (301.9 kB view hashes)

Uploaded CPython 3.10 manylinux: glibc 2.17+ ARM64

floret-0.10.5-cp310-cp310-macosx_11_0_x86_64.whl (368.9 kB view hashes)

Uploaded CPython 3.10 macOS 11.0+ x86-64

floret-0.10.5-cp310-cp310-macosx_11_0_arm64.whl (350.2 kB view hashes)

Uploaded CPython 3.10 macOS 11.0+ ARM64

floret-0.10.5-cp39-cp39-win_amd64.whl (236.7 kB view hashes)

Uploaded CPython 3.9 Windows x86-64

floret-0.10.5-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (320.7 kB view hashes)

Uploaded CPython 3.9 manylinux: glibc 2.17+ x86-64

floret-0.10.5-cp39-cp39-manylinux_2_17_aarch64.manylinux2014_aarch64.whl (302.2 kB view hashes)

Uploaded CPython 3.9 manylinux: glibc 2.17+ ARM64

floret-0.10.5-cp39-cp39-macosx_11_0_x86_64.whl (369.2 kB view hashes)

Uploaded CPython 3.9 macOS 11.0+ x86-64

floret-0.10.5-cp39-cp39-macosx_11_0_arm64.whl (350.5 kB view hashes)

Uploaded CPython 3.9 macOS 11.0+ ARM64

floret-0.10.5-cp38-cp38-win_amd64.whl (242.0 kB view hashes)

Uploaded CPython 3.8 Windows x86-64

floret-0.10.5-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (320.2 kB view hashes)

Uploaded CPython 3.8 manylinux: glibc 2.17+ x86-64

floret-0.10.5-cp38-cp38-manylinux_2_17_aarch64.manylinux2014_aarch64.whl (301.7 kB view hashes)

Uploaded CPython 3.8 manylinux: glibc 2.17+ ARM64

floret-0.10.5-cp38-cp38-macosx_11_0_arm64.whl (350.1 kB view hashes)

Uploaded CPython 3.8 macOS 11.0+ ARM64

floret-0.10.5-cp38-cp38-macosx_10_16_x86_64.whl (368.9 kB view hashes)

Uploaded CPython 3.8 macOS 10.16+ x86-64

floret-0.10.5-cp37-cp37m-win_amd64.whl (241.6 kB view hashes)

Uploaded CPython 3.7m Windows x86-64

floret-0.10.5-cp37-cp37m-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (324.0 kB view hashes)

Uploaded CPython 3.7m manylinux: glibc 2.17+ x86-64

floret-0.10.5-cp37-cp37m-manylinux_2_17_aarch64.manylinux2014_aarch64.whl (305.6 kB view hashes)

Uploaded CPython 3.7m manylinux: glibc 2.17+ ARM64

floret-0.10.5-cp37-cp37m-macosx_10_16_x86_64.whl (364.3 kB view hashes)

Uploaded CPython 3.7m macOS 10.16+ x86-64

floret-0.10.5-cp36-cp36m-win_amd64.whl (255.8 kB view hashes)

Uploaded CPython 3.6m Windows x86-64

floret-0.10.5-cp36-cp36m-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (324.3 kB view hashes)

Uploaded CPython 3.6m manylinux: glibc 2.17+ x86-64

floret-0.10.5-cp36-cp36m-manylinux_2_17_aarch64.manylinux2014_aarch64.whl (305.0 kB view hashes)

Uploaded CPython 3.6m manylinux: glibc 2.17+ ARM64

floret-0.10.5-cp36-cp36m-macosx_10_16_x86_64.whl (364.5 kB view hashes)

Uploaded CPython 3.6m macOS 10.16+ x86-64

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page