Read and use many word embedding formats

These details have not been verified by PyPI

Project links

GitHub Statistics

View statistics for this project via Libraries.io, or by using our public dataset on Google BigQuery

Project description

🐍 snakefusion

Introduction

snakefusion is a Python package for reading, writing, and using finalfusion, fastText, floret, GloVe, and word2vec embeddings. This package is a thin wrapper around the Rust finalfusion crate.

snakefusion supports the same types of embeddings as finalfusion:

Vocabulary:
- No subwords
- Subwords
Embedding matrix:
- Array
- Memory-mapped
- Quantized
Format:
- fastText
- finalfusion
- floret
- GloVe
- word2vec

Building from source

Building snakefusion from source requires a Rust toolchain that is installed through rustup and setuptools-rust:

$ pip install --upgrade setuptools-rust

You can then build and install snakefusion in your environment:

$ pip install .

Documentation

Read the snakefusion documentation for a quickstart and API reference.

You use finalfrontier to train new embeddings, or download some pretrained embeddings.

Project details

These details have not been verified by PyPI

Project links

GitHub Statistics

View statistics for this project via Libraries.io, or by using our public dataset on Google BigQuery

Release history Release notifications | RSS feed

This version

0.1.6

Dec 17, 2021

0.1.5

Dec 12, 2021

0.1.4

Dec 12, 2021

0.1.3

Dec 5, 2021

0.1.2

Dec 2, 2021

0.1.0

Dec 1, 2021

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

snakefusion-0.1.6.tar.gz (86.5 kB view hashes)

Uploaded Dec 17, 2021 Source

Built Distributions

snakefusion-0.1.6-cp36-abi3-win_amd64.whl (657.9 kB view hashes)

Uploaded Dec 17, 2021 CPython 3.6+ Windows x86-64

snakefusion-0.1.6-cp36-abi3-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (5.4 MB view hashes)

Uploaded Dec 17, 2021 CPython 3.6+ manylinux: glibc 2.17+ x86-64

snakefusion-0.1.6-cp36-abi3-macosx_10_9_x86_64.macosx_11_0_arm64.macosx_10_9_universal2.whl (1.5 MB view hashes)

Uploaded Dec 17, 2021 CPython 3.6+ macOS 10.9+ universal2 (ARM64, x86-64) macOS 10.9+ x86-64 macOS 11.0+ ARM64

Hashes for snakefusion-0.1.6.tar.gz

Hashes for snakefusion-0.1.6.tar.gz
Algorithm	Hash digest
SHA256	`f49f4d022208d0e4c247db90d475f3c8727241ae2fd272074cb0a41e03aa5550`
MD5	`7af50bf2173bd10fd87c5ef085a5b2ab`
BLAKE2b-256	`b3f7ad3305355a2a55ccc4ab33ac334f55ed5e20b0d3dc2c2a0aa7ed74cc9813`

Hashes for snakefusion-0.1.6-cp36-abi3-win_amd64.whl

Hashes for snakefusion-0.1.6-cp36-abi3-win_amd64.whl
Algorithm	Hash digest
SHA256	`b030808601cb11aa3226f797274065b6b5a3fa8486cb8715940169e32026f3e2`
MD5	`8ac89a50b59e9f9e2615852007478b02`
BLAKE2b-256	`41e271bd8f2fafe7e6efee62cd0065df084d9d6ad6f40bab7471ad18226e916a`

Hashes for snakefusion-0.1.6-cp36-abi3-manylinux_2_17_x86_64.manylinux2014_x86_64.whl

Hashes for snakefusion-0.1.6-cp36-abi3-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm	Hash digest
SHA256	`2173b14f38918c50b7cb6db52632f3ede066ab3e972b074ac56cc37df7591f73`
MD5	`af181df41f641bebba13cba15f66df07`
BLAKE2b-256	`fd629187cf9c85ab845e07e0394cc42313a5ed780b8a0e53abc9b6a040522933`

Hashes for snakefusion-0.1.6-cp36-abi3-macosx_10_9_x86_64.macosx_11_0_arm64.macosx_10_9_universal2.whl

Hashes for snakefusion-0.1.6-cp36-abi3-macosx_10_9_x86_64.macosx_11_0_arm64.macosx_10_9_universal2.whl
Algorithm	Hash digest
SHA256	`77e7287f5b52309e93285116e2ebfb68f6b5b585846986b8aa05560fa474a539`
MD5	`7c3c2a11650c4c9d003a538df1e0be09`
BLAKE2b-256	`d8ff526df7011a56420c2f39c251ef845732808eed9649aab276c87366166505`