AltCLIP model for use with Autodistill.
Project description
Autodistill AltCLIP Module
This repository contains the code supporting the AltCLIP base model for use with Autodistill.
AltCLIP is a multi-modal vision model. With AltCLIP, you can compare the similarity between text and images, or the similarlity between two images. AltCLIP was trained on multi-lingual text-image pairs, which means it can be used for zero-shot classification with text prompts in different languages. Read the AltCLIP paper for more information.
The Autodistill AltCLIP module enables you to use AltCLIP for zero-shot classification.
Read the full Autodistill documentation.
Read the CLIP Autodistill documentation.
Installation
To use AltCLIP with autodistill, you need to install the following dependency:
pip3 install autodistill-altclip
Quickstart
from autodistill_altclip import AltCLIP
from autodistill.detection import CaptionOntology
# define an ontology to map class names to our AltCLIP prompt
# the ontology dictionary has the format {caption: class}
# where caption is the prompt sent to the base model, and class is the label that will
# be saved for that caption in the generated results
# then, load the model
base_model = AltCLIP(
ontology=CaptionOntology(
{
"person": "person",
"a forklift": "forklift"
}
)
)
results = base_model.predict("coffeeshop.jpg")
print(results)
License
The AltCLIP model is licensed under an Apache 2.0 license. See the model README for more information.
🏆 Contributing
We love your input! Please see the core Autodistill contributing guide to get started. Thank you 🙏 to all our contributors!
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Hashes for autodistill-altclip-0.1.1.tar.gz
Algorithm | Hash digest | |
---|---|---|
SHA256 | 77b154d1664682517f86b02d1b94d3ac4fa1a3373192ff9c7cd12b8a4046a0e6 |
|
MD5 | a225d1bc0f1d8f1ea3d6ee3e216ce0e1 |
|
BLAKE2b-256 | 232f0f4bbbd5ab185631875574ac9207e7a606a48fa691fc7d6e3b378b8d8152 |
Hashes for autodistill_altclip-0.1.1-py3-none-any.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | c6042d4ad46b343199ab3cb3e39235e409d90ea569253b2f46ed1da697d75509 |
|
MD5 | 8f3869f2bbd28f3cad1bda874f4541fa |
|
BLAKE2b-256 | 63ae80ad72cae0d6b12ddf8d58fd8575efd66e22f5489e49da033faec1994487 |