Swarm Intelligence in Python
Project description
pybert
预训练语言模型
bert模型放在 bert_pretain目录下,三个文件:
- pytorch_model.bin
- bert_config.json
- vocab.txt
预训练模型下载地址:
bert_Chinese: 模型 https://s3.amazonaws.com/models.huggingface.co/bert/bert-base-chinese.tar.gz
词表 https://s3.amazonaws.com/models.huggingface.co/bert/bert-base-chinese-vocab.txt
来自这里
备用:模型的网盘地址:https://pan.baidu.com/s/123VJOsbHyi6RW0zyvOG0Ow?pwd=lq7a
训练数据下载
训练和预测
训练
from pybert.models import bert
from pybert.train_eval import load_and_train
dataset = 'THUCNews' # 数据集
logfile = 'log.txt' # 日志文件
config = bert.Config(dataset, logfile=logfile)
load_and_train(config)
预测
# coding: UTF-8
import pybert.models.bert as bert
from pybert.train_eval import Prediction
config = bert.Config(dataset='THUCNews')
prediction = Prediction(config)
sentences = ['野兽用纪录打爆第二中锋 掘金版三巨头已巍然成型'] # * 128
predict_label, score = prediction.predict(sentences)
print("predict label:")
print(predict_label)
对应论文
[1] BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
pybert-0.0.1.tar.gz
(28.3 kB
view hashes)
Built Distribution
pybert-0.0.1-py3-none-any.whl
(29.9 kB
view hashes)