nlp学习笔记

作者 : admin 本文共456个字，预计阅读时间需要2分钟发布时间： 2024-06-16 共1人阅读

很多入门例子

bert chinese

很多入门例子

nlp学习笔记插图

https://github.com/lansinuote/Huggingface_Toturials

bert chinese

import torch 
import torch.nn as nn
from transformers import AutoTokenizer, AutoModel, BertModel, TFBertModel, BertTokenizer

# youpath = 'D:/bert-base-chinese'
# tokenizer =AutoTokenizer.from_pretrained(youpath)

tokenizer = BertTokenizer.from_pretrained(
    pretrained_model_name_or_path='bert-base-chinese',
    cache_dir=None,
    force_download=False,
)

model = BertModel.from_pretrained('bert-base-chinese')