huggingface-tokenizers

115 Questions
Newest Active Unanswered Frequent
Score
View
Card Compact
Huggingface BERT Tokenizer add new token
user_113240080
•
4
1
6319
huggingface-tokenizers bert-language-model huggingface-transformers
Huggingface saving tokenizer
user_25306740
•
18
3
18795
huggingface-tokenizers huggingface-transformers
Loading saved NER back into HuggingFace pipeline?
user_80279950
•
2
0
528
named-entity-recognition huggingface-tokenizers huggingface-transformers nlp
Any reason to save a pretrained BERT tokenizer?
user_107130840
•
2
3
1770
huggingface-tokenizers bert-language-model pytorch save
GPT2 on Hugging face(pytorch transformers) RuntimeError: grad can be implicitly created only for scalar outputs
user_80105680
•
2
1
653
huggingface-tokenizers huggingface-transformers pytorch nlp python
ValueError: TextEncodeInput must be Union[TextInputSequence, Tuple[InputSequence, InputSequence]] - Tokenizing BERT / Distilbert Error
user_86345890
•
22
4
22750
distilbert huggingface-tokenizers bert-language-model huggingface-transformers tokenize
How do I translate using HuggingFace from Chinese to English?
user_123609370
•
4
2
5043
huggingface-tokenizers huggingface-transformers machine-translation translation nlp
How to disable TOKENIZERS_PARALLELISM=(true | false) warning?
user_43614070
•
22
4
23050
huggingface-tokenizers huggingface-transformers pytorch python
How to encode multiple sentences using transformers.BertTokenizer?
user_14873360
•
11
2
12160
huggingface-tokenizers word-embedding huggingface-transformers
Hugging-Face Transformers: Loading model from path error
user_114780630
•
5
3
4183
huggingface-tokenizers huggingface-transformers
Hot Questions