huggingface-tokenizers

115 Questions
Newest Active Unanswered Frequent
Score
View
Card Compact
BERT get sentence embedding
user_25436220
•
4
2
5248
huggingface-tokenizers bert-language-model huggingface-transformers nlp python
HuggingFace BPE Trainer Error - Training Tokenizer
user_1922040
•
1
1
501
huggingface-tokenizers google-colaboratory nlp python
How long does load_dataset take time in huggingface?
user_26510730
•
2
0
173
huggingface-datasets huggingface-tokenizers google-colaboratory load python-3.x
How to convert tokenized words back to the original ones after inference?
user_108747910
•
4
1
529
huggingface-datasets huggingface-tokenizers huggingface-transformers pytorch python
Using Hugging-face transformer with arguments in pipeline
user_44096600
•
2
1
801
transformer-model huggingface-tokenizers bert-language-model huggingface-transformers pytorch
Problem with inputs when building a model with TFBertModel and AutoTokenizer from HuggingFace's transformers
user_115791840
•
8
6
2261
huggingface-tokenizers bert-language-model huggingface-transformers keras tensorflow
How to add new special token to the tokenizer?
user_31968450
•
3
1
6609
sentencepiece huggingface-tokenizers bert-language-model
Which loss function to use for training sparse multi-label text classification problem and class skewness/imbalance
user_99077330
•
2
1
448
huggingface-tokenizers multilabel-classification loss-function huggingface-transformers pytorch
HuggingFace-Transformers --- NER single sentence/sample prediction
user_61170170
•
2
1
388
huggingface-tokenizers huggingface-transformers pytorch deep-learning python-3.x
HUGGINGFACE TypeError: '>' not supported between instances of 'NoneType' and 'int'
user_166200100
•
3
1
1549
huggingface-datasets huggingface-tokenizers data-science huggingface-transformers deep-learning
Hot Questions