Facing using while doing token classification using BLOOM LLM Model

Viewed 131

I am trying to import BloomTokenizer:

from transformers import BloomTokenizer, BloomModel

but receive the following error message:

ImportError                               Traceback (most recent call last)
<ipython-input-10-7a6e1f78a498> in <module>()
----> 1 from transformers import BloomTokenizer, BloomForTokenClassification
      2 import torch

ImportError: cannot import name 'BloomTokenizer' from 'transformers' (/usr/local/lib/python3.7/dist-packages/transformers/__init__.py)

PS: Transformer version 4.2

1 Answers

There is no BloomTokenizer but you can use BloomTokenizerFast

Related