o ¾e¦iDã@s*dZddlmZGdd„deƒZdgZdS)z"Tokenization classes for ConvBERT.é)Ú BertTokenizerc@seZdZdZdS)ÚConvBertTokenizera Construct a ConvBERT tokenizer (backed by HuggingFace's tokenizers library). Based on WordPiece. This tokenizer inherits from [`BertTokenizer`] which contains most of the main methods. Users should refer to this superclass for more information regarding those methods. N)Ú__name__Ú __module__Ú __qualname__Ú__doc__©rrúp/home/ubuntu/transcripts/venv/lib/python3.10/site-packages/transformers/models/convbert/tokenization_convbert.pyrsrN)rÚmodels.bert.tokenization_bertrrÚ__all__rrrr Ús