o ¾e¦i;ã@s$dZddlmZeZeZddgZdS)al Compatibility shims for BART tokenizers in v5. In v5 we consolidate on the tokenizers-library backend and remove separate "slow" vs "fast" implementations. BART uses the same byte-level BPE tokenizer as RoBERTa, so we expose `BartTokenizer` and `BartTokenizerFast` as aliases to `RobertaTokenizer` to preserve the public API expected by existing code and tests. é)ÚRobertaTokenizerÚ BartTokenizerÚBartTokenizerFastN)Ú__doc__Úroberta.tokenization_robertarÚ_RobertaTokenizerrrÚ__all__©r r úh/home/ubuntu/transcripts/venv/lib/python3.10/site-packages/transformers/models/bart/tokenization_bart.pyÚs