o i@sBdZddlmZmZGdddeddZGdddeZdgZd S) z Processor class for Bros. )ProcessingKwargsProcessorMixinc @s&eZdZddddddddddiZdS)BrosProcessorKwargs text_kwargsTF)add_special_tokenspaddingstridereturn_overflowing_tokensreturn_special_tokens_maskreturn_offsets_mapping return_lengthverboseN)__name__ __module__ __qualname__ _defaultsrre/home/ubuntu/veenaModal/venv/lib/python3.10/site-packages/transformers/models/bros/processing_bros.pyrsrF)totalcs0eZdZdZdgZdZeZdfdd ZZ S) BrosProcessora Constructs a Bros processor which wraps a BERT tokenizer. [`BrosProcessor`] offers all the functionalities of [`BertTokenizerFast`]. See the docstring of [`~BrosProcessor.__call__`] and [`~BrosProcessor.decode`] for more information. Args: tokenizer (`BertTokenizerFast`, *optional*): An instance of ['BertTokenizerFast`]. The tokenizer is a required input. tokenizer) BertTokenizerBertTokenizerFastNc s |durtdt|dS)Nz"You need to specify a `tokenizer`.) ValueErrorsuper__init__)selfrkwargs __class__rrr5szBrosProcessor.__init__)N) rrr__doc__ attributestokenizer_classrvalid_processor_kwargsr __classcell__rrrrr%s  rN)r!processing_utilsrrrr__all__rrrrs