o ¹ÈÏiéã@s¤dZddlmZddlmZddlmZmZm Z ddl m Z e  e ¡Zd Zd ejd ed ed ejfdd„ZGdd„de ƒZGdd„deƒZGdd„deƒZgd¢ZdS)zFlax mT5 model.éNé)Úloggingé)ÚFlaxT5EncoderModelÚFlaxT5ForConditionalGenerationÚ FlaxT5Modelé)Ú MT5ConfigÚT5ConfigÚ input_idsÚ pad_token_idÚdecoder_start_token_idÚreturncCsdt |¡}|jdd…dd…f |dd…dd…f¡}|jdd…df |¡}t |dk||¡}|S)z1 Shift input ids one token to the right. Nréÿÿÿÿriœÿÿÿ)ÚjnpÚ zeros_likeÚatÚsetÚwhere)r r r Úshifted_input_ids©rú]/home/ubuntu/.local/lib/python3.10/site-packages/transformers/models/mt5/modeling_flax_mt5.pyÚshift_tokens_rights ,rc@óeZdZdZdZeZdS)Ú FlaxMT5Modela This class overrides [`FlaxT5Model`]. Please check the superclass for the appropriate documentation alongside usage examples. Examples: ```python >>> from transformers import FlaxMT5Model, AutoTokenizer >>> model = FlaxMT5Model.from_pretrained("google/mt5-small") >>> tokenizer = AutoTokenizer.from_pretrained("google/mt5-small") >>> article = "UN Offizier sagt, dass weiter verhandelt werden muss in Syrien." >>> summary = "Weiter Verhandlung in Syrien." >>> inputs = tokenizer(article, return_tensors="np") >>> decoder_input_ids = tokenizer(text_target=summary, return_tensors="np").input_ids >>> outputs = model(input_ids=inputs["input_ids"], decoder_input_ids=decoder_input_ids) >>> hidden_states = outputs.last_hidden_state ```Úmt5N©Ú__name__Ú __module__Ú __qualname__Ú__doc__Ú model_typer Ú config_classrrrrr*órc@r)ÚFlaxMT5EncoderModela  This class overrides [`FlaxT5EncoderModel`]. Please check the superclass for the appropriate documentation alongside usage examples. Examples: ```python >>> from transformers import FlaxT5EncoderModel, AutoTokenizer >>> model = FlaxT5EncoderModel.from_pretrained("google/mt5-small") >>> tokenizer = AutoTokenizer.from_pretrained("google/mt5-small") >>> article = "UN Offizier sagt, dass weiter verhandelt werden muss in Syrien." >>> summary = "Weiter Verhandlung in Syrien." >>> inputs = tokenizer(article, return_tensors="np") >>> decoder_input_ids = tokenizer(text_target=summary, return_tensors="np").input_ids >>> outputs = model(input_ids=inputs["input_ids"]) >>> hidden_states = outputs.last_hidden_state ```rNrrrrrr$Er#r$c@r)ÚFlaxMT5ForConditionalGenerationa- This class overrides [`FlaxT5ForConditionalGeneration`]. Please check the superclass for the appropriate documentation alongside usage examples. Examples: ```python >>> from transformers import FlaxMT5ForConditionalGeneration, AutoTokenizer >>> model = FlaxMT5ForConditionalGeneration.from_pretrained("google/mt5-small") >>> tokenizer = AutoTokenizer.from_pretrained("google/mt5-small") >>> article = "UN Offizier sagt, dass weiter verhandelt werden muss in Syrien." >>> summary = "Weiter Verhandlung in Syrien." >>> inputs = tokenizer(article, return_tensors="np") >>> decoder_input_ids = tokenizer(text_target=summary, return_tensors="np").input_ids >>> outputs = model(**inputs, decoder_input_ids=decoder_input_ids) >>> logits = outputs.logits ```rNrrrrrr%`r#r%)r$r%r)r Ú jax.numpyÚnumpyrÚutilsrÚt5.modeling_flax_t5rrrÚconfiguration_mt5r Ú get_loggerrÚloggerÚ_CONFIG_FOR_DOCÚndarrayÚintrrr$r%Ú__all__rrrrÚs