o %ݫi@sddZddlZddlZddlmmZddlmZddl m Z e e Z dej d<GdddeZdS) zThis lobe enables the integration of huggingface pretrained LaBSE models. Reference: https://arxiv.org/abs/2007.01852 Transformer from HuggingFace needs to be installed: https://huggingface.co/transformers/installation.html Authors * Ha Nguyen 2023 N)HFTransformersInterface) get_loggerfalseTOKENIZERS_PARALLELISMcs.eZdZdZ  dfdd ZddZZS)LaBSEa,This lobe enables the integration of HuggingFace and SpeechBrain pretrained LaBSE models. Source paper LaBSE: https://arxiv.org/abs/2007.01852 Transformer from HuggingFace needs to be installed: https://huggingface.co/transformers/installation.html The model can be used as a fixed text-based sentence-level embeddings generator or can be finetuned. It will download automatically the model from HuggingFace or use a local path. Arguments --------- source : str HuggingFace hub name: e.g "setu4993/LaBSE" save_path : str Path (dir) of the downloaded model. freeze : bool (default: True) If True, the model is frozen. If False, the model will be trained alongside with the rest of the pipeline. output_norm : bool (default: True) If True, normalize the output. Example ------- >>> inputs = ["La vie est belle"] >>> model_hub = "setu4993/smaller-LaBSE" >>> save_path = "savedir" >>> model = LaBSE(model_hub, save_path) >>> outputs = model(inputs) Tcs(tj|||d|j|d||_dS)N)source save_pathfreeze)r)super__init__load_tokenizer output_norm)selfrrr r  __class__k/home/ubuntu/.local/lib/python3.10/site-packages/speechbrain/lobes/models/huggingface_transformers/labse.pyr 9s  zLaBSE.__init__cCs|jrLt=|j|ddd}|D]}||j|jjd||<d||_q|jd i|j }|j r;t j |dd}|WdS1sGwY|j|ddd}|D]}||j|jjd||<qX|jd i|j }|j rzt j |dd}|S) zThis method implements a forward of the labse model, which generates sentence-level embeddings from input text. Arguments ---------- input_texts (translation): list The list of texts (required). ptT)return_tensorspadding)deviceF)pNr) r torchno_grad tokenizerkeystomodelr requires_grad pooler_outputr F normalize)r input_textskey embeddingsrrrforwardFs0     z LaBSE.forward)TT)__name__ __module__ __qualname____doc__r r& __classcell__rrrrrs " r)r*osrtorch.nn.functionalnn functionalr!=speechbrain.lobes.models.huggingface_transformers.huggingfacerspeechbrain.utils.loggerrr'loggerenvironrrrrrs