o ´©iº ã@s4dZddlmZmZddlZGdd„dejjƒZdS)z+VGG2L module definition for custom encoder.é)ÚTupleÚUnionNc sŽeZdZdZddededejjf‡fdd„ Zdej d ej d e e ej ej fe e ej ej fej fffd d „Z d ej d ej fd d„Z ‡ZS)ÚVGG2LzœVGG2L module for custom encoder. Args: idim: Input dimension. odim: Output dimension. pos_enc: Positional encoding class. NÚidimÚodimÚpos_enccsìtƒ ¡tj tjjddddddtj ¡tjjddddddtj ¡tj d¡tjjddddddtj ¡tjjddddddtj ¡tj d¡¡ |_|durftj tj  d|d d |¡|¡|_ dStj  d|d d |¡|_ dS) zConstruct a VGG2L object.éé@é)ÚstrideÚpadding)r éé€)r r Nr ) ÚsuperÚ__init__ÚtorchÚnnÚ SequentialÚConv2dÚReLUÚ MaxPool2dÚvgg2lÚLinearÚoutput)Úselfrrr©Ú __class__©úY/home/ubuntu/.local/lib/python3.10/site-packages/funasr/models/transformer/utils/vgg2l.pyrs$   ö  ÿ zVGG2L.__init__ÚfeatsÚ feats_maskÚreturnc Csn| d¡}| |¡}| ¡\}}}}| | dd¡ ¡ ||||¡¡}|dur1| |¡}||fS|}||fS)azForward VGG2L bottleneck. Args: feats: Feature sequences. (B, F, D_feats) feats_mask: Mask of feature sequences. (B, 1, F) Returns: vgg_output: VGG output sequences. (B, sub(F), D_out) or ((B, sub(F), D_out), (B, sub(F), D_att)) vgg_mask: Mask of VGG output sequences. (B, 1, sub(F)) rr N)Ú unsqueezerÚsizerÚ transposeÚ contiguousÚviewÚcreate_new_mask) rrr Ú vgg_outputÚbÚcÚtÚfÚvgg_maskrrrÚforward*s  $ þz VGG2L.forwardcCs˜| d¡| d¡d}|dd…dd…d|…fdd…dd…ddd…f}| d¡| d¡d}|dd…dd…d|…fdd…dd…ddd…f}|S)zÛCreate a subsampled mask of feature sequences. Args: feats_mask: Mask of feature sequences. (B, 1, F) Returns: vgg_mask: Mask of VGG2L output sequences. (B, 1, sub(F)) r r N)r#)rr Ú vgg1_t_lenr-Ú vgg2_t_lenrrrr'Hs  22zVGG2L.create_new_mask)N)Ú__name__Ú __module__Ú __qualname__Ú__doc__ÚintrrÚModulerÚTensorrrr.r'Ú __classcell__rrrrrs ÿ ÿr)r4Útypingrrrrr6rrrrrÚs