o i@sXdZddlmZmZmZddlZddlmZddlm Z ddl m Z Gddde Z dS) z3Stateless decoder definition for Transducer models.)ListOptionalTupleN)check_argument_types) Hypothesis) AbsDecoderc seZdZdZ   d"dedededed d f fd d Z d#d ejde e eje ejfd ejfddZ dejde edd d e ejd ffddZ de ed e ejd ffddZdejd d fddZded d fddZde ejded d fd d!ZZS)$StatelessDecoderzStateless Transducer decoder module. Args: vocab_size: Output size. embed_size: Embedding size. embed_dropout_rate: Dropout rate for embedding layer. embed_pad: Embed/Blank symbol ID. r vocab_size embed_sizeembed_dropout_rate embed_padreturnNcs^tts Jtjj|||d|_tjj|d|_||_ ||_ t | j |_ i|_dS)z$Construct a StatelessDecoder object.) padding_idx)pN)super__init__rtorchnn EmbeddingembedDropoutr output_sizer next parametersdevice score_cache)selfr r r r __class__d/home/ubuntu/.local/lib/python3.10/site-packages/espnet2/asr_transducer/decoder/stateless_decoder.pyrs   zStatelessDecoder.__init__labelsstatescCs|||}|S)zEncode source label sequences. Args: labels: Label ID sequences. (B, L) states: Decoder hidden states. None Returns: dec_embed: Decoder output sequences. (B, U, D_emb) )r r)rr#r$ dec_embedr!r!r"forward,szStatelessDecoder.forwardlabellabel_sequencestatecCsFdtt|}||jvr|j|}n ||}||j|<|ddfS)aEOne-step forward hypothesis. Args: label: Previous label. (1, 1) label_sequence: Current label sequence. state: Previous decoder hidden states. None Returns: dec_out: Decoder output sequence. (1, D_emb) state: Decoder hidden states. None _rN)joinmapstrrr)rr'r(r) str_labelsr%r!r!r"score?s      zStatelessDecoder.scorehypscCs2tjdd|D|jd}||}|ddfS)zOne-step forward hypotheses. Args: hyps: Hypotheses. Returns: dec_out: Decoder output sequences. (B, D_dec) states: Decoder hidden states. None cSsg|]}|jdgqS))yseq).0hr!r!r" jsz0StatelessDecoder.batch_score..rN)r LongTensorrrsqueeze)rr0r#r%r!r!r" batch_score\s zStatelessDecoder.batch_scorercCs ||_dS)zNSet GPU device to use. Args: device: Device ID. Nr6)rrr!r!r" set_deviceos zStatelessDecoder.set_device batch_sizecCdS)zInitialize decoder states. Args: batch_size: Batch size. Returns: : Initial decoder hidden states. None Nr!)rr<r!r!r" init_statexs zStatelessDecoder.init_stateidxcCr=)zGet specified ID state from decoder hidden states. Args: states: Decoder hidden states. None idx: State ID to extract. Returns: : Decoder hidden state for given ID. None Nr!)rr$r?r!r!r" select_states zStatelessDecoder.select_state)r r r)N)__name__ __module__ __qualname____doc__intfloatrrTensorrrr&rr/rr:rr;r>r@ __classcell__r!r!rr"r sR       $ r) rDtypingrrrr typeguardr-espnet2.asr_transducer.beam_search_transducerr*espnet2.asr_transducer.decoder.abs_decoderrrr!r!r!r"s