o i@sVdZddlmZmZmZddlZddlmZddlm Z ddl m Z GdddZ dS) z'Error Calculator module for Transducer.)ListOptionalTupleN)BeamSearchTransducer) AbsDecoder) JointNetworkcseZdZdZ  ddededeededede d e d d ffd d Z de j de j d e eeeeffddZde j de j d e eeffddZde j de j d efddZde j de j d efddZZS)ErrorCalculatoraNCalculate CER and WER for transducer models. Args: decoder: Decoder module. joint_network: Joint Network module. token_list: List of token units. sym_space: Space symbol. sym_blank: Blank symbol. report_cer: Whether to compute CER. report_wer: Whether to compute WER. Fdecoder joint_network token_list sym_space sym_blank report_cer report_werreturnNcsFtt||dddd|_||_||_||_||_||_||_ dS)z.Construct an ErrorCalculatorTransducer object.defaultF)r r beam_size search_type score_normN) super__init__r beam_searchr r spaceblankrr)selfr r r r r rr __class__[/home/ubuntu/.local/lib/python3.10/site-packages/espnet2/asr_transducer/error_calculator.pyrs  zErrorCalculator.__init__ encoder_outtargetc sd\}}td}tjjfddt|D}dd|D}||\}} j r: || }j rC || }||fS)a5Calculate sentence-level WER or/and CER score for Transducer model. Args: encoder_out: Encoder output sequences. (B, T, D_enc) target: Target label ID sequences. (B, L) Returns: : Sentence-level CER score. : Sentence-level WER score. )NNrcsg|] }|qSr)r).0br rrr Lz,ErrorCalculator.__call__..cSsg|] }|djddqS)rrN)yseq)r" nbest_hyprrrr%Ms) intsizetonextr parametersdevicerangeconvert_to_charr calculate_cerr calculate_wer) rr r!cerwer batchsize batch_nbestpred char_pred char_targetrr$r__call__8s  zErrorCalculator.__call__r7c sgg}}t|D]D\}}fdd|D}fdd||D}d|jd}|jd}d|jd}|jd}||||q ||fS)aEConvert label ID sequences to character sequences. Args: pred: Prediction label ID sequences. (B, U) target: Target label ID sequences. (B, L) Returns: char_pred: Prediction character sequences. (B, ?) char_target: Target character sequences. (B, ?) cg|] }jt|qSrr r))r"hrrrr%jr&z3ErrorCalculator.convert_to_char..cr;rr<)r"rr>rrr%kr& ) enumeratejoinreplacerrappend) rr7r!r8r9ipred_i char_pred_i char_target_irr>rr0Ys   zErrorCalculator.convert_to_charr8r9c Cstddl}gg}}t|D]"\}}|dd}||dd} |||| |t| q tt|t|S)zCalculate sentence-level CER score. Args: char_pred: Prediction character sequences. (B, ?) char_target: Target character sequences. (B, ?) Returns: : Average sentence-level CER score. rNrAr@) editdistancerBrDrEevallenfloatsum rr8r9rJ distanceslensrFrHr7r!rrrr1xs  zErrorCalculator.calculate_cerc Cs|ddl}gg}}t|D]&\}}|dd}||dd} |||| |t| q tt|t|S)zCalculate sentence-level WER score. Args: char_pred: Prediction character sequences. (B, ?) char_target: Target character sequences. (B, ?) Returns: : Average sentence-level WER score rNu▁rA) rJrBrDsplitrErKrLrMrNrOrrrr2s zErrorCalculator.calculate_wer)FF)__name__ __module__ __qualname____doc__rrrr)strboolrtorchTensorrrrMr:r0r1r2 __classcell__rrrrr sb  !   r) rVtypingrrrrY-espnet2.asr_transducer.beam_search_transducerr*espnet2.asr_transducer.decoder.abs_decoderr$espnet2.asr_transducer.joint_networkrrrrrrs