o i)@sdZddlZddlmZddlmZdedefddZdedefd d Zdedefd d Zdedefd dZ dedefddZ dedefddZ dedefddZ dedefddZ dedefddZdS)zTransducer model arguments.N)_ArgumentGroup) strtoboolgroupreturncCs.|jddtgddd|jddtdd |S) %Define general arguments for encoder.z--etypeblstmp)customlstmblstmlstmprvgglstmp vggblstmpvgglstmvggblstmgrubgrugrupbgrupvgggrupvggbgrupvgggruvggbgruz$Type of encoder network architecturedefaulttypechoiceshelpz--dropout-ratezDropout rate for the encoderrrr add_argumentstrfloatrr$d/home/ubuntu/.local/lib/python3.10/site-packages/espnet/nets/pytorch_backend/transducer/arguments.pyadd_encoder_general_argumentssr&cCsN|jddtdd|jdddtdd|jd d td d|jd d tdd|S)z!Define arguments for RNN encoder.z --elayerszPNumber of encoder layers (for shared recognition part in multi-speaker asr mode)rz--eunitsz-ui,zNumber of encoder hidden unitsz--eprojs@z"Number of encoder projection unitsz --subsample1zhSubsample input frames x_y_z means subsample every x frame at 1st layer, every y frame at 2nd layer etc.)r intr!r#r$r$r%add_rnn_encoder_arguments-s.r+cCs|jdtdddd|jddtdd |jd td gd d d|jdtddd|jdtddd|jdtdgddd|jdtdddgdd|jdtdgdd d|jd!td"gdd#d|S)$z$Define arguments for Custom encoder.z--enc-block-archappendNz)Encoder architecture definition by blocksractionrrz--enc-block-repeatz3Repeat N times the provided encoder blocks if N > 1rz--custom-enc-input-layerconv2d)r0vgg2llinearembedzCustom encoder input layer typerrrrz--custom-enc-input-dropout-raterz*Dropout rate of custom encoder input layer)rrrz'--custom-enc-input-pos-enc-dropout-ratezADropout rate of positional encoding in custom encoder input layerz%--custom-enc-positional-encoding-typeabs_pos)r5scaled_abs_posrel_posz-Custom encoder positional encoding layer typez--custom-enc-self-attn-type self_attn rel_self_attnz"Custom encoder self-attention typez--custom-enc-pw-activation-typerelur:hardtanhseluswishz(Custom encoder pointwise activation typez%--custom-enc-conv-mod-activation-typer>z3Custom encoder convolutional module activation type)r evalr*r!r"r#r$r$r%add_custom_encoder_argumentsKszr@cCs@|jddtgddd|jddtdd |jd dtd d |S) rz--dtyper )r rrzType of decoder to userz--dropout-rate-decoderrzDropout rate for the decoderrz--dropout-rate-embed-decoderz,Dropout rate for the decoder embedding layerrr#r$r$r%add_decoder_general_argumentss(rAcCs:|jddtdd|jddtdd|jddtd d|S) z!Define arguments for RNN decoder.z--dec-embed-dimr(z'Number of decoder embeddings dimensionsrz --dlayersr/zNumber of decoder layersz--dunitszNumber of decoder hidden units)r r*r#r$r$r%add_rnn_decoder_argumentssrBcCsZ|jdtdddd|jddtdd |jd td d d gd d|jdtdgddd|S)z$Define arguments for Custom decoder.z--dec-block-archr,Nz Custom decoder blocks definitionr-z--dec-block-repeatr/z3Repeat N times the provided decoder blocks if N > 1rz--custom-dec-input-layerr3r2zCustom decoder input layer typer4z--custom-dec-pw-activation-typer:r;z(Custom decoder pointwise activation type)r r?r*r!r#r$r$r%add_custom_decoder_argumentss8rCcCsp|jddtdd|jddtdd|jdd td d|jd td d d|jdtddd|jdtddd|S)z7Define arguments for training with Custom architecture.z--optimizer-warmup-stepsiazOptimizer warmup stepsrz --noam-lrg$@zInitial value of learning ratez --noam-adimrz0Most dominant attention dimension for scheduler.z--transformer-warmup-stepszaOptimizer warmup steps. The parameter is deprecated, please use --optimizer-warmup-steps instead.optimizer_warmup_steps)rrdestz--transformer-lrzZInitial value of learning rate. The parameter is deprecated, please use --noam-lr instead.noam_lrz--adimzmMost dominant attention dimension for scheduler. The parameter is deprecated, please use --noam-adim instead. noam_adim)r r*r"r#r$r$r%add_custom_training_argumentssJrHcCsf|jddtdd|jddtdd|jdtd gd d d |jd tdddd|jddtdd|S)z.Define general arguments for Transducer model.z--transducer-weightg?zWeight of main Transducer loss.rz --joint-dimr(z#Number of dimensions in joint spacez--joint-activation-typetanh)r:rIr>zJoint network activation typer4z --score-norm?Tz%Normalize Transducer scores by lengthrnargsrrz--fastemit-lambdarzHRegularization parameter for FastEmit (https://arxiv.org/abs/2010.11148))r r"r*r!rr#r$r$r%add_transducer_argumentssBrMcCs|jdtdddd|jddtdd |jd d td d |jd tdddd|jddtdd |jdd tdd |jdtdddd|jddtdd |jddtjdd |jddtdd |jdd tdd |jd tddd!d|jd"dtd#d |S)$z!Add arguments for auxiliary task.z--use-ctc-lossrJFz&Whether to compute auxiliary CTC loss.rKz--ctc-loss-weightg?zWeight of auxiliary CTC loss.rz--ctc-loss-dropout-raterzDropout rate for auxiliary CTC.z --use-lm-lossz7Whether to compute auxiliary LM loss (label smoothing).z--lm-loss-weightzWeight of auxiliary LM loss.z--lm-loss-smoothing-ratez?Smoothing rate for LM loss. If > 0, label smoothing is enabled.z--use-aux-transducer-lossz-Whether to compute auxiliary Transducer loss.z--aux-transducer-loss-weightg?z$Weight of auxiliary Transducer loss.z'--aux-transducer-loss-enc-output-layersNzNList of intermediate encoder layers for auxiliary transducer loss computation.z--aux-transducer-loss-mlp-dimr(zEMultilayer perceptron hidden dimension for auxiliary Transducer loss.z&--aux-transducer-loss-mlp-dropout-ratezAMultilayer perceptron dropout rate for auxiliary Transducer loss.z--use-symm-kl-div-lossz0Whether to compute symmetric KL divergence loss.z--symm-kl-div-loss-weightz'Weight of symmetric KL divergence loss.)r rr"ast literal_evalr*r#r$r$r%add_auxiliary_task_arguments,srP)__doc__rNargparserdistutils.utilrr&r+r@rArBrCrHrMrPr$r$r$r%s  %B!-&