o ei @sBdZddlZddlmZddlmZeeZGdddejZ dS)zHLibrary implementing transducer_joint. Author Abdelwahab HEBA 2020 N) get_loggercs<eZdZdZddejjffdd ZddZdd Z Z S) Transducer_jointaComputes joint tensor between Transcription network (TN) & Prediction network (PN) Arguments --------- joint_network : torch.class (neural network modules) if joint == "concat", we call this network after the concatenation of TN and PN if None, we don't use this network. joint : str join the two tensors by ("sum",or "concat") option. nonlinearity : torch class Activation function used after the joint between TN and PN Type of nonlinearity (tanh, relu). Example ------- >>> from speechbrain.nnet.transducer.transducer_joint import Transducer_joint >>> from speechbrain.nnet.linear import Linear >>> input_TN = torch.rand(8, 200, 1, 40) >>> input_PN = torch.rand(8, 1, 12, 40) >>> joint_network = Linear(input_size=80, n_neurons=80) >>> TJoint = Transducer_joint(joint_network, joint="concat") >>> output = TJoint(input_TN, input_PN) >>> output.shape torch.Size([8, 200, 12, 80]) Nsumcs"t||_||_||_dS)N)super__init__ joint_networkjoint nonlinearity)selfrrr  __class__j/home/ubuntu/transcripts/venv/lib/python3.10/site-packages/speechbrain/nnet/transducer/transducer_joint.pyr*s  zTransducer_joint.__init__cCs||dS)z Arguments --------- first_input : tensor A first input used for initializing the parameters. N)r)r first_inputr r r init_params2szTransducer_joint.init_paramscCs6t|jt|jkrtdt|jdks t|jdks td|jdkr)||}|jdkrt|jdkr|t|jd}|}|}ddt|d d |d d D}|t||jd g}|t||jd g}tj ||f|d }nt|jdkrtj ||fd d }|j d ur| |}| |S) a,Returns the fusion of inputs tensors. Arguments --------- input_TN : torch.Tensor Input from Transcription Network. input_PN : torch.Tensor Input from Prediction Network. Returns ------- fusion of input tensors. z"Arg 1 and 2 must be have same sizez(Tensors 1 and 2 must have dim=1 or dim=4rconcatcSsg|] \}}t||qSr )max).0ijr r r Wsz,Transducer_joint.forward..N)dimr) lenshape ValueErrorrzipsizeexpandtorchSizecatrr )r input_TNinput_PNrrxsymatszr r rforward;s,      zTransducer_joint.forward) __name__ __module__ __qualname____doc__r!nn LeakyReLUrrr) __classcell__r r r rrs   r) r-r!torch.nnr.speechbrain.utils.loggerrr*loggerModulerr r r rs