o mi) @sdZddlZddlZddlZddlZddlmZddlmZ ddl m Z m Z ddl mZegdZd0d ejd ed ejfd dZd1d ejded ed ejfddZ d2dejdededed ef ddZd2dejdededefddZd3dejdejeefdedefd d!Zdejdejeeffd"d#ZGd$d%d%ejZGd&d'd'ejZGd(d)d)ejZ Gd*d+d+ejZ!Gd,d-d-ejZ"Gd.d/d/ejZ#dS)4z,Convolutional layers wrappers and utilities.N)nn) functional) spectral_norm weight_norm) ConvLayerNorm)nonerrtime_layer_norm layer_normtime_group_normrmodulenormreturncCs0|tvsJ|dkrt|S|dkrt|S|S)Nrr)CONV_NORMALIZATIONSrr)r r rlr>cFeZdZdZdiddedejeejfffddZdd Z Z S) NormConv2dzWrapper around Conv2d and normalization applied to this conv to provide a uniform interface across normalization approaches. rr rr rcsFtttj|i|||_t|jfd|d||_||_dSNF)rr ) rBrCrrConv2drrr rErGr rrHrIrJrrrCs  zNormConv2d.__init__cCrMrArNrOrrrrPrQzNormConv2d.forward rSrTrUrVrXrYrZr[rCrPr\rrrJrr_}s r_c r=) NormConvTranspose1dzWrapper around ConvTranspose1d and normalization applied to this conv to provide a uniform interface across normalization approaches. Frr?rr rcr@rA) rBrCrrConvTranspose1dconvtrrr rErFrJrrrCrLzNormConvTranspose1d.__init__cCrMrArgr rOrrrrPrQzNormConvTranspose1d.forwardrRrrrJrrer]recr^) NormConvTranspose2dzWrapper around ConvTranspose2d and normalization applied to this conv to provide a uniform interface across normalization approaches. rr`r rcs@tttj|i|||_t|jfd|d||_dSra)rBrCrrConvTranspose2drgrr rcrJrrrCs zNormConvTranspose2d.__init__cCrMrArhrOrrrrPrQzNormConvTranspose2d.forwardrdrrrJrris ricsteZdZdZddddddidfdeded ed ed ed ed edededejeej fdeffdd Z ddZ Z S)SConv1dz]Conv1d with some builtin handling of asymmetric or causal padding and normalization. rTFrr3 in_channelsrrr dilationgroupsbiasrr rpad_modec sft|dkr|dkrtd|d|d|dt||||||||| | d |_||_| |_dS)NrzKSConv1d has been initialized with stride > 1 and dilation > 1 (kernel_size=z stride=z , dilation=z).)rmrnrorr r)rBrCwarningswarnr>rrrp) rGrlrrr rmrnrorr rrprJrrrCs   zSConv1d.__init__c Cs|j\}}}|jjjd}|jjjd}|jjjd}|d||d}t||||} |jr:t||| f|jd}n|d} || } t|| | | f|jd}||S)Nrr)r1) r#rrr rmr)rr;rp) rGrBCTrr rmr!r,r6r5rrrrPs  zSConv1d.forward) rSrTrUrVintrWrXrYrZr[rCrPr\rrrJrrks4 rkcsbeZdZdZddddifdededed ed ed ed ed ej eej fffdd Z ddZ Z S)SConvTranspose1dzfConvTranspose1d with some builtin handling of asymmetric or causal padding and normalization. rFr?rlrrr rr trim_right_ratiorc sbtt|||||||d|_||_||_|js#|jdks#Jd|jdkr-|jdks/JdS)Nr?ryzB`trim_right_ratio` != 1.0 only makes sense for causal convolutionsr/)rBrCrergrrz) rGrlrrr rr rzrrJrrrCs  zSConvTranspose1d.__init__cCs|jjjd}|jjjd}||}||}|jr/t||j}||}t|||f}|S|d}||}t|||f}|S)Nrrs)rgrr rr$r%rzr<)rGrrr r!yr6r5rrrrPs zSConvTranspose1d.forward)rSrTrUrVrwrWrXfloatrYrZr[rCrPr\rrrJrrxs&  rx)r)Fr)r)r.r/)$rVr$typingrYrqtorchrtorch.nnrr*torch.nn.utilsrrr r frozensetrModulerXrrWrTensorrwr)r-Tupler|r;r<r>r_rerirkrxrrrrs6       ( &