o i @shddlZddlmZmZddlmZddlZGdddejjZGdddejZ Gdd d ejZ dS) N) MiniCPMModelMiniCPM4Configcs&eZdZfddZdddZZS)SinusoidalPosEmbcs*t||_|jddksJddS)Nrrz(SinusoidalPosEmb requires dim to be even)super__init__dim)selfr __class__S/home/ubuntu/.local/lib/python3.10/site-packages/voxcpm/modules/locdit/local_dit.pyrs zSinusoidalPosEmb.__init__cCs|jdkr |d}|j}|jd}td|d}ttj||j |d| }||d|d}tj | | fdd}|S)Nrri')dtypedevicer) ndim unsqueezerrmathlogtorchexparangercatsincos)r xscalerhalf_dimembr r r forward s   zSinusoidalPosEmb.forward)r)__name__ __module__ __qualname__rr" __classcell__r r r r rs rcs6eZdZ d dededeffdd ZddZZS) TimestepEmbeddingN in_channelstime_embed_dimout_dimcsNttj||dd|_t|_|dur|}n|}tj||dd|_dS)NTbias)rrnnLinearlinear_1SiLUactlinear_2)r r(r)r*time_embed_dim_outr r r rs  zTimestepEmbedding.__init__cCs"||}||}||}|SN)r/r1r2)r sampler r r r"+s   zTimestepEmbedding.forwardr4)r#r$r%intrr"r&r r r r r'sr'c sVeZdZdZ ddedeffdd Zdejdejd ejd ejd ejf d d Z Z S) VoxCPMLocDiTz6 Diffusion model with a Transformer backbone. @configr(cst||_||_||_tj||jdd|_tj||jdd|_ tj|j|jdd|_ t |j|_ t |j|jd|_t |j|jd|_|jdksNJdt||_dS)NTr+)r(r)rz"vocab_size must be 0 for local DiT)rrr( out_channelsr9r-r. hidden_sizein_proj cond_projout_projrtime_embeddingsr'time_mlpdelta_time_mlp vocab_sizerdecoder)r r9r(r r r r7s$  zVoxCPMLocDiT.__init__rmutconddtc Cs||dd}||dd}|d}|||j}||}|||j}| |}||}t j || d||gdd}|j |dd\}}|dd|ddddf}||}|ddS)a) Forward pass of DiT. x: (N, C, T) tensor of inputs mu: (N, C) tensor of hidden embedding t: (N,) tensor of diffusion timesteps cond: (N, C, T') tensor of prefix conditions dt: (N,) used for mean velocity (may be supported in the future...) rrrF) is_causalN)r< transpose contiguousr=sizer?torr@rArrrrCr>) r rrDrErFrGprefixhidden_r r r r"Rs    zVoxCPMLocDiT.forward)r8) r#r$r%__doc__rr6rrTensorr"r&r r r r r72s&r7) rminicpm4rrtorch.nnr-rModulerr'r7r r r r s