o ߥi @s4ddlZddlmZddlmZGdddeZdS)N) rearrange) AttentionBasecs<eZdZ     d fdd ZddZfd d ZZS) MutualSelfAttentionControl N2cspt||_||_||_|dur|ntt|d|_|dur"|ntt|||_t d|jt d|jdS)a Mutual self-attention control for Stable-Diffusion model Args: start_step: the step to start mutual self-attention control start_layer: the layer to start mutual self-attention control layer_idx: list of the layers to apply mutual self-attention control step_idx: list the steps to apply mutual self-attention control total_steps: the total number of steps Nz step_idx: z layer_idx: ) super__init__ total_steps start_step start_layerlistrange layer_idxstep_idxprint)selfr rrrr  __class___/home/ubuntu/.local/lib/python3.10/site-packages/modelscope/models/cv/image_editing/masactrl.pyr s  z#MutualSelfAttentionControl.__init__c Ksz|jd|} t|d|d}t|d|d}t|d|d}td||| d}|d}td||} t| d| d } | S) Nrz(b h) n d -> h (b n) d)hzh i d, h j d -> h i jscalezh i j, h j d -> h i dzh (b n) d -> b n (h d))b)shapertorcheinsumgetsoftmax) rqkvsimattnis_cross place_in_unet num_headskwargsroutrrr attn_batch(s z%MutualSelfAttentionControl.attn_batchc  s|s|j|jvs|jd|jvr!tj||||||||fi| S|d\} } |d\} } |d\}}|d\}}|j| | d||d||d|||||fi| }|j| | d||d||d|||||fi| }tj ||gdd}|S)z, Attention forward function Nr)dim) cur_stepr cur_att_layerrr forwardchunkr,rcat)rr"r#r$r%r&r'r(r)r*quqckukcvuvcattnuattncout_uout_cr+rrrr15s0 z"MutualSelfAttentionControl.forward)rrNNr)__name__ __module__ __qualname__r r,r1 __classcell__rrrrr s r)reinopsrmasactrl_utilsrrrrrrs