o ۷i1 @stddlmZddlmZddlmZddlZddlmZedddGdd d Z Gd d d eZ Gd d d Z dS)) annotations) dataclass)ProtocolN)AttentionMetadataT)frozenslotsc@seZdZUdZded<dS)ParallelAttentionContextzOpaque per-forward context returned by a parallel strategy. Strategies may stash whatever they need here to finish post-processing after the attention kernel runs (e.g. reverse resharding, slicing metadata, etc.). strnameN)__name__ __module__ __qualname____doc____annotations__rra/home/ubuntu/vllm_env/lib/python3.10/site-packages/vllm_omni/diffusion/attention/parallel/base.pyrs  rc@s@eZdZdZedddZedddZdddZdddZdS)ParallelAttentionStrategyaOPluggable strategy for parallel attention communication/resharding. This is intentionally orthogonal to the attention *kernel* backend. The kernel backend implements `AttentionImpl.forward()` for a given device, while the parallel strategy implements how Q/K/V and outputs are sharded / communicated across ranks. returnboolcCdSNrselfrrrenabled"z!ParallelAttentionStrategy.enabledr cCrrrrrrrr %rzParallelAttentionStrategy.namequery torch.Tensorkeyvalue attn_metadataAttentionMetadata | Nonejtuple[torch.Tensor, torch.Tensor, torch.Tensor, AttentionMetadata | None, ParallelAttentionContext | None]cCdS)zRuns before the attention kernel. Returns possibly transformed Q/K/V and metadata, and an optional context for `post_attention`. Nrrrrrrrrr pre_attention(z'ParallelAttentionStrategy.pre_attention attn_outputctxParallelAttentionContext | NonecCr")z Runs after the attention kernel.Nrrr&r'rrrpost_attention5r%z(ParallelAttentionStrategy.post_attentionNrrrr ) rrrrrrrr rr!r&rr'r(rr r r r rpropertyrr r$r*rrrrrs    rc@s@eZdZdZedddZedddZdddZdddZdS)NoParallelAttentionz5Default strategy: do nothing (single device / no SP).rrcCr")NFrrrrrr@zNoParallelAttention.enabledr cCr")Nnonerrrrrr Dr1zNoParallelAttention.namerrrrrr cCs||||dfSrrr#rrrr$Hsz!NoParallelAttention.pre_attentionr&r'r(cCs|Srrr)rrrr*Qrz"NoParallelAttention.post_attentionNr+r,)rrrrrrrr r-r.rrrrr0=s    r0) __future__r dataclassesrtypingrtorch/vllm_omni.diffusion.attention.backends.abstractrrrr0rrrrs      $