o ٷi@sUddlmZddlmZddlmZddlmZddlm Z ddl m Z eGdddZ d a d ed <d!d dZd"ddZ d#d$ddZed%ddZe d#d$dd Zd S)&) annotations)contextmanager) dataclass) VllmConfig)AttentionMetadata)OmniDiffusionConfigc@s|eZdZUdZdZded<dZded<dZded<d Zd ed <d Z d ed<dZ ded<d Z d ed<e dddZ ddZdS)ForwardContextz2 set forward context for diffusion models NVllmConfig | None vllm_configOmniDiffusionConfig | Noneomni_diffusion_configHdict[str, AttentionMetadata] | list[dict[str, AttentionMetadata]] | None attn_metadataFboolsplit_text_embed_in_sprintsp_padding_sizez int | Nonesp_original_seq_len_sp_shard_depthreturncCs |jdkS)zIReturns True when inside an SP sharded region (between shard and gather).r)rselfrW/home/ubuntu/.local/lib/python3.10/site-packages/vllm_omni/diffusion/forward_context.py sp_active's zForwardContext.sp_activecCsdSNrrrrr __post_init__,szForwardContext.__post_init__rr)__name__ __module__ __qualname____doc__r __annotations__r rrrrrpropertyrrrrrrrs          rNForwardContext | None_forward_contextrcCstdusJdtS)z Get the current forward context.NzXForward context is not set. Please use `set_forward_context` to set the forward context.r%rrrrget_forward_context3s r'rcCstduSrr&rrrris_forward_context_available;sr(Fr r r r rr rcCst||||dS)Nr r rr)rr)rrrcreate_forward_context?s r*forward_contextccs"t}|azdVW|adS|aw)zA context manager that overrides the current forward context. This is used to override the forward context for a specific forward pass. Nr&)r+ prev_contextrrroverride_forward_contextMs r-c cst||||d}t|>|durdVn%ddlm}|| dVWdn1s.wYWddSWddSWddS1sNwYdS)zA context manager that stores the current forward context, can be attention metadata, split_text_embed_in_sp, etc. Here we can inject common logic for every model forward pass. r)Nr)set_current_vllm_config)r*r-vllm.config.vllmr.)r r rrr+r.rrrset_forward_context\s&    "r0)rrr)NNNF)r r r r rr rr)r+r$) __future__r contextlibr dataclassesr vllm.configr/vllm_omni.diffusion.attention.backends.abstractrvllm_omni.diffusion.datarrr%r"r'r(r*r-r0rrrrs0      !