o ٷi| @sddlmZmZddlmZddlmZddlZddlmZddl m Z ddl m Z e e ZGdd d eZeGd d d ZGd d d eZdS))ABCabstractmethod) dataclass)EnumN)nn) init_logger)OmniDiffusionConfigc@seZdZdZdZdZdS)OffloadStrategynone model_level layer_wiseN)__name__ __module__ __qualname__NONE MODEL_LEVEL LAYER_WISErrV/home/ubuntu/.local/lib/python3.10/site-packages/vllm_omni/diffusion/offloader/base.pyr sr c@s8eZdZUeed<dZeed<ededdfddZ dS) OffloadConfigstrategyTpin_cpu_memory od_configreturncCs\t|dd}t|dd}t|dd}|rtj}|rtdn |r%tj}ntj}|||dS)anExtract and validate offload settings from OmniDiffusionConfig. For now, enforces mutual exclusion between model-level and layer-wise offloading. Layer-wise takes priority if both are enabled. Args: od_config: OmniDiffusionConfig with offload settings Returns: OffloadConfig with validated settings enable_cpu_offloadFenable_layerwise_offloadrTzpBoth model-level and layer-wise offloading enabled. Layer-wise takes priority, disabling model-level offloading.)rr)getattrr rloggerinforr)clsrrrrrrrrfrom_od_configs"  zOffloadConfig.from_od_configN) r rrr __annotations__rbool classmethodrr rrrrrs  rc@sXeZdZdZdedejfddZede j ddfd d Z edd d Z de fd dZdS)OffloadBackendz#Base class for CPU offload backendsconfigdevicecCs||_||_d|_dS)NF)r%r&enabled)selfr%r&rrr__init__Cs zOffloadBackend.__init__pipelinerNcCt)zEnable offloading on the pipeline. Discovers modules, moves them to appropriate devices, and registers forward hooks for swapping/prefetching. Args: pipeline: Diffusion pipeline model (e.g., Wan22Pipeline) NotImplementedError)r(r*rrrenableHs zOffloadBackend.enablecCr+)zDisable offloading and cleanup resources. Removes all registered hooks. Does NOT move modules back to original devices (caller responsible for that). r,r(rrrdisableTszOffloadBackend.disablecCs|jS)N)r'r/rrr is_enabled]szOffloadBackend.is_enabled)rN)r rr__doc__rtorchr&r)rrModuler.r0r"r1rrrrr$@s r$)abcrr dataclassesrenumrr3r vllm.loggerrvllm_omni.diffusion.datarr rr rr$rrrrs     (