o ٷi1 @sddlZddlZddlZddlmZmZzddlmZddlmZ de fddZ Wne y=dZdZ de fddZ Ynwdd l mZeeZdd gZe rue duruee d ejjd edeejjeejjffd dZdd ZdSdd ZdS)N)ListUnion)ContextParallelConfig)_find_submodule_by_namereturncCdS)NTrrrg/home/ubuntu/.local/lib/python3.10/site-packages/cache_dit/parallelism/attention/_experimental_utils.py#_is_diffusers_parallelism_available r cCr)NFrrrrr r r ) init_logger_maybe_patch_find_submodulemodelnamecCs>|dkr|Sd|vr|ddn|df\}}|dkrNt|tjjs%tdg}|D]"}t||}t|tsFt|tjjrCt| }n|g}| |q)|St ||rt ||}t|tjjr|dkrt| }|D]}t|tjj std|d|dqk|Std |d |d t||Std |d |jjd )N.*z-Wildcard '*' can only be used with ModuleListzValue 'z' in ModuleDict 'z' is not a ModulezCannot access submodule 'z' of ModuleDict 'z;' directly. Please specify the key of the ModuleDict first.'z' is not a submodule of ')split isinstancetorchnn ModuleList ValueError_patch_find_submodule_by_namelist ModuleDictvaluesextendhasattrgetattrModule __class____name__)rr first_atomremaining_name submodules submodule subsubmodulesvrrr r)sD        rcCs*tjjjtkrttjj_tddSdS)Nz6Patched _find_submodule_by_name to support ModuleDict.) diffusershookscontext_parallelrrloggerdebugrrrr r Us  cCsdS)Nrrrrr r _r )r functoolsr+typingrrr diffusers.hooks.context_parallelr,_find_submodule_by_name_for_context_parallelboolr ImportErrorcache_dit.loggerr r$r.__all__wrapsrr"strrr rrrr s>      +