o ٷi @sPddlmZddlmZddlmZeeZeGdddZGdddZ dS) ) dataclass)nn) init_loggerc@sTeZdZUeejed<eeed<eejed<eeed<dZejdBed<dS)PipelineModulesdits dit_namesencoders encoder_namesNvae) __name__ __module__ __qualname__listrModule__annotations__strr rrb/home/ubuntu/.local/lib/python3.10/site-packages/vllm_omni/diffusion/offloader/module_collector.pyr s   rc@s>eZdZdZgdZgdZdgZedej de fddZ d S) ModuleDiscoveryz,Discovers pipeline components for offloading) transformer transformer_2ditlanguage_modeltransformer_blocks) text_encodertext_encoder_2text_encoder_3 image_encoderr pipelinereturnc Csg}g}tjD]5}t||sqt||}|durqt|tjs-td|dt |q||vr2q| || |qg}g}tj D]}t||r_t||dur_| t||| |qDd}tj D]}t||d}|duru|}nqet |||||dS)zDiscover DiT, encoder, and VAE modules from pipeline. Args: pipeline: Diffusion pipeline model Returns: PipelineModules with lists of discovered modules and names Nz Expected z to be nn.Module, got )rrrr r )r DIT_ATTRShasattrgetattr isinstancerrloggerwarningtypeappend ENCODER_ATTRS VAE_ATTRSr) r dit_modulesrattr module_objrr r modulerrrdiscoversH           zModuleDiscovery.discoverN) r r r __doc__r r(r) staticmethodrrrr.rrrrrsrN) dataclassesrtorchr vllm.loggerrr r$rrrrrrs