o pi@s`ddlmZddlmZmZmZddlmZmZm Z ddZ e r%ddZ iZ erQd ge d <d ge d <d ge d<e rQdge d<gde d<dge d<dge d<dge d<esZererddl mZddlmZddlmZe rddlmZddlmZmZmZmZmZmZddlmZdd lmZdd!lm Z d"Sdd"l!Z!ee"e#d#e e$d$e!j%e"<d"S)%) TYPE_CHECKING)DIFFUSERS_SLOW_IMPORT _LazyModule deprecate)is_peft_availableis_torch_availableis_transformers_availablecCstdddi}t|D]\\}}|jjD] \}}|||d|<q|jjD] \}}|||d|<q.|jjD] \}}|||d|<qD|jjD] \}}|||d|<qZq |S)Nz(text_encoder_load_state_dict in `models`0.27.0`text_encoder_lora_state_dict` is deprecated and will be removed in 0.27.0. Make sure to retrieve the weights using `get_peft_model`. See https://huggingface.co/docs/peft/v0.6.2/en/quicktour#peftmodel for more information.z.q_proj.lora_linear_layer.z.k_proj.lora_linear_layer.z.v_proj.lora_linear_layer.z.out_proj.lora_linear_layer.) rtext_encoder_attn_modulesq_projlora_linear_layer state_dictitemsk_projv_projout_proj) text_encoderrnamemodulekvrX/home/ubuntu/SoloSpeech/.venv/lib/python3.10/site-packages/diffusers/loaders/__init__.pytext_encoder_lora_state_dicts"rcCs|tdddddlm}m}g}t|||fr5t|jjjD]\}}d|d}|j }| ||fq|St d|j j ) Nz%text_encoder_attn_modules in `models`r r r) CLIPTextModelCLIPTextModelWithProjectionztext_model.encoder.layers.z .self_attnz.do not know how to get attention modules for: )r transformersrr isinstance enumerate text_modelencoderlayers self_attnappend ValueError __class____name__)rrr attn_modulesilayerrmodrrrr !s r FromOriginalModelMixinsingle_file_modelUNet2DConditionLoadersMixinunetAttnProcsLayersutilsFromSingleFileMixin single_file)AmusedLoraLoaderMixinStableDiffusionLoraLoaderMixinSD3LoraLoaderMixin StableDiffusionXLLoraLoaderMixinLoraLoaderMixinFluxLoraLoaderMixin lora_pipelineTextualInversionLoaderMixintextual_inversionIPAdapterMixin ip_adapterPeftAdapterMixinpeft)r-)r/)r1)r>)r5r:r9r7r6r8)r3)r<)r@N__file__) module_spec)&typingrr2rrrutils.import_utilsrrr rr _import_structurer.r-r0r/r1r?r>r;r5r:r9r7r6r8r4r3r=r<rAr@sysr(globals__spec__modulesrrrrs<