o wi@sDddlmZmZddlmZmZddlmZddlm Z ddZ dS)) DictConfig ListConfig) LoraConfigget_peft_model)PreTrainedModel)loggingcCsd|jvrSt|drt|jtsJt|drt|jtsJd|jvr-t|jjttfs/Jt di|jj |_ t |j|j |_|jj dtd|j dSdS) z=Add LoRA adapters to a model, using HuggingFace PEFT library.loracfgllmprevent_freeze_paramsz ^.+\.lora_.+$zLoRA adapter installed: N)r hasattr isinstancerr rr listrrr lora_configrappendrinfo)modelr r b/home/ubuntu/sommelier/.venv/lib/python3.10/site-packages/nemo/collections/speechlm2/parts/lora.pymaybe_install_loras  rN) omegaconfrrpeftrr transformersr nemo.utilsrrr r r rs