o Ni @shddlmZddlZddlmZddlmZddlmZer'GdddeZ d ej j d e fd d Z dS) )OptionalN)is_inc_available)BaseTunerLayer)LinearcsTeZdZdejjdeffdd Zddede e ed dfd d Z dd d Z Z S) IncOFTLinear base_layer adapter_namec stj||fi|dS)N)super__init__)selfrr kwargs __class__G/home/ubuntu/.local/lib/python3.10/site-packages/peft/tuners/oft/inc.pyr szIncOFTLinear.__init__FN safe_merge adapter_namesreturncCtd)a Merge the active adapter weights into the base weights Args: safe_merge (`bool`, *optional*): If True, the merge operation will be performed in a copy of the original weights and check for NaNs before merging the weights. This is useful if you want to check if the merge operation will produce NaNs. Defaults to `False`. adapter_names (`list[str]`, *optional*): The list of adapter names that should be merged. If None, all active adapters will be merged. Defaults to `None`. z2Merging OFT with INC layers is not yet implementedNotImplementedError)r rrrrrmerge(s zIncOFTLinear.mergecCr)z_ This method unmerges all merged adapter layers from the base weights. z4Unmerging OFT from INC layers is not yet implementedr)r rrrunmerge7szIncOFTLinear.unmerge)FN)rN)__name__ __module__ __qualname__torchnnModulestrr boolrlistrr __classcell__rrrrrs rtargetr cKsNd}t|tr |}n|}tr%ddlm}t||r%t||fi|}|S)Nr) PatchedLinear) isinstancerget_base_layerrIneural_compressor.torch.algorithms.fp8_quant._quant_common.helper_modulesr%r)r$r r new_moduletarget_base_layerr%rrr dispatch_inc>s    r+)typingrrpeft.import_utilsrpeft.tuners.tuners_utilsrlayerrrrrr r+rrrrs