o Nie@s2UddlmZddlZddlZddlmZddlmZmZm Z m Z m Z m Z m Z ddlmZddlmZmZmZmZmZmZmZddlmZdd lmZeeeeeed Zd ed <Gd ddZGdddeZGdddeZ GdddeZ!GdddeZ"GdddeZ#GdddeZ$GdddeZ%dS)) annotationsN)Optional) AutoModelAutoModelForCausalLMAutoModelForQuestionAnsweringAutoModelForSeq2SeqLM"AutoModelForSequenceClassificationAutoModelForTokenClassification AutoTokenizer) PeftConfig) PeftModelPeftModelForCausalLMPeftModelForFeatureExtractionPeftModelForQuestionAnsweringPeftModelForSeq2SeqLM"PeftModelForSequenceClassificationPeftModelForTokenClassification)TOKENIZER_CONFIG_NAME)check_file_exists_on_hf_hub)SEQ_CLS SEQ_2_SEQ_LM CAUSAL_LM TOKEN_CLS QUESTION_ANSFEATURE_EXTRACTIONzdict[str, type[PeftModel]] MODEL_TYPE_TO_PEFT_MODEL_MAPPINGc@s4eZdZdZdZddZe    ddddZdS)_BaseAutoPeftModelNcOs&t|jjd|jjd|jjd)Nz+ is designed to be instantiated using the `z5.from_pretrained(pretrained_model_name_or_path)` or `z.from_config(config)` methods.)EnvironmentError __class____name__)selfargskwargsr$=/home/ubuntu/.local/lib/python3.10/site-packages/peft/auto.py__init__;s z_BaseAutoPeftModel.__init__defaultF adapter_namestr is_trainableboolconfigOptional[PeftConfig]revision Optional[str]cKstj|fd|i|}|j}|j} t|dd} |jdur |j} n |jdur-| dur-td| durKt| } |jj | j krJtd| j d|jj dn)| durpt|dddurpt|dd} | d }| d }t |}t||} ntd | j|fd| i|}d }t j t j |trd }n|dd}|dur|dd}t|t||dd|d}|rt|drtj||dd d}|jjd}t||kr|t||jj||f|||d|S)a A wrapper around all the preprocessing steps a user needs to perform in order to load a PEFT model. The kwargs are passed along to `PeftConfig` that automatically takes care of filtering the kwargs of the Hub methods and the config object init. r. task_typeNzCannot use `AutoPeftModel` with a task type, please use a specific class for your task type. (e.g. `AutoPeftModelForCausalLM` for `task_type='CAUSAL_LM'`)zExpected target PEFT class: z, but you have asked for: zE make sure that you are loading the correct model for your task type. auto_mappingbase_model_classparent_libraryzxCannot infer the auto class from the config, please make sure that you are loading the correct model for your task type.FTtokenuse_auth_token repo_type)repo_idfilenamer.r6r4get_input_embeddingstrust_remote_code)r:r)r(r*r,)r from_pretrainedbase_model_name_or_pathr.getattr _target_class ValueErrorr_target_peft_classr importlib import_moduleospathexistsjoinrgetrhasattrr r9weightshapelenresize_token_embeddings)clspretrained_model_name_or_pathr(r*r,r.r# peft_configbase_model_pathbase_model_revisionr0 target_classexpected_target_classr1r2parent_library_namer3 base_modeltokenizer_existsr4 tokenizerembedding_sizer$r$r%r;Csr          z"_BaseAutoPeftModel.from_pretrained)r'FNN)r(r)r*r+r,r-r.r/)r __module__ __qualname__r>r@r& classmethodr;r$r$r$r%r7src@seZdZdZeZdS) AutoPeftModelN)r rYrZr>r r@r$r$r$r%r\r\c@eZdZeZeZdS)AutoPeftModelForCausalLMN)r rYrZrr>rr@r$r$r$r%r_r]r_c@r^)AutoPeftModelForSeq2SeqLMN)r rYrZrr>rr@r$r$r$r%r`r]r`c@r^)&AutoPeftModelForSequenceClassificationN)r rYrZrr>rr@r$r$r$r%rar]rac@r^)#AutoPeftModelForTokenClassificationN)r rYrZr r>rr@r$r$r$r%rbr]rbc@r^)!AutoPeftModelForQuestionAnsweringN)r rYrZrr>rr@r$r$r$r%rcr]rcc@r^)!AutoPeftModelForFeatureExtractionN)r rYrZrr>rr@r$r$r$r%rdr]rd)& __future__rrArCtypingr transformersrrrrrr r r,r peft_modelr rrrrrrutils.constantsr utils.otherrr__annotations__rr\r_r`rarbrcrdr$r$r$r%s0 $ $  a