o ॵiw@sddlZddlmZddlmZddlmZddlmZ ddlm Z ddlm Z ddlmZdd lmZdd lmZdd lmZdd lmZdd lmZmZddlmZddlmZmZzddlmZ ddlm!Z"Wn e#ywdZ dZ"YnwdddZ$ddZ%ddZ&e%e&gfddZ'e'eZe'e Ze'e Z e'e Z e'eZe'eddgdZe'eddgdZe'eddgdZe Ze"Z!eZe'eZe'eZdS)N) AutoConfig)AutoImageProcessor) AutoModel)AutoModelForCausalLM)AutoModelForSeq2SeqLM)"AutoModelForSequenceClassification)AutoModelForTokenClassification) AutoTokenizer) BatchFeature)BitsAndBytesConfig)GenerationConfig)PreTrainedModelPreTrainedTokenizerBase)snapshot_download)DEFAULT_MODEL_REVISIONInvoke) GPTQConfig) AwqConfigcCs |durtj}dtj|f}|S)Nz%s/%s)r PRETRAINEDKEY) invoked_byuagentrL/home/ubuntu/.local/lib/python3.10/site-packages/modelscope/utils/hf_util.py user_agentsrc"tjjtfdd}|t_dS)zV Monkey patch PreTrainedTokenizerBase.from_pretrained to adapt to modelscope hub. csLddg}tj|s|dd}t|||d}n|}||g|Ri|S)N\w+\.bin\w+\.safetensorsrevisionrignore_file_patternospathexistspoprclspretrained_model_name_or_path model_argskwargsr r model_dirori_from_pretrainedrrfrom_pretrained*s  z-patch_tokenizer_base..from_pretrainedN)rr.__func__ classmethodr.rr,rpatch_tokenizer_base% r2cr)zN Monkey patch PreTrainedModel.from_pretrained to adapt to modelscope hub. csJdg}tj|s|dd}t|||d}n|}||g|Ri|S)Nrrrr!r&r,rrr.@s  z)patch_model_base..from_pretrainedN)r r.r/r0r1rr,rpatch_model_base;r3r4c s.|Gfddd}j|_j|_|S)alGet a custom wrapper class for auto classes to download the models from the ModelScope hub Args: module_class: The actual module class ignore_file_pattern (`str` or `List`, *optional*, default to `None`): Any file pattern to be ignored in downloading, like exact file names or file extensions. Returns: The wrapper cseZdZefddZdS)z'get_wrapped_class..ClassWrappercsj|d}tj|s|dt}t|||td}n|}j|g|Ri|}j dr3||_ |S)Nr r)rr rr) r%r"r#r$rrrr.__name__ startswithr+)r'r(r)r*r rr+ module_objdefault_ignore_file_pattern module_classrrr.bs$   z7get_wrapped_class..ClassWrapper.from_pretrainedN)r5 __module__ __qualname__r0r.rr8rr ClassWrapper`sr=)r5r<)r:r r*r=rr8rget_wrapped_classUs  r>rr)r )N)(r" transformersr AutoConfigHFrAutoImageProcessorHFr AutoModelHFrAutoModelForCausalLMHFrAutoModelForSeq2SeqLMHFr$AutoModelForSequenceClassificationHFr!AutoModelForTokenClassificationHFr AutoTokenizerHFr BatchFeatureHFr BitsAndBytesConfigHFr GenerationConfigHFr r modelscopermodelscope.utils.constantrrr GPTQConfigHFr AwqConfigHF ImportErrorrr2r4r>rrrrsf                (