o ߥi@sddlmZddlmZddlmZddlmZddlm Z ddl m Z GdddZ e j e jejd Gd d d e eeZd S) ) BloomConfig) BloomModel)Models) TorchModel) BACKBONES)Taskscs eZdZefddZZS) MsModelMixinc s\|dd}|dd|durtdi|}||}n tt|jdd|i|}||_|S)a%Instantiate the model. Args: kwargs: Input args. model_dir: The model dir used to load the checkpoint and the label information. Returns: The loaded model, which is initialized by transformers.PreTrainedModel.from_pretrained model_dirNdevicepretrained_model_name_or_path)poprsuperrfrom_pretrainedr )clskwargsr configmodel __class__r X/home/ubuntu/.local/lib/python3.10/site-packages/modelscope/models/nlp/bloom/backbone.py _instantiate s  zMsModelMixin._instantiate)__name__ __module__ __qualname__ classmethodr __classcell__r r rrr sr) group_key module_namec@s eZdZdS)rN)rrrr r r rr#srN) transformersrrBloomModelTransformmodelscope.metainformodelscope.modelsrmodelscope.models.builderrmodelscope.utils.constantrrregister_modulebackbonebloomr r r rs