o ॵi%@sddlZddlZddlmZmZddlmZmZmZddl m Z ddl m Z ddl mZddlmZddlmZmZd d lmZGd d d eZejd dGdddeZdS)N)ABCabstractmethod)CallableDictOptional)check_local_model_is_latest)snapshot_download)TRAINERS)Config)Invoke ThirdParty) LogBufferc@s`eZdZdZddedeefddZ  dddZe d d Z e d ed e ee ffd dZ dS) BaseTrainerz Base class for trainer which can not be instantiated. BaseTrainer defines necessary interface and provide default implementation for basic initialization such as parsing config file and parsing commandline args. Ncfg_file arg_parse_fncCsLt||_|r|j||_nd|_t|_t|_t dt |_ dS)z Trainer basic init, should be called in derived class Args: cfg_file: Path to configuration file. arg_parse_fn: Same as ``parse_fn`` in :obj:`Config.to_args`. Nz %Y%m%d_%H%M%S) r from_filecfgto_argsargsr log_buffervisualization_buffertimestrftime localtime timestamp)selfrrrL/home/ubuntu/.local/lib/python3.10/site-packages/modelscope/trainers/base.py__init__s zBaseTrainer.__init__cCsftj|r#tj|r|ntj|}t|tjtjt j|id|St ||tjtj t j|id}|S)aH Get local model directory or download model if necessary. Args: model (str): model id or path to local model directory. model_revision (str, optional): model version number. third_party (str, optional): in which third party library this function is called. ) user_agent)revisionr ) ospathexistsisdirdirnamerr KEY LOCAL_TRAINERr rTRAINER)rmodelmodel_revision third_partymodel_cache_dirrrrget_or_download_model_dir(s*  z%BaseTrainer.get_or_download_model_dircOdS) Train (and evaluate) process Train process should be implemented for specific task or model, related parameters have been initialized in ``BaseTrainer.__init__`` and should be used in this function Nr)rrkwargsrrrtrainGszBaseTrainer.traincheckpoint_pathreturncOr/) Evaluation process Evaluation process should be implemented for specific task or model, related parameters have been initialized in ``BaseTrainer.__init__`` and should be used in this function Nr)rr3rr1rrrevaluateQs zBaseTrainer.evaluateN)NN)__name__ __module__ __qualname____doc__strrrrr.rr2rfloatr6rrrrrs    rdummy) module_namecsHeZdZdeffdd ZddZ d dedeeeffd d ZZ S) DummyTrainerrcst|dS)zY Dummy Trainer. Args: cfg_file: Path to configuration file. N)superr)rrrr1 __class__rrr`szDummyTrainer.__init__cOs|jj}td|dS)r0z train cfg N)rr2print)rrr1rrrrr2hszDummyTrainer.trainNr3r4cOs(|jj}td|td|dS)r5z eval cfg zcheckpoint_path N)r evaluationrD)rr3rr1rrrrr6rs zDummyTrainer.evaluater7) r8r9r:r<rr2rr=r6 __classcell__rrrBrr@]s  r@)r"rabcrrtypingrrrmodelscope.hub.check_modelr modelscope.hub.snapshot_downloadrmodelscope.trainers.builderr modelscope.utils.configr modelscope.utils.constantr r utils.log_bufferrrregister_moduler@rrrrs      M