o ॵi<'@sddlZddlmZddlmZmZddlZddl Z ddl m Z ddl m Z ddlmZmZmZmZmZddlmZddlmZddlmZdd lmZeZe e je d kr[n ed e d ej!d dGdddeZ"dS)N)DictOptional)version)tqdm) CartoonModelall_filesimple_superpixeltf_data_loaderwrite_batch_image) BaseTrainer)TRAINERS) ModelFile) get_logger2zTensorFlow version z< found, TF2.x is not supported by CartoonTranslationTrainer.zcartoon-translation) module_namecsdeZdZ     ddedeffdd ZddZdd Z dd eed eee ffd d Z Z S)CartoonTranslationTrainerNmodelcfg_filec sV||}t||_t|tj|_|durt|tj }t |i|_ | |dur5||j d<|dur>||j d<|durG||j d<|durP||j d<tj|j dsat|j dt|j d|_t|j d|_tjdd} d| j_tj| d|_ttj|j d |j d |j d d g|_ttj|j d |j d |j d d g|_ttj|j d |j d |j d d g|_t|j|_ | |j|j|j} | d |_!| d |_"| d|_#tj$%d |j"tj$%d|j#tj$&|j dd|_'tj$(|_)t*} dd| D} dd| D} t+tj,j-}t.|.tj/j0|j ddddj1|j"| d|_2tj/j0|j ddddj1|j#| d|_3Wdn 1sRwYtj/j4dd|_5|j6<}|7t8|j ddkrt9:d|j|j5;|t|jdt<|j dWddSWddS1swYdS)a  Args: model: the model_id of trained model cfg_file: the path of configuration file work_dir: the path to save training results photo: the path of photo images for training cartoon: the path of cartoon images for training max_steps: the number of total iteration for training Returns: initialized trainer: object of CartoonTranslationTrainer Nwork_dirphotocartoon max_stepsT)allow_soft_placement)config batch_size patch_sizeoutput_cartoong_lossd_lossz /train_logcSg|] }d|jvr|qS)genename.0varr'f/home/ubuntu/.local/lib/python3.10/site-packages/modelscope/trainers/cv/cartoon_translation_trainer.py pz6CartoonTranslationTrainer.__init__..cSr )discr"r$r'r'r(r)qr* adv_train_lrg?gGz?)beta1beta2)var_listi) max_to_keep resume_epochrzloading model from zmodel-)=get_or_download_model_dirtfreset_default_graph model_dirospjoinr TF_CHECKPOINT_FOLDER model_path CONFIGURATIONsuper__init__params_override_params_from_fileospathexistsmakedirsrface_photo_listface_cartoon_list ConfigProto gpu_options allow_growthSession_session placeholderfloat32 input_photoinput_superpixel input_cartoonrrrrrsummaryscalar FileWriter train_writer merge_all summary_optrainable_variablesget_collection GraphKeys UPDATE_OPScontrol_dependenciestrain AdamOptimizerminimizeg_optimd_optimSaversaver as_defaultrunglobal_variables_initializerloggerinforestorestr)selfrrrrrrargskwargs tf_configoutputall_vars gene_vars disc_vars update_opssess __class__r'r(r<!s                   $z"CartoonTranslationTrainer.__init__cCs|jdd|jd<|jdd|jd<|jdd|jd<|jdd|jd<|jdd|jd<|jdd|jd<|jdd|jd<|jdd |jd <|jdd |jd <|jdd |jd <|jdd |jd <dS) NrZrrrrrr,rlogging_intervalckpt_period_intervalr1num_gpus)cfgr=)rhr'r'r(r>s z4CartoonTranslationTrainer._override_params_from_filec Os\tdt|j|jd}t|j|jd}|}|}|}|}tj j r-dnd} t | t t |jdD]} |j|j|j|j|j||g\} } |jj|j|j| id} t| dd}|jj|j|jg|j| |j||j| id\}}|jj|j|j|jg|j| |j||j| id\}}}|j|| t| d |jd d ks| d krtd | d |d|t| d |jdd ks| d kr|jj |j|jddd| d|jj|j|j| |j| |j| id}t!||jddt"d| ddt!| |jddt"d| ddq>WddS1s'wYdS)Nz'Begin local cartoon translator trainingrzgpu:0zcpu:0r) feed_dict)seg_numrtrzIter: z , d_loss: z , g_loss: rurz/saved_models/modelF)write_meta_graph global_stepz/imagesz%8dz_face_result.jpgz_face_photo.jpg)#rdrer rCr=rDmake_initializable_iteratorget_nextr3testis_gpu_availabledevicerrangerIrb initializerrrLrrr]rMrNrr^rTrR add_summarynpmodr`saver rg)rhrirjphoto_ds cartoon_dsphoto_iteratorcartoon_iterator photo_next cartoon_nextrr photo_batch cartoon_batch transfer_resrMr_r train_info result_facer'r'r(rZs          $zCartoonTranslationTrainer.traincheckpoint_pathreturncOstd)aevaluate a dataset evaluate a dataset via a specific model from the `checkpoint_path` path, if the `checkpoint_path` does not exist, read from the config file. Args: checkpoint_path (Optional[str], optional): the model path. Defaults to None. Returns: Dict[str, float]: the results about the evaluation Example: {"accuracy": 0.5091743119266054, "f1": 0.673780487804878} z6evaluate is not supported by CartoonTranslationTrainer)NotImplementedError)rhrrirjr'r'r(evaluatesz"CartoonTranslationTrainer.evaluate)NNNNN)N) __name__ __module__ __qualname__rgr<r>rZrrfloatr __classcell__r'r'rrr(rs&bN r)#r?os.pathr@r6typingrrnumpyr tensorflowr3 packagingrrmodelscope.models.cv.cartoonrrrr r modelscope.trainers.baser modelscope.trainers.builderr modelscope.utils.constantr modelscope.utils.loggerrrdparse __version__re _tf_versionregister_modulerr'r'r'r(s(