o ॵi@slddlmZddlmZddlmZddlmZddlm Z GdddZ ej ej d Gd d d e Z d S) ) OrderedDict)Optional)Hooks)HOOKS)Hookc@seZdZdZdZdZdS)EvaluationStrategyby_epochby_stepnoN)__name__ __module__ __qualname__r r r rr]/home/ubuntu/.local/lib/python3.10/site-packages/modelscope/trainers/hooks/evaluation_hook.pyr sr) module_namec@sdeZdZdZdejdfdeedeedeefddZ d d Z d d Z d dZ ddZ ddZdS)EvaluationHooka7 Evaluation hook. Args: interval (int): Evaluation interval. by_epoch (bool): Evaluate by epoch or by iteration. start_idx (int or None, optional): The epoch or iterations validation begins. Default: None, validate every interval epochs/iterations from scratch. rNinterval eval_strategy start_idxcKsT|dksJd||_||_d|_d|vr%|drtj|_dStj|_dS||_dS)Nrz"interval must be a positive number)NNr )rr last_eval_tagrr r r)selfrrrkwargsrrr__init__s zEvaluationHook.__init__cC8|jtjkr||r||d|jf|_dSdSdS)z9Called after every training iter to evaluate the results.iterN)rrr _should_evaluate do_evaluaterrrtrainerrrrafter_train_iter+  zEvaluationHook.after_train_itercCr)z:Called after every training epoch to evaluate the results.epochN)rrr rrr"rrrrrafter_train_epoch2r!z EvaluationHook.after_train_epochcCsB|jjdddurt|jjd<|jjd||dSdS)N eval_results)visualization_bufferoutputgetrupdate visualize)rrresultsrrradd_visualization_info9s  z%EvaluationHook.add_visualization_infocCs6|}|D] \}}||jjd|<qd|j_dS)zEvaluate the results.z evaluation/TN)evaluateitems log_bufferr&ready)rreval_resnamevalrrrrAs zEvaluationHook.do_evaluatecCsr|jtjkr |j}|j}n|j}|j}|jdur"|||js dSdS|d|jkr+dS|d|j|jr7dSdS)aNJudge whether to perform evaluation. Here is the rule to judge whether to perform evaluation: 1. It will not perform evaluation during the epoch/iteration interval, which is determined by ``self.interval``. 2. It will not perform evaluation if the ``start_idx`` is larger than current epochs/iters. 3. It will not perform evaluation when current epochs/iters is larger than the ``start_idx`` but during epoch/iteration interval. Returns: bool: The flag indicating whether to perform evaluation. NFrT) rrr r"every_n_epochsr every_n_itersrr)rrcurrent check_timerrrrIs   zEvaluationHook._should_evaluate)r r r__doc__rr rintstrrr r#r+rrrrrrrs"   rN) collectionsrtypingrmodelscope.metainforbuilderrhookrrregister_modulerrrrrs