o /wi1@sddlmZddlZddlmZddlZddlmZddl m Z ddl m Z ddl m Z ddlmZd ZGd d d ejd Zed GdddeZed dddZed GdddeZdS)) annotationsN)cast)experimental_class)StudyDirection) FrozenTrial)Trial) TrialStatezterminator:cv_scoresc@s eZdZdZejd dd Zd S) BaseErrorEvaluatorz Base class for error evaluators.trialslist[FrozenTrial]study_directionrreturnfloatcCsdSNselfr r rrX/home/ubuntu/sommelier/.venv/lib/python3.10/site-packages/optuna/terminator/erroreval.pyevaluateszBaseErrorEvaluator.evaluateNr r r rr r)__name__ __module__ __qualname____doc__abcabstractmethodrrrrrr sr ) metaclassz3.2.0c@seZdZdZd dd Zd S) CrossValidationErrorEvaluatoraAn error evaluator for objective functions based on cross-validation. This evaluator evaluates the objective function's statistical error, which comes from the randomness of dataset. This evaluator assumes that the objective function is the average of the cross-validation and uses the scaled variance of the cross-validation scores in the best trial at the moment as the statistical error. r r r rr rc Csdd|D}t|dksJ|tjkrt|ddd}nt|ddd}|j}t|vr1|t}ntdt|}|d ksAJd d |d |d }|t |}t |} t | S) aEvaluate the statistical error of the objective function based on cross-validation. Args: trials: A list of trials to consider. The best trial in ``trials`` is used to compute the statistical error. study_direction: The direction of the study. Returns: A float representing the statistical error of the objective function. cSsg|] }|jtjkr|qSr)staterCOMPLETE).0trialrrr <sz:CrossValidationErrorEvaluator.evaluate..rcS tt|jSrrrvaluetrrr@ z8CrossValidationErrorEvaluator.evaluate..)keycSr#rr$r&rrrr(Br)zCross-validation scores have not been reported. Please call `report_cross_validation_scores(trial, scores)` during a trial and pass the list of scores as `scores`.z9Should be guaranteed by `report_cross_validation_scores`.) lenrMAXIMIZEmaxmin system_attrs_CROSS_VALIDATION_SCORES_KEY ValueErrornpvarsqrtr) rr r best_trialbest_trial_attrs cv_scoreskscaler4stdrrrr)s"   z&CrossValidationErrorEvaluator.evaluateNr)rrrrrrrrrrs rr!rscores list[float]r NonecCs*t|dkr td|j|jt|dS)aA function to report cross-validation scores of a trial. This function should be called within the objective function to report the cross-validation scores. The reported scores are used to evaluate the statistical error for termination judgement. Args: trial: A :class:`~optuna.trial.Trial` object to report the cross-validation scores. scores: The cross-validation scores of the trial. r+z:The length of `scores` is expected to be greater than one.N)r,r2storageset_trial_system_attr _trial_idr1)r!r<rrrreport_cross_validation_scoresXs rBc@s$eZdZdZdddZdd d ZdS)StaticErrorEvaluatora7An error evaluator that always returns a constant value. This evaluator can be used to terminate the optimization when the evaluated improvement potential is below the fixed threshold. Args: constant: A user-specified constant value to always return as an error estimate. constantrr r>cCs ||_dSr _constant)rrDrrr__init__ys zStaticErrorEvaluator.__init__r r r rcCs|jSrrErrrrr|szStaticErrorEvaluator.evaluateN)rDrr r>r)rrrrrGrrrrrrCls rC)r!rr<r=r r>) __future__rrtypingrnumpyr3optuna._experimentalr optuna.studyr optuna.trialrroptuna.trial._staterr1ABCMetar rrBrCrrrrs"        9