o `۷i_@sddlZddlZddlmZmZmZddlZddlm Z ddl m Z ddl m Z eeZdZ de defd d ZGd d d Ze Gd dde ZdS)N)DictListOptional)Searcher)+_set_search_properties_backwards_compatible) PublicAPI__trial_index__searcher num_samplescCs*t|tr||jrtddSdSdS)Na`num_samples` is now expected to be the total number of trials, including the repeat trials. For example, set num_samples=15 if you intend to obtain 3 search algorithm suggestions and repeat each suggestion 5 times. Any leftover trials (num_samples mod repeat) will be ignored.) isinstanceRepeaterrepeatloggerwarning)r r rN/home/ubuntu/vllm_env/lib/python3.10/site-packages/ray/tune/search/repeater.py_warn_num_sampless rc@seZdZdZddededefddZdefd d Zd e fd d Z dede fddZ d e fddZ d eee fddZd efddZdS) _TrialGroupaInternal class for grouping trials of same parameters. This is used when repeating trials for reducing training variance. Args: primary_trial_id: Trial ID of the "primary trial". This trial is the one that the Searcher is aware of. config: Suggested configuration shared across all trials in the trial group. max_trials: Max number of trials to execute within this group. primary_trial_idconfig max_trialscCs:t|tus Jd|||_||_|di|_||_dS)Nzconfig is not a dict, got {})typedictformatrr_trialsr)selfrrrrrr__init__*s   z_TrialGroup.__init__trial_idcCs&t|j|jks J|j|ddSN)lenrr setdefault)rrrrradd1sz_TrialGroup.addreturncCst|j|jkSr)r rrrrrrfull5z_TrialGroup.fullscorecCs,||jvsJ|durtd||j|<dS)Nz%Internal Error: Score cannot be None.)r ValueError)rrr'rrrreport8sz_TrialGroup.reportcCsd|jvot|j|jkSr)rvaluesr rr$rrrfinished_reporting>sz_TrialGroup.finished_reportingcCst|jSr)listrr*r$rrrscoresCsz_TrialGroup.scorescCs t|jSr)r rr$rrrcountFs z_TrialGroup.countN)r)__name__ __module__ __qualname____doc__strrintrr"boolr%floatr)r+rrr-r.rrrrrs rcseZdZdZd dededeffdd Zd ed e e fd d Z d!d ede e fddZ d e fddZ de fddZdefddZdefddZde ede ede d efddZZS)"r aA wrapper algorithm for repeating trials of same parameters. Set tune.TuneConfig(num_samples=...) to be a multiple of `repeat`. For example, set num_samples=15 if you intend to obtain 3 search algorithm suggestions and repeat each suggestion 5 times. Any leftover trials (num_samples mod repeat) will be ignored. It is recommended that you do not run an early-stopping TrialScheduler simultaneously. Args: searcher: Searcher object that the Repeater will optimize. Note that the Searcher will only see 1 trial among multiple repeated trials. The result/metric passed to the Searcher upon trial completion will be averaged among all repeats. repeat: Number of times to generate a trial with a repeated configuration. Defaults to 1. set_index: Sets a tune.search.repeater.TRIAL_INDEX in Trainable/Function config which corresponds to the index of the repeated trial. This can be used for seeds. Defaults to True. Example: .. code-block:: python from ray.tune.search import Repeater search_alg = BayesOptSearch(...) re_search_alg = Repeater(search_alg, repeat=10) # Repeat 2 samples 10 times each. tuner = tune.Tuner( trainable, tune_config=tune.TuneConfig( search_alg=re_search_alg, num_samples=20, ), ) tuner.fit() rTr r set_indexcsD||_||_||_g|_i|_d|_tt|j|jj |jj ddS)N)metricmode) r r _set_index_groups_trial_id_to_group_current_groupsuperr rr8r9)rr r r7 __class__rrrws   zRepeater.__init__rr#cCs|jdus |jr,|j|}|dur|St|t||jd|_|j |jd}n |j }|j ||jj }|j rD||t<|j|j|<|S)N)rr)r=r%r suggestrcopydeepcopyr r;appendr.r"rr: TRIAL_INDEXr<)rrrindex_in_grouprrrrAs      zRepeater.suggestNresultcKs||jvrtd|t|j|j|}|r|jj|vr"tj}n||jj}| ||| rL| }|jj |j fd|jjt|ii|dSdS)aStores the score for and keeps track of a completed trial. Stores the metric of a trial as nan if any of the following conditions are met: 1. ``result`` is empty or not provided. 2. ``result`` is provided but no metric was provided. z;Trial {} not in group; cannot report score. Seen trials: {}rGN)r<rerrorrr,r r8npnanr)r+r-on_trial_completernanmean)rrrGkwargs trial_groupr'r-rrrrKs(     zRepeater.on_trial_completecCs|j}|d=|S)Nr )__dict__rB)r self_staterrr get_states zRepeater.get_statestatecC|j|dSr)rOupdate)rrRrrr set_stater&zRepeater.set_statecheckpoint_pathcCrSr)r saverrVrrrrWr&z Repeater.savecCrSr)r restorerXrrrrYr&zRepeater.restorer8r9rcKst|jj|||fi|Sr)rr set_search_properties)rr8r9rspecrrrrZs  zRepeater.set_search_properties)rTr)r/r0r1r2rr4r5rr3rrrArKrQrUrWrYrZ __classcell__rrr?rr Js$+ r )rBloggingtypingrrrnumpyrIray.tune.search.searcherrray.tune.search.utilrray.utilr getLoggerr/rrEr4rrr rrrrs     .