o $i^ @sddlZddlZddlmZddlmZddlmZddlmZm Z m Z m Z m Z m Z mZddlZddlmZmZmZzejjZdZWneyTGdd d Zd ZYnweeZeZdKd d ZGdddZ ede eejj!e"fZ!eGdddZ#eGdddZ$eGddde$Z%eGddde$Z&eGddde$Z'eGddde$Z(eGddde$Z)eGddde#Z*eGd d!d!e#Z+eGd"d#d#e#Z,eGd$d%d%e#Z-eGd&d'd'e$Z.ed(e e geffd)d*Z/ed+e0d,e0fd-d.Z1ed+e0d,e0d/e0fd0d1Z2eefd+e0d,e0d2efd3d4Z3eefd+e0d,e0d/e0d2efd5d6Z4ed7e fd8d9Z5ed+e"d,e"fd:d;Z6eefd+e"d,e"d2efdeZdZ   d dedeeeeefdeddfdd Z dS) SamplerNrBdomainrCrDrEr!cCrLrrMr%rSrCrDrErrrrFszSampler.samplerQ) rrrr5r r rrr1rFrrrrrRsrRc@eZdZddZdS) BaseSamplercCrI)NBaserr'rrr__str__rKzBaseSampler.__str__NrrrrXrrrrrV rVc@rU)UniformcCrI)Nr[rr'rrrrXrKzUniform.__str__NrYrrrrr[rZr[c@s&eZdZefdefddZddZdS) LogUniformbasecCs|tur tdSdSr)_MISSINGr)r%r]rrrr&s zLogUniform.__init__cCrI)Nr\rr'rrrrXrKzLogUniform.__str__N)rrrr^objectr&rXrrrrr\s r\c@s(eZdZd dedefddZddZdS) NormalmeansdcCs"||_||_|jdksJddS)Nrz$SD has to be strictly greater than 0rbrc)r%rbrcrrrr&szNormal.__init__cCrI)Nr`rr'rrrrXrKzNormal.__str__N)rara)rrrfloatr&rXrrrrr`s r`c @sBeZdZdZ   d dedeeeeefde ddfd d Z dS) rGz"Dummy sampler used for grid searchNrBrSrCrDrEr!cCstdS)NzDo not call `sample()` on grid.) RuntimeErrorrTrrrrFz Grid.samplerQ) rrrr0r5r r rrr1rFrrrrrGsrGc@seZdZGdddeZGdddeZGdddeZeZ de e de e fd d Z d d Z d dZefdefddZdddZde fddZde fddZeddZdS) Floatc @>eZdZ   d dddeeeeefdeddfd d ZdS) zFloat._UniformNrBrSrhrCrDrEr!cCspt|ts t|}|jtdksJd|jtdksJd|j|j|j|d}t|dkr1|S||dS)N-infzUniform needs a lower boundinfzUniform needs a upper boundrDrBr)rrlowerreupperuniformlenr8r%rSrCrDrEitemsrrrrFs zFloat._Uniform.samplerQ rrrr r rrr1rFrrrr_Uniformrtc @ri) zFloat._LogUniformNrBrSrhrCrDrEr!cCst|ts t|}|jdksJdd|jkr"tdks'JdJdt|j}t|j}t|j|||d}t |dkrF|S| |dSNrz-LogUniform needs a lower bound greater than 0rkz-LogUniform needs a upper bound greater than 0rlrB) rrrmrnrerlogexprorpr8r%rSrCrDrElogminlogmaxrrrrrrFs   zFloat._LogUniform.samplerQrsrrrr _LogUniformrur|c @ri) z Float._NormalNrBrSrhrCrDrEr!cCs|t|ts t|}|jr|jtdksJd|jr%|jtdks%Jd|j|j|j|d}t|dkr7|S| |dS)Nrjz3Normal sampling does not allow a lower value bound.rkz3Normal sampling does not allow a upper value bound.rlrBr) rrrmrernnormalrbrcrpr8rqrrrrFs   zFloat._Normal.samplerQrsrrrr_Normalrur~rmrncCs6|dur|ntd|_|dur||_dStd|_dS)Nrjrk)rermrnr%rmrnrrrr& s zFloat.__init__cCt|Sr)rer6rrrr8z Float.castcCsF|jtdks td|jtdkstdt|}|||S)NrjzTUniform requires a lower bound. Make sure to set the `lower` parameter of `Float()`.rkzTUniform requires a upper bound. Make sure to set the `upper` parameter of `Float()`.)rmrer;rnrr?rtr%newrrrrosz Float.uniformr]cCr|turt|jdkstd|jdd|jkr"tdks,ntd|jdt|}|||SNrz6LogUniform requires a lower bound greater than 0.Got: zg. Did you pass a variable that has been log-transformed? If so, pass the non-transformed value instead.rkz7LogUniform requires a upper bound greater than 0. Got: r^rrmr;rnrerr?r|r%r]rrrr loguniform#" zFloat.loguniformra?cCst|}|||||Sr)rr?r~)r%rbrcrrrrr}8sz Float.normalqcCs|jtdkr t|j|t|j|s td|jd|d|jtdkr@t|j|t|j|s@td|jd|dt|}|jt| |dd|S) NrjzYour lower variable bound z) is not divisible by quantization factor .rkzYour upper variable bound Tr>) rmrerroundr;rnrr? QuantizedrAr%rrrrr quantized=s&  zFloat.quantizedr7cC|j|ko |jkSSrrmrnr6rrrrOQzFloat.is_validcCd|jd|jdSN(z, )rr'rrrrPTzFloat.domain_strNrar)rrrr[rtr\r|r`r~r@r rer&r8ror^r_rr}rrOr2rPrrrrrhs rhc@seZdZGdddeZGdddeZeZddZddZ d e fd d Z d d Z e fdefddZde fddZeddZdS)Integerc @ri) zInteger._UniformNrBrSrrCrDrEr!cCsDt|ts t|}|j|j|j|d}t|dkr|S||dS)NrlrBr)rrr+rmrnrpr8rqrrrrF\s zInteger._Uniform.samplerQrsrrrrrt[rurtc @ri) zInteger._LogUniformNrBrSrrCrDrEr!cCst|ts t|}|jdksJdd|jkr"tdks'JdJdt|j}t|j}t|j|||d}t | t }t |dkrN|S| |dSrv)rrrmrnrerrwrxrofloorastyper1rpr8ryrrrrFis   zInteger._LogUniform.samplerQrsrrrrr|hrur|cCs||_||_dSrrrrrrr&s zInteger.__init__cCrr)r1r6rrrr8rz Integer.castrcCs$t|}|jt||dd|S)NTr)rr?rrArrrrrszInteger.quantizedcCt|}|||Srrr?rtrrrrrozInteger.uniformr]cCrrrrrrrrrzInteger.loguniformr7cCrrrr6rrrrOrzInteger.is_validcCrrrr'rrrrPrzInteger.domain_strN)rrrr[rtr\r|r@r&r8r1rror^r_rrOr2rPrrrrrYs rc@sheZdZGdddeZeZdefddZddZdd Z d d Z d d Z de fddZ eddZdS) Categoricalc @ri) zCategorical._UniformNrBrSrrCrDrEr!cs^t|ts t|}|jtdtj|d}fdd|D}t|dkr(|S|dS)Nrrlcsg|]}j|qSr categories).0indexrSrr sz/Categorical._Uniform.sample..rB)rrchoicerarangerprr8)r%rSrCrDrEindicesrrrrrrFs zCategorical._Uniform.samplerQrsrrrrrtrurtrcCst||_dSr)listr)r%rrrrr&szCategorical.__init__cCrrrrrrrrorzCategorical.uniformcCst|}|t|Sr)rr?rGrrrrgrids zCategorical.gridcCs t|jSr)rprr'rrr__len__ zCategorical.__len__cCs |j|Srr)r%itemrrr __getitem__rzCategorical.__getitem__r7cCs ||jvSrrr6rrrrOrzCategorical.is_validcCs|jSrrr'rrrrPszCategorical.domain_strN)rrrr[rtr@r r&rorrrrrOr2rPrrrrrsrc@sPeZdZGdddeZeZdefddZddZde fd d Z e d d Z d S)Functionc @sXeZdZdddeeeffddZ   d dddeee eefde d d fd d Z dS)zFunction._CallSamplerrSrrCc CsPz||WSttfy'ddlm}||d|i}td|YSw)Nr)_UnresolvedAccessGuardrCz~sample_from functions that take a spec dict are deprecated. Please update your function to work with the config dict directly.)funcAttributeErrorKeyError!ray.tune.search.variant_generatorrloggerwarning)r%rSrCrrrrr__try_fns  zFunction._CallSampler.__try_fnNrBrDrEr!csht|ts t|}jrfddt|D}n fddt|D}t|dkr-|S|dS)Ncs2g|]}ttr|nqSr)rr_CallSampler__try_fnrirCrSr%rrrs  z0Function._CallSampler.sample..csg|]}qSrrrrrrrsrBr)rr pass_configrangerpr8rqrrrrFs  zFunction._CallSampler.samplerQ) rrrrr4rrr r rr1rFrrrr _CallSamplersrrc Csvt|}d}z|iWn tyd}Ynw|s3z|Wnty2}ztd|d}~ww||_||_dS)NTFz]The function passed to a `Function` parameter must be callable with either 0 or 1 parameters.)rbind TypeErrorr;rr)r%rsigrexcrrrr&s(   zFunction.__init__cCrINTrr'rrrrJrKzFunction.is_functionr7cCrIrrr6rrrrO rKzFunction.is_validcCs |jdS)Nz()rr'rrrrP#s zFunction.domain_strN) rrrrVrr@rr&rJrrOr2rPrrrrrs&rc @s`eZdZdedeeeffddZddZ   dd e d e ee e e fd ed d fddZ dS)rr:rcCs||_||_|js JddS)Nz&Quantized() expects a sampler instance)r:r)r%r:rrrrr&*szQuantized.__init__cCs|jSr)r:r'rrrrA0szQuantized.get_samplerNrBrSrCrDrEr!cCst|ts t|}|jdkr|jj||||dSt|}t|j|j|j|_t |j |j|j|_ |jj||||d}t t ||j|j}t|tj sX||St|S)NrB)rE)rrrr:rFrrceilrmrrnrdividendarrayr8r)r%rSrCrDrEquantized_domainvaluesrrrrrF3s    zQuantized.samplerQ)rrrrRr rer1r&rAr5r rrrFrrrrr(srrcCst|S)zSpecify that tune should sample configuration values from this function. Arguments: func: An callable function to draw a sample from. )rrrrr sample_fromMrgrrmrncCt||S)zSample a float value uniformly between ``lower`` and ``upper``. Sampling from ``tune.uniform(1, 10)`` is equivalent to sampling from ``np.random.uniform(1, 10))`` )rhrorrrrroWsrorcCt|||S)a>Sample a quantized float value uniformly between ``lower`` and ``upper``. Sampling from ``tune.uniform(1, 10)`` is equivalent to sampling from ``np.random.uniform(1, 10))`` The value will be quantized, i.e. rounded to an integer increment of ``q``. Quantization makes the upper bound inclusive. )rhrorrmrnrrrrquniformbs rr]cC|turtt||S)zSugar for sampling in different orders of magnitude. Args: lower: Lower boundary of the output interval (e.g. 1e-4) upper: Upper boundary of the output interval (e.g. 1e-2) )r^rrhrrmrnr]rrrrps rcC"|turtt|||S)aSugar for sampling in different orders of magnitude. The value will be quantized, i.e. rounded to an integer increment of ``q``. Quantization makes the upper bound inclusive. Args: lower: Lower boundary of the output interval (e.g. 1e-4) upper: Upper boundary of the output interval (e.g. 1e-2) q: Quantization number. The result will be rounded to an integer increment of this value. )r^rrhrrrmrnrr]rrr qloguniform~rrcCs t|S)zSample a categorical value. Sampling from ``tune.choice([1, 2])`` is equivalent to sampling from ``np.random.choice([1, 2])`` )rrorrrrrs rcCr)aSample an integer value uniformly between ``lower`` and ``upper``. ``lower`` is inclusive, ``upper`` is exclusive. Sampling from ``tune.randint(10)`` is equivalent to sampling from ``np.random.randint(10)`` .. versionchanged:: 1.5.0 When converting Ray Tune configs to searcher-specific search spaces, the lower and upper limits are adjusted to keep compatibility with the bounds stated in the docstring above. )rrorrrrr,sr,cCr)ajSample an integer value log-uniformly between ``lower`` and ``upper``. ``lower`` is inclusive, ``upper`` is exclusive. .. versionchanged:: 1.5.0 When converting Ray Tune configs to searcher-specific search spaces, the lower and upper limits are adjusted to keep compatibility with the bounds stated in the docstring above. )r^rrrrrrr lograndints rrBcCr)aSample an integer value uniformly between ``lower`` and ``upper``. ``lower`` is inclusive, ``upper`` is also inclusive (!). The value will be quantized, i.e. rounded to an integer increment of ``q``. Quantization makes the upper bound inclusive. .. versionchanged:: 1.5.0 When converting Ray Tune configs to searcher-specific search spaces, the lower and upper limits are adjusted to keep compatibility with the bounds stated in the docstring above. )rrorrrrrqrandintsrcCr)aSample an integer value log-uniformly between ``lower`` and ``upper``. ``lower`` is inclusive, ``upper`` is also inclusive (!). The value will be quantized, i.e. rounded to an integer increment of ``q``. Quantization makes the upper bound inclusive. .. versionchanged:: 1.5.0 When converting Ray Tune configs to searcher-specific search spaces, the lower and upper limits are adjusted to keep compatibility with the bounds stated in the docstring above. )r^rrrrrrrr qlograndintrrrarrbrccCstdd||S)zSample a float value normally with ``mean`` and ``sd``. Args: mean: Mean of the normal distribution. Defaults to 0. sd: SD of the normal distribution. Defaults to 1. N)rhr}rdrrrrandns rcCstdd|||S)aaSample a float value normally with ``mean`` and ``sd``. The value will be quantized, i.e. rounded to an integer increment of ``q``. Args: mean: Mean of the normal distribution. sd: SD of the normal distribution. q: Quantization number. The result will be rounded to an integer increment of this value. N)rhr}r)rbrcrrrrqrandns r)rN)rBr)<loggingrrinspectrmathrtypingrrrrr r r numpyrray.util.annotationsr r rr Generatorrr#r getLoggerrrr_r^rrr!r1r5rRrVr[r\r`rGrhrrrrrrerorrrrr,rrrrrrrrrs   $    )>    S0I$