o }oi1@sddlmZddlmZddlZddlmZddlm Z eZ ddl m Z Wdn1s0wYerJddl m Z ddlmZddlmZn dd lmZed Ze sae eZed d)ddZ  ! " # $ $ %d*d+d'd(ZdS),) annotations) TYPE_CHECKINGN) try_import) get_loggergreenlet)Callable)Any) _LazyImportzscipy.optimizez}The 'greenlet' package is unavailable, falling back to sequential L-BFGS-B optimization. This may lead to slower suggestions. func_and_grad,Callable[..., tuple[np.ndarray, np.ndarray]] x0_batched np.ndarray batched_argstuple[Any, ...]bounds list[tuple[float, float]] | Nonemintfactrfloatpgtol max_evals max_itersmax_line_searchreturn)tuple[np.ndarray, np.ndarray, np.ndarray]c  s2 jdksJt } t tj| tdtj| td d f dd fd d t| D} d d t| D} t d d | D} t t d d | D| j r|| gR\fdd t| D} t dd | D} t t dd | Ddd t | | D} | j s\ fS)NdtypeirrNonec svd dd}tj| tfd d D d \}}}| <|<|d  <tjdddS)Nxrargsr rtuple[float, np.ndarray]cWs&tj||\}}t||fSN)r getcurrentparentswitchrcopy)r"r#fvalgradr,M/home/ubuntu/.local/lib/python3.10/site-packages/optuna/_gp/batched_lbfgsb.py_func_and_grad5sz4_batched_lbfgsb..run.._func_and_gradc3|]}|VqdSr%r,.0argr r,r- =z/_batched_lbfgsb..run.. funcx0r#rrrrmaxfunmaxitermaxlsnit)r"rr#r rr$)so fmin_l_bfgs_btuplerr&r'r()r r.x_optfval_optinfo) rrr fvals_optrrrr n_iterationsrr xs_optr3r-run4s"    z_batched_lbfgsb..runcsg|]}tqSr,r)r1_)rFr,r- Ksz#_batched_lbfgsb..cSsg|] \}}||qSr,r(r1r glr,r,r-rHLscSg|] \}}|dur|qSr%r,r1r"rGr,r,r-rHMcSg|] \}}|dur|qSr%r,r1rGr#r,r,r-rHNrNcs$g|]\}}|||qSr,rIrJ)fvalsgradsr,r-rHQs$cSrLr%r,rMr,r,r-rHRrNcSrOr%r,rPr,r,r-rHSrNcSs g|] \\}}}|dur|qSr%r,)r1r"rGrKr,r,r-rHTs )r rrr!) ndimlennp empty_likeemptyrrrange enumeratearrayr?zipsize)r r rrrrrrrr batch_size greenletsx_and_args_list x_batchedr,)rrrrQrCrRrrrrrDrrFr rEr-_batched_lbfgsb"s$  $ rar, cAh㈵>:tuple[list[Any], ...]c  s\|j\} } t|D]\} } t| | ks#Jd| d| dt| dq |dus?t|| dfks?Jd| dt|dtr[t|d kr[t||||||||| d \}}}nNdfdd }t|}tj|jdt d}tj|jdt d}t|D])\}t j ||t fdd|D||||||| d \|<|<}|d|<q|||fS)a Batched L-BFGS-B optimization with/without greenlet. - `func_and_grad` is expected to take a 2D array as the first argument and return a tuple of a 1D array of function values and a 2D array of gradients. - `x0_batched` is a 2D array where each row is an initial point for optimization. - `batched_args` is a tuple of additional arguments to pass to `func_and_grad`. e.g., if `batched_args` is `([alpha1, ..., alphaB], [beta1, ..., betaB])`, then `func_and_grad` is called by `func_and_grad(x0_batched, [alpha1, ..., alphaB], [beta1, ..., betaB])`. Note that each argument in `batched_args` is expected to be a list of length `B` (batch size). z batched_args[z] must have length z , but got .Nrz!The shape of bounds must be (dim=z, 2), but got ) r r rrrrrrrrx_1drargs_1dr rr$csT|jdksJdd|D}|dddf}|g|R\}}||dfS)Nricss|]}|gVqdSr%r,r0r,r,r-r4szAbatched_lbfgsb.._func_and_grad_wrapper..r)rSitemr))rjrkargs_2dx_2dr*r+)r r,r-_func_and_grad_wrappers z.batched_lbfgsb.._func_and_grad_wrapperrrc3r/r%r,r0r3r,r-r4r5z!batched_lbfgsb..r6r<)rjrrkr rr$)shaperYrTrU_greenlet_imports is_successfulrarVrWrrr=r>r?)r r rrrrrrrrr]dimjr2rErCrDror8rBr,)r r r-batched_lbfgsbYsV   ru)r r r rrrrrrrrrrrrrrrrrrr)r,Nrbrcrdrererf)r r r rrrgrrrrrrrrrrrrrrrr) __future__rtypingrnumpyrUoptuna._importsroptuna.loggingrrqrcollections.abcrr scipy.optimizeoptimizer=optunar rr__name___loggerwarningrarur,r,r,r-s:       :