o bi6%@sddlZddlZddlZddlZddlZddlZddlmZmZm Z m Z  dZ ej dkZ dedeefddZd edefd d Zd edefd dZ d(dededeejddfddZd(dedeejdefddZdefddZdefddZdedee eeffddZGdddeZ d)d eed!edeejde ee eeefffd"d#Z $d*d eedejd%ede eeffd&d'ZdS)+N)ListOptionalTupleUnionRAY_CONDA_HOMEntconda_env_namereturncCs~ts$dtjvs ttjvr$td}dtj|ddg}|dd|g7}ntd}ts0d||g}n td}|d|g}|ddgS) zQ Get a list of commands to run to silently activate the given conda env. CONDA_EXEconda.z/../etc/profile.d/conda.shz&&activatesourcez1>&2)_WIN32osenvironrget_conda_bin_executablepathdirname)r conda_pathactivate_conda_env activate_pathrX/home/ubuntu/.local/lib/python3.10/site-packages/ray/_private/runtime_env/conda_utils.pyget_conda_activate_commandss   rexecutable_namecCstjt}|r6tr-tj|d|}tj|r|Stj|d|}tj|r,|Sn tj|d|Sd}dtjvrrtjtjd}trktj|d|}tj|rY|Stj|d|}tj|rj|Sntj||Strx|dS|S)a Return path to the specified executable, assumed to be discoverable within a conda installation. The conda home directory (expected to contain a 'bin' subdirectory on linux) is configurable via the ``RAY_CONDA_HOME`` environment variable. If ``RAY_CONDA_HOME`` is unspecified, try the ``CONDA_EXE`` environment variable set by activating conda. If neither is specified, this method returns `executable_name`. z%s.exez%s.batzbin/%sr r z.bat) rrgetrrrjoinexistsr)r conda_home candidate conda_bin_dirrrrr+s4      rconda_env_pathcCs$t|}dt|dS)Nzray-%szutf-8)openreadhashlibsha1encode hexdigest)r"conda_env_contentsrrr_get_conda_env_nameTs r*conda_yaml_fileprefixloggerc Cs|dur tt}td}z t|dgddWnttfy+td|dtdwt|d d d g\}}}t || d dd }||vrT| d|ddS|d dd|d|g}| d|t ||\}} |dkrtj|r{t|td|d| dS)a Given a conda YAML, creates a conda environment containing the required dependencies if such a conda environment doesn't already exist. Args: conda_yaml_file: The path to a conda `environment.yml` file. prefix: Directory to install the environment into via the `--prefix` option to conda create. This also becomes the name of the conda env; i.e. it can be passed into `conda activate` and `conda remove` Nr --helpFthrow_on_errorz$Could not find Conda executable at 'z'. Ensure Conda is installed as per the instructions at https://conda.io/projects/conda/en/latest/user-guide/install/index.html. You can also configure Ray to look for a specific Conda executable by setting the z: environment variable to the path of the Conda executable.envlist--json{envszConda environment z already exists.createz--filez--prefixzCreating conda environment rz$Failed to install conda environment z : Output: )logging getLogger__name__rexec_cmdEnvironmentErrorFileNotFoundError ValueErrorrjsonloadsindexinfoexec_cmd_stream_to_loggerrrrshutilrmtree RuntimeError) r+r,r-r_stdoutr5 create_cmd exit_codeoutputrrrcreate_conda_env_if_neededYsD     rKcCsn|dur tt}|d|td}|dd|ddg}t||\}}|dkr5|d|d |d Sd S) NzDeleting conda environment r removez-pz--allz-yrz#Failed to delete conda environment z: FT)r7r8r9rArrBdebug)r,r-r delete_cmdrIrJrrrdelete_conda_envs rOcCsdtd}z t|dgddWntytd|dwt|ddd g\}}}t|d }|S) z+ Get conda env list in full paths. r r.Fr/#Could not find Conda executable at r r1r2r3r5rr:r;r=r>r?)rrFrGr5rrrget_conda_env_lists rRcCsZtd}z t|dgddWntytd|dwt|ddg\}}}t|S) aO Get `conda info --json` output. Returns dict of conda info. See [1] for more details. We mostly care about these keys: - `conda_prefix`: str The path to the conda installation. - `envs`: List[str] absolute paths to conda environments. [1] https://github.com/conda/conda/blob/main/conda/cli/main_info.py r r.Fr/rPr rAr3rQ)rrFrGrrrget_conda_info_jsons   rS conda_infocCsL|d}g}|dD]}||kr|d|fq |tj||fq |S)zH Gets the conda environments, as a list of (name, path) tuples. conda_prefixr5base)appendrrbasename)rTr,retr1rrrget_conda_envss rZc@s eZdZdS)ShellCommandExceptionN)r9 __module__ __qualname__rrrrr[sr[Tcmdr0cCsVtj|tjtjtjdd}|\}}|}|r&|dkr&td|||f|||fS)a Runs a command as a child process. A convenience wrapper for running a command from a Python script. Note on the return value: A tuple of the exit code, standard output and standard error is returned. Args: cmd: the command to run, as a list of strings throw_on_error: if true, raises an Exception if the exit code of the program is nonzero T)rGstdinstderruniversal_newlinesrz-Non-zero exit code: %s STDOUT: %s STDERR:%s) subprocessPopenPIPE communicatewaitr[)r^r0r-childrGr`rIrrrr:s    r:2n_linescKsd|vrtrddd|jDvrtdtj|fdtjtjd|}g}|j8t|jj dD](}| }|d ur<n| }|sCq0| | || d }| | q0Wd n1scwY|}|d |fS) zRuns a command as a child process, streaming output to the logger. The last n_lines lines of output are also returned (stdout and stderr). r1PATHcSsg|]}|qSr)upper).0xrrr sz-exec_cmd_stream_to_logger..z*On windows, Popen requires 'PATH' in 'env'T)rarGr`N )rkeysr=rbrcrdSTDOUTrGiterreadlinepollstriprWrArfr)r^r-rikwargsrg last_n_lineslinerIrrrrBs6  rB)N)TN)rh) r%r>r7rrCrbtypingrrrrrnamerstrrrr*LoggerrKboolrOr2rRdictrSrZ Exceptionr[intr:rBrrrrs` ) 9 "