o W۷i]@sdZddlmZddlZddlZddlZddlZddlZddl Zddl Z ddl Z ddl Z ddl Z ddlmZddlZdadadadada dadddZejddd kZdUddZddZddZddZddZddZ e j !dZ"e j !dZ#ddZ$ddZ%d d!Z&d"d#Z'd$d%Z(d&d'Z)d(d)Z*d*d+Z+d,d-Z,dVd/d0Z-dWd2d3Z.dXd6d7Z/d8d9Z0dYdzinclude/hipcubz) cupy_backends.cuda.apirZr/r5rGabspath__file__is_hipisdirr7r")rZ current_dirr&rXrrrr's$     r'cCsxtjdrt}|duo|ddk}t}|dur'|r|}ntj|d}n d}|s0t dt d |tjt ddd }tj |rOt d |n t d |d}d tjkr|durt d |t|tj|d}tj|rt d|t||durt d |t|dSdS|durt d |tjdd}|tj|tjd<dSdSdS)Nr*r?r@rQzZCUDA path could not be detected. Set CUDA_PATH environment variable if CuPy fails to load.z CUDA_PATH: {}cupy.datalibzWheel shared libraries: {}z%Not wheel distribution ({} not found))zAdding DLL search path: {}x64z&Adding DLL search path (for CUDA 13): zAdding to PATH: {}PATHr)rr3rJrErr/r5r7warningswarnrformatget_cupy_install_pathr_ version_infoadd_dll_directoryr6r0r1pathsep)rMis_condar< cuda_bin_path wheel_libdircuda_bin_x64_pathr5rrr_setup_win32_dll_directorysV       -rscCstjtjtjtdS)Nz..)r/r5r\r7rGr]rrrrrk7srkcCs.tjdd}|durtjdStj|S)azReturns the directory where CUDA external libraries are installed. This environment variable only affects wheel installations. Shared libraries are looked up from `$CUPY_CUDA_LIB_PATH/$CUDA_VER/$LIB_NAME/$LIB_VER/{lib,lib64,bin}`, e.g., `~/.cupy/cuda_lib/11.2/nccl/2.8.0/lib64/libnccl.so.2.8.0`. The default $CUPY_CUDA_LIB_PATH is `~/.cupy/cuda_lib`. CUPY_CUDA_LIB_PATHNz~/.cupy/cuda_lib)r/r0r1r5 expanduserr\)cupy_cuda_lib_pathrrrget_cupy_cuda_lib_path=s   rwdict[str, Any] | NonecCstdurtdatS)Nz _wheel.json)_preload_config_get_json_datarrrrrENsrEnamecCsZtjtdd|}tj|sdSt| }t|WdS1s&wYdS)Nrarb)r/r5r7rkr6openjsonload)r{ config_pathfrrrrzUs   $rzrcboolcCst}|dus |ddkrtd|ddS|tvr"td|||vr0td|d dSt|dur?td |dSd S) z(Returns if the preload can be attempted.Nr?r@zNot preloading z( as this is not a pip wheel installationFzUnknown preload library: zPreload z not configured in wheelzPreload already attempted: T)rEr _preload_libsAssertionError)rcrMrrr_can_attempt_preload^s rc stdts dSit<ddlm}m}z|}Wn|y:}ztd|WYd}~nd}~ww|td<td|dStd}td |ttd d d }|D]׉td dddfdddD}dkrd}t |d|}ndkrd}t |d|}|D]T} t j | std| qztd| t| t| <tdWnity }z t|j} d| d| d|d} t| t| WYd}~qd}~wwtdtddztt<tdWqrtyH}ztdd|WYd}~qrd}~wwqrdS) zPreload dependent shared libraries. The preload configuration file (cupy/.data/_wheel.json) will be added during the wheel build process. z"Preloading triggered for library: NrrAz) could not be loaded by cuda-pathfinder: pathfinderz is loaded by cuda-pathfinder: cudaz$CuPy wheel package built for CUDA {}zCuPy CUDA library directory: {}version filenamesz Looking for z version  ()c s&g|]}tjd|qS)r)r/r5r7).0xrMrvfilenamercrrr sz$_preload_library..)rclib64rQrmin_pypi_versionrz"Rejected candidate (not found): {}zTrying to load Loadedz CuPy failed to preload library (z): zFile {} could not be foundz from default search pathzLibrary z could not be preloaded: )rrrrFrBrCrErjrw_get_cutensor_from_wheel_get_nccl_from_wheelr/r5r6ctypesCDLL Exceptiontype__name__rhri) rcrBrC loaded_dle cuda_versionr libpath_candsrlibpathe_typer rrr_preload_libraryzs            rrtuple[int, int, int]cCs^tjd|dd}t|d}t|dkrt|dnd}t|dkr(t|dnd}|||fS)Nz[^\d]rd)maxsplitr)rKsplitintlen)rpartsmajorminorpatchrrr_parse_versions   rpackage_prefixr&importlib.metadata.Distribution | Nonec Cs|d\}}|d|}ztj|}Wntjjy,t|d|dYdSwt|j}t|}|d|dkoU|d|dkpU|d|dkoU|d|dk} | sjt|d|d |d |jdSt|d|d |j|S) z Returns the distribution of the given package name and version installed via pip (e.g., cutensor-cuXX). If the package is not found or incompatible, returns None. .z-cuz wheel package (z) not installedNrrrz) incompatible: expected z, found z ) found: )r importlibmetadata distributionPackageNotFoundErrorrrr) rrrcuda_major_ver_pkgdistactualexpected is_compatiblerrr_find_compatible_wheels. r list[str]cCsztd||}|dur gStjdkr,|d|dd|d|ddg}n |d|d g}d d |DS) zx Returns the list of shared library path candidates for cuTENSOR installed via Pip (cutensor-cuXX package). rNr)zcutensor/lib/libcutensor.so.rrzcutensor/lib/libcutensorMg.so.zcutensor\bin\cutensor.dllzcutensor\bin\cutensorMg.dllcSg|]}t|qSrr rrcrrrrz,_get_cutensor_from_wheel..)rrr3 locate_filerrrr shared_libsrrrrs   rcCsPtjdkrgStd||}|durgS|d|ddg}dd|DS) zw Returns the list of shared library path candidates for NCCL installed via Pip (nvidia-nccl-cuXX package). r)z nvidia-ncclNznvidia/nccl/lib/libnccl.so.rrcSrrrrrrrr(rz(_get_nccl_from_wheel..)rr3rrrrrrrrs  rc Cst}|dus ||vr dS|ddkrc|d}|dd}|dkr=|dd}t|d}d|d |d |d d }n4|d kr\|d d}t|d}d|d |d |d d }ntd||ddkrod|}nttd|dt|jdt|d|d dS)Nr?piprrrrrzpip install "cutensor-cuz>=z, If you previously installed CuPy via conda, also run the following: $ conda uninstall cupy 2. Install the appropriate CuPy package. Refer to the Installation Guide for detailed instructions. https://docs.cupy.dev/en/stable/install.html -------------------------------------------------------------------------------- ) rrrappendrrr7sortedrhri)knowncupy_installedkcupy_packages_listrrr_detect_duplicate_installationks  rc Csdd}tjdkr0z|t7}W|Sty/}z|dt|jd|7}WYd}~|Sd}~ww|S)NaFailed to import CuPy. If you installed CuPy via wheels (cupy-cudaXXX or cupy-rocm-X-X), make sure that the package matches with the version of CUDA or ROCm installed. On Linux, you may need to set LD_LIBRARY_PATH environment variable depending on how you installed CUDA/ROCm. On Windows, try setting CUDA_PATH environment variable. Check the Installation Guide for details: https://docs.cupy.dev/en/latest/install.htmlr*z% The cause could not be identified: : )rr3_diagnose_win32_dll_loadrrr)r rrrr_diagnose_import_errors"  rc Cs"td}|dur dSddlm}td}|j|j|jg|j_|j|j_ dddt dg}t d}|d D]T}zt|}||j |t ||d |d |jWq7tyh|d |d Yq7ty}z|d |d t|jd|dWYd}~q7d}~wwd|S)Nz _depends.jsonrr)wintypeskernel32z CUDA Path: zDLL dependencies:idependsz z -> z -> not foundz -> error (rrr)rzrrrHANDLELPWSTRDWORDGetModuleFileNameWargtypesrestypercreate_unicode_buffer_handlerrvalueFileNotFoundErrorrrrr7)rrrlinesfilepathr{dllrrrrrs4         0 r)r r r r )r rx)r{r r rx)rcr r r)rr r r)rr rr rr r r)rr rr r r)rrrrr r)r r );__doc__ __future__rr functoolsimportlib.metadatarr}r/os.pathr3rKrSrtypingrrhrrr r#r&ryrr0r1rrrrr"r%r(rJr2r8r=rrr!r$r'rsrkrwrErzrrrrrrrcacherrrrrrrrsp     4 6    ]  !   H