o پi!@sddlZddlZddlZddlZddlZddlZddlmZddl m Z ddl Z e e ZddZddZdd Zd d Zd d ZdS)N)Path)ListcCs4tjsdStj}tj|}|jd|jS)z.Get the compute capability of the current GPU.N )torchcuda is_availablecurrent_deviceget_device_propertiesmajorminor)device propertiesrI/home/ubuntu/.local/lib/python3.10/site-packages/sgl_kernel/load_utils.py_get_compute_capabilitys   rcsVgd}g}g}|D]}t|tfdd|Dr!||q ||q ||S)zCFilter and prioritize compiled extensions over Python source files.)z.soz.pydz.dllc3s*|]}t|p|tvVqdS)N)strendswith).0extpathrr %s z._filter_compiled_extensions..)ranyappend) file_listcompiled_extensionscompiled_files other_files file_pathrrr_filter_compiled_extensionss   rcCst}td|ttj}td||dkr!d}d}n|dur.d}d|d }nd}d }t||d }t|}t|}td |td |td|td|g}|rt|d}td|zIt j dt|} | durt d|t j | } | jdurt d|td|d| j| td|td| j| WSty} z|| td|dt| jd| WYd} ~ n d} ~ wwtd|t|d } t| } t| }td| td| td||rt|d}td|zHt j dt|} | dur=t d|t j | } | jdurPt d|td |d| j| td!td| j| WSty} z|| td"|dt| jd| WYd} ~ n d} ~ wwtd#| td$zddl} td%td| j| WSt y} z|| td&| WYd} ~ nd} ~ wwd'd(d)|D}d*|d+|d,| d+|d-|d.|d/|d'}t|t |)0zBLoad the appropriate common_ops library based on GPU architecture.z1[sgl_kernel] GPU Detection: compute_capability = z#[sgl_kernel] sgl_kernel directory: Zsm90z.SM90 (Hopper/H100 with fast math optimization)Nsm100SMz! (precise math for compatibility)z(CPU/No GPU detected (using precise math)z common_ops.*z [sgl_kernel] Attempting to load z3[sgl_kernel] Looking for library matching pattern: z[sgl_kernel] Found files: z [sgl_kernel] Prioritized files: rz2[sgl_kernel] Found architecture-specific library: common_opsz!Could not create module spec for zModule spec has no loader for z![sgl_kernel] Loading module from z...u%[sgl_kernel] ✓ Successfully loaded u[sgl_kernel] ✓ Module file: u%[sgl_kernel] ✗ Failed to load from : uK[sgl_kernel] ✗ Architecture-specific library not found matching pattern: z6[sgl_kernel] Attempting fallback: looking for pattern z#[sgl_kernel] Found fallback files: z)[sgl_kernel] Prioritized fallback files: z%[sgl_kernel] Found fallback library: z*[sgl_kernel] Loading fallback module from u5[sgl_kernel] ✓ Successfully loaded fallback libraryu.[sgl_kernel] ✗ Failed to load fallback from u>[sgl_kernel] ✗ Fallback library not found matching pattern: zF[sgl_kernel] Final attempt: trying standard Python import 'common_ops'uA[sgl_kernel] ✓ Successfully imported via standard Python importu0[sgl_kernel] ✗ Standard Python import failed:  css&|]}dt|jd|VqdS)z- r%N)type__name__)rerrrrrrs z2_load_architecture_specific_ops..zw [sgl_kernel] CRITICAL: Could not load any common_ops library! Attempted locations: 1. Architecture-specific pattern: z - found files: z 2. Fallback pattern: zQ 3. Standard Python import: common_ops - failed GPU Info: - Compute capability: z - Expected variant: z Please ensure sgl_kernel is properly installed with: pip install --upgrade sgl_kernel Error details from previous import attempts: )rloggerdebugr__file__parentrglobr importlibutilspec_from_file_location ImportErrormodule_from_specloader exec_module Exceptionrr'r(r$join)compute_capabilitysgl_kernel_dir ops_subdir variant_name ops_patternraw_matching_filesmatching_filesprevious_import_errorsops_pathspecr$e alt_pattern raw_alt_filesalt_matching_filesalt_pathattempt_error_msg error_msgrrr_load_architecture_specific_ops0s                      rIcCsRtjdp tjd}|dur'td}|dur%tjtj|}|Sd}|S)zFind the CUDA install path. CUDA_HOME CUDA_PATHNnvccz/usr/local/cuda)osenvirongetshutilwhichrdirname) cuda_home nvcc_pathrrr_find_cuda_homes rUc Cstt}|d|dtdtdtdtdg}|D]B}|d}|r]z|}tjt|tjdt d |Wd St y\}zt d |d |WYd }~qd }~wwqt d d S)zRPreload the CUDA runtime library to help avoid 'libcudart.so.12 not found' issues.liblib64z/usr/lib/x86_64-linux-gnuz/usr/lib/aarch64-linux-gnuz /usr/lib64z/usr/libzlibcudart.so.12)modezPreloaded CUDA runtime under NzFailed to load r%z3[sgl_kernel] Could not preload CUDA runtime library) rrUexistsresolvectypesCDLLr RTLD_GLOBALr*r+r6)rScandidate_dirsbase candidatecuda_runtime_librBrrr_preload_cuda_librarys.    rb)r[r.importlib.utilr/loggingrMrPpathlibrtypingrr getLoggerr(r*rrrIrUrbrrrrs