o پi @sddlZddlmZzddlmZWney&ZzeZWYdZ[ndZ[wwdZedZ dde de de d e eeffd d Z dde d e fd d Z dS)N)ExternalStream) spatial_opszKFailed to load sgl_kernel.spatial_ops extension. Ensure CUDA Driver >= 12.4SM_aSM_b device_idreturncCsrtdurtt|durtj}tjj|||}t|dt d|d}t|dt d|d}||fS)z Create two streams for greenctx. Args: sm_A (int): The SM of stream A. sm_B (int): The weight of stream B. device_id (int): The device id. Returns: tuple[ExternalStream, ExternalStream]: The two streams. Nrzcuda:) stream_ptrdevicer) _spatial_import_error _IMPORT_ERRORtorchcudacurrent_deviceops sgl_kernelcreate_greenctx_stream_by_valuerr )rrrresstream_astream_brF/home/ubuntu/.local/lib/python3.10/site-packages/sgl_kernel/spatial.pyrs  rcCs6tdurtt|durtj}tj|}|j}|S)z Get the SMs available on the device. Args: device_id (int): The device id. Returns: int: The SMs available. N)r r r rrget_device_propertiesmulti_processor_count)r device_propssm_countrrrget_sm_available-s  r)N)r torch.cuda.streamsrr Exception_er ImportErrorr inttuplerrrrrrs.