o Ti @sHddlmZzddlmZWn eydZYnwGdddeZdS)) OpBuilder)versionNcsJeZdZdZdZfddZddZddZd d Zdfd d Z Z S)SparseAttnBuilderDS_BUILD_SPARSE_ATTN sparse_attncstj|jddS)N)name)super__init__NAMEself __class__X/home/ubuntu/.local/lib/python3.10/site-packages/deepspeed/ops/op_builder/sparse_attn.pyr szSparseAttnBuilder.__init__cCsd|jdS)Nzdeepspeed.ops.sparse_attention._op)r r rrr absolute_nameszSparseAttnBuilder.absolute_namecCsdgS)Nzcsrc/sparse_attention/utils.cpprr rrrsourcesszSparseAttnBuilder.sourcescCsddgS)Nz-O2z-fopenmprr rrrcxx_argsszSparseAttnBuilder.cxx_argsFc s|r|r||jddSzddl}Wnty(|r%|dYdSw|jjdur=d}|r<||jdn,|jjddd\}}t|dkrVt|d kp[t|d k}|si|ri||jd t|j dd}t|j dd }|d ko|d k}|s|r||jd |d|zddl } Wnty|r|dYdSwt rt | j } | t dk} n| j } | dk} | r|r|d| ddSt |o|o|S)Nz is not compatible with ROCMFrz/unable to import torch, please install it firstz! cuda is not available from torch. r z requires CUDA version 10.1+z8 requires a torch version >= 1.5 and < 2.0 but detected z@please install triton==1.0.0 if you want to use sparse attentionz1.0.0zusing untested triton version (z'), only 1.0.0 is known to be compatible)is_rocm_pytorchwarningr torch ImportErrorrcudasplitint __version__triton pkg_versionparser is_compatible) r verbosercuda_compatiblemajorminor TORCH_MAJOR TORCH_MINORtorch_compatibler#installed_tritontriton_mismatchrrrr&s`    $     zSparseAttnBuilder.is_compatible)F) __name__ __module__ __qualname__ BUILD_VARr r rrrr& __classcell__rrrrrs r)builderr packagingrr$rrrrrrs