o i@sddlmZddlZddlmZmZdejfddZdejfddZd ejd ejfd d Z dd eejdee dee fddZ dS))ListN)get_compute_capabilityGPUArchitectureErrorxcCs6|js Jt|d|sJt|ddS)Nz must be a CUDA Tensorz must be contiguous)is_cudastr is_contiguous)rr M/home/ubuntu/vllm_env/lib/python3.10/site-packages/flashinfer/triton/utils.py check_inputsr cCs(||ksJt|d|ddS)Nz must be a zD tensor)dimr)drr r r check_dim s(rabcCs^||ks Jdt|D]}||||ks,Jd|d|qdS)Nztensors should have same dimztensors shape mismatch,  and )r rangesize)rrir r r check_shapes rtensorsmajorminorcCs|dj}|D]}|j|ksJd|d|jq|dus"|durLt|\}}|dur:||vr:td|d||durN||vrPtd|d|dSdSdS)Nrz2All tensors should be on the same device, but got rzDevice major should be in z , but got zDevice minor should be in )devicerr)rrrrt actual_major actual_minorr r r check_devices"   r)NN) typingrtorchflashinfer.utilsrrTensorr rrintrr r r r s