o پi@sddlmZmZddlZddlmZmZmZeser#ddlm Z ner-ddl m Z ne ddeej eej eej fdeej eeeeeffd d ZdS) )AnyUnionN)is_cudais_hipis_npuweak_ref_tensor)_weak_ref_tensorz5weak_ref_tensor is implemented only for CUDA and NPU.tensorsreturncCsPt|tjr t|St|trdd|DSt|tr$tdd|DStd)z Convenience function to create weak references to tensors, for single tensor, list of tensors or tuple of tensors. cSsg|]}t|qSr.0tr r Z/home/ubuntu/.local/lib/python3.10/site-packages/sglang/srt/compilation/weak_ref_tensor.py sz$weak_ref_tensors..css|]}t|VqdS)Nrr r r r sz#weak_ref_tensors..zInvalid type for tensors) isinstancetorchTensorrlisttuple ValueError)r r r rweak_ref_tensorss   r)typingrrrsglang.srt.utils.commonrrr sgl_kernelr torch_npu._Cr NotImplementedErrorrrrrr r r rs