o $i @sUddlZddlmZddlmZddlmZddlmZddl m Z er)ddl Z eeeda e ee fed<d d gd gd gdZiaead ed d fddZddded efddZded efddZdedefddZdS)N) TYPE_CHECKING)TensorTransportEnum)CollectiveTensorTransport)NixlTensorTransport)TensorTransportManager)NIXLGLOONCCLtransport_manager_classescudacputransport_namereturnrcCstt.|tvrt|WdS|tvrtd|t||t|<t|WdS1s3wYdS)aGet the tensor transport manager for the given tensor transport protocol. Args: transport_name: The tensor transport protocol to use for the GPU object. Returns: TensorTransportManager: The tensor transport manager for the given tensor transport protocol. N'Unsupported tensor transport protocol: )transport_managers_locktransport_managersr ValueError)r re/home/ubuntu/veenaModal/venv/lib/python3.10/site-packages/ray/experimental/gpu_object_manager/util.pyget_tensor_transport_manager's$rdevicez torch.devicetensor_transportcCs$|tvr td||jt|vS)z*Check if the device matches the transport.r)transport_devicesrtype)rrrrrdevice_match_transportCsrcCs.|}|tjjkr|tvrtd||S)NzInvalid tensor transport: )upperr OBJECT_STOREnamer r)rrrr'normalize_and_validate_tensor_transportLs  rray_usage_funccCs6|tjjkrt|std|d|ddSdS)Nz*Trying to use two-sided tensor transport: z for zS. This is only supported for one-sided transports such as NIXL or the OBJECT_STORE.)rrrr is_one_sidedr)rrrrrvalidate_one_sidedXs  r!) threadingtypingrray._private.custom_typesr?ray.experimental.gpu_object_manager.collective_tensor_transportr9ray.experimental.gpu_object_manager.nixl_tensor_transportrs4