o Ơi @sddlZddlmZejdkrddlmZnddlmZddlZddlmZzddl m Z Wne y<e dYnwGdd d eZ dS) N)Any) )Self)Device)_CzrUnable to import torchscript frontend core and torch-tensorrt runtime. Some dependent features may be unavailable.csPeZdZdZdedeffdd ZdejfddZe d e de fd d Z Z S) TorchScriptDevicea Defines a device that can be used to specify target devices for engines Attributes: device_type (torch_tensorrt.DeviceType): Target device type (GPU or DLA). Set implicitly based on if dla_core is specified. gpu_id (int): Device ID for target GPU dla_core (int): Core ID for target DLA core allow_gpu_fallback (bool): Whether falling back to GPU if DLA cannot support an op should be allowed argskwargscstj|i|dS)a__init__ Method for torch_tensorrt.Device Device accepts one of a few construction patterns Args: spec (str): String with device spec e.g. "dla:0" for dla, core_id 0 Keyword Arguments: gpu_id (int): ID of target GPU (will get overridden if dla_core is specified to the GPU managing DLA). If specified, no positional arguments should be provided dla_core (int): ID of target DLA core. If specified, no positional arguments should be provided. allow_gpu_fallback (bool): Allow TensorRT to schedule operations on GPU if they are not supported on DLA (ignored if device type is not DLA) Examples: - Device("gpu:1") - Device("cuda:1") - Device("dla:0", allow_gpu_fallback=True) - Device(gpu_id=0, dla_core=0, allow_gpu_fallback=True) - Device(dla_core=0, allow_gpu_fallback=True) - Device(gpu_id=1) N)super__init__)selfr r  __class__M/home/ubuntu/.local/lib/python3.10/site-packages/torch_tensorrt/ts/_Device.pyr szTorchScriptDevice.__init__returncCs4t}|jtj|_|j|_|j|_|j|_|S)N)rr device_typeto DeviceTypegpu_iddla_coreallow_gpu_fallback)r internal_devrrr _to_internal7s zTorchScriptDevice._to_internaldcCs||j|j|jdS)Nrrrr)clsrrrr_from?s zTorchScriptDevice._from)__name__ __module__ __qualname____doc__rr rrr classmethodobjectrr __classcell__rrrrrs  r)systypingr version_infortyping_extensionswarningstorch_tensorrt._Devicertorch_tensorrtr ImportErrorwarnrrrrrs