o i@sddlZddlmZmZddlZddlmZm Z ddl m Z m Z Gddde Z Gdd d ee ZGd d d e ed ZGd ddejZeGdddeZeGdddeZeGdddeZeGdddeZeGdddeZddZeGdddZeGdddeZeGdd d eZeGd!d"d"ZeGd#d$d$ZeGd%d&d&eZeGd'd(d(Ze reGd)d*d*Z dSdS)+N)TupleUnion) public_apiIS_AOT_ENABLED)ABCabstractmethodc@seZdZeddZeddZeddZeddZed d Zed d Z ed dZ eddZ e ede fddZe edefddZe eddZdS)SymExprcCdSNselfopotherr r T/home/ubuntu/.local/lib/python3.10/site-packages/tensorrt_bindings/plugin/_tensor.py_opz SymExpr._opcCr r r rrr r r__add__rzSymExpr.__add__cCr r r rr r r__sub__"rzSymExpr.__sub__cCr r r rr r r__mul__&rzSymExpr.__mul__cCr r r rr r r __floordiv__*rzSymExpr.__floordiv__cCr r r rr r r__eq__.rzSymExpr.__eq__cCr r r rr r r__lt__2rzSymExpr.__lt__cCr r r rr r r__repr__6rzSymExpr.__repr__returncCr r r rr r r is_constant:zSymExpr.is_constantcCr r r rr r rconstant_value?rzSymExpr.constant_valuecCr r r rr r r_exprErz SymExpr._exprN)__name__ __module__ __qualname__rrrrrrrrrpropertyboolrintr r!r r r rr s4        r c@s eZdZdS)SymIntExprMetaN)r"r#r$r r r rr(Jsr(c@s eZdZdZdZd!deeejdffddZ dej deedffdd Z deedffd d Z deedffd d Z deedffddZdeedffddZdeedffddZdeedffddZddZedefddZdefddZeddZdd ZdS)" SymIntExprz. Symbolic integer (scalar) expression NvaluecCsfd|_t|trtjdurd|_dStj||_dSt|tjr&||_dSt|tr1|j|_dSdS)z Args: value (Union[int, trt.IDimensionExpr, SymIntExpr], optional): Constant or another symbolic expression. Defaults to creating a fake shape expression. N) _int_expr isinstancer'r) _exprBuilderconstanttrtIDimensionExprrr*r r r__init__Ss       zSymIntExpr.__init__rrcCs*t|tr t|}ttj||j|jSr )r,r'r)r- operationr!r r r rrcs zSymIntExpr._opcC|tjj|Sr )rr/DimensionOperationSUMrr r rrjzSymIntExpr.__add__cCr4r )rr/r5SUBrr r rrmr7zSymIntExpr.__sub__cCr4r )rr/r5PRODrr r rrpr7zSymIntExpr.__mul__cCr4r )rr/r5 FLOOR_DIVrr r rrsr7zSymIntExpr.__floordiv__cCr4r )rr/r5EQUALrr r rrvr7zSymIntExpr.__eq__cCr4r )rr/r5LESSrr r rryr7zSymIntExpr.__lt__cC>|jr dt|dS|jsdt|dSd|jdS)NzFakeSymIntExpr[id=]zSymIntExpr[id=z SymIntExpr[ _is_dummyidrr!get_constant_valuerr r rr| zSymIntExpr.__repr__rcCs|jrtd|jS)z `True` if this integer expression is a build-time constant, `False` otherwise. Raises: RuntimeError: For fake :class:`SymIntExpr`\s. Check :attr:`is_fake` to determine accessibility. zPNot accessible for fake 'SymIntExpr's. Check is_fake to determine accessibility.)r@ RuntimeErrorr!rrr r rrs  zSymIntExpr.is_constantcCs|jstd|jS)z Return value of the constant integer expression. Raises: RuntimeError: For non-constant integer expressions. Check :attr:`is_constant` to determine accessibility. zbNot accessible for non-constant integer expressions. Check is_constant to determine accessibility.)rrDr!rBrr r rr  zSymIntExpr.constant_valuecC|jSr )r+rr r rr!szSymIntExpr._exprcCs t|dSNr)r)rr r r_clones zSymIntExpr._cloner )r"r#r$__doc__r-rr'r/r0r2r5rrrrrrrrr%r&rr r!rHr r r rr)Ms$   r)) metaclassc@seZdZdefddZdS) SymExprImplexprcCsvtj|tjj|_t|trtjj |_ nt|t r!tjj |_ nt|t r,tjj|_ n tdt||j|_dS)NzUnknown SymIntExpr type )r/ISymExprr2 PluginArgTypeINTtyper,SymInt32PluginArgDataTypeINT32dtypeSymInt16INT16SymInt8INT8 ValueErrorr!rL)rrLr r rr2s         zSymExprImpl.__init__N)r"r#r$r)r2r r r rrKsrKcs<eZdZdZddeeejefffdd Z ddZ Z S) rQz2 Symbolic expression for a 32-bit integer Nr*ct|dSr superr2r1 __class__r rr2r7zSymInt32.__init__cCst|Sr )rKrr r r__call__zSymInt32.__call__r ) r"r#r$rIrr'r/r0r)r2r_ __classcell__r r r]rrQs rQc4eZdZdZddeeejdfffdd ZZ S)rWz2 Symbolic expression for an 8-bit integer Nr*r)crZr r[r1r]r rr2r7zSymInt8.__init__r r"r#r$rIrr'r/r0r2rar r r]rrW(rWcrb)rUz2 Symbolic expression for a 16-bit integer Nr*r)crZr r[r1r]r rr2r7zSymInt16.__init__r rcr r r]rrUrdrUcseZdZdZddeeejdefffdd Z dej deedfffdd Z d d Z e d efd dZe d efddZe d effdd Zd effdd ZddZZS) ShapeExprz> Symbolic expression for single dimension of a tensor Nr*cst|tj|_d|_d|_|durd|_dSt|tr*|jdur(d|_dSdSt|tr9|j|_|j|_dSt|trA dSdS)z Args: value (Union[int, trt.IDimensionExpr, ShapeExpr, SymIntExpr], optional): Constant or another symbolic expression. Defaults to creating a fake shape expression. FNT) r\r2r)r-r@_is_size_tensorr,r'rer1r]r rr2s        zShapeExpr.__init__rrcs,|jrtd|jr tStt||SNzKIt is not permitted to perform binary operations on size tensor expressions)rfrYr@rer\rr r]r rrs z ShapeExpr._opcCr=)NzFakeShapeExpr[id=r>z ShapeExpr[id=z ShapeExpr[r?rr r rrrCzShapeExpr.__repr__rcCrF)z A ShapeExpr may be "fake" when it is accessed in a non-shape calculation context. Fake `ShapeExpr`s are externally indistinguishable unless `is_constant` or `constant_value` is required. )r@rr r ris_fakeszShapeExpr.is_fakecCrF)zM `True` if this represents a size tensor, `False` otherwise. )rfrr r ris_size_tensorzShapeExpr.is_size_tensorcs|jrtdtjS)z `True` if this shape expression is a build-time constant, `False` otherwise. Raises: RuntimeError: For fake :class:`ShapeExpr`\s. Check :attr:`is_fake` to determine accessibility. ONot accessible for fake 'ShapeExpr's. Check is_fake to determine accessibility.)r@rDr\rrr]r rrs zShapeExpr.is_constantcs|jstdtS)z Return value of the constant shape expression. Raises: RuntimeError: For non-constant shape expressions. Check :attr:`is_constant` to determine accessibility. z`Not accessible for non-constant shape expressions. Check is_constant to determine accessibility.)rrDr\r rr]r rr rEzShapeExpr.constant_valuecCs t|d}|j|_|j|_|SrG)rer@rfrretr r rrH"s zShapeExpr._cloner )r"r#r$rIrr'r/r0r)r2r5rrr%r&rhrirr rHrar r r]rres"    recsbeZdZdZdfdd Zdejdeedffd d Z e d d Z e fd dZ ddZ ZS)SizeTensorShapeExprzZ Extends :class:`ShapeExpr` A shape expression that represent a size tensor size_tensor_descSizeTensorDesccs$td|_|jj|_||_dS)z .. note:: It is recommended to use :attr:`SizeTensorDesc.expr` to get a :class:`SizeTensorShapeExpr` representing a size tensor TN)r\r2rfoptrhr@_size_tensor_desc)rror]r rr20s   zSizeTensorShapeExpr.__init__rrrecCstdrg)rYr r r rr9r`zSizeTensorShapeExpr._opcCs|jrtddS)NrkF)r@rDrr r rr<s zSizeTensorShapeExpr.is_constantcs:|jdur|jStj|jj|jjj|jjj|_|jSr ) r+r\r-declare_size_tensorrrindexrqr! upper_boundrr]r rr!Ds $zSizeTensorShapeExpr._exprcCsdt|dS)Nz$ShapeExpr[is_size_tensor = True, id=r>)rArr r rrLr7zSizeTensorShapeExpr.__repr__)rorp)r"r#r$rIr2r/r5rr'rr%rr!rrar r r]rrn(s  rncCs8t|tr t|St|trtdtdt|d)Nz,Float symbolic expressions are not supportedzUnsupported type: '')r,r'rQfloatrYrP)sr r r _from_scalarOs  ryc@sdeZdZdefddZedeeeefddfddZ dd Z d d Z d d Z ddZ ddZdS)SymExprslengthcCs||_dg||_dS)z Iterable holding symbolic expressions Args: length (int): Number of dimensions of the tensor N)_length_exprsrr{r r rr2ZszSymExprs.__init__ shape_exprsrcC,tdd|D}|t|}t||_|S)zw Args: shape_exprs (Tuple[Union[SymExpr, int]]): Tuple to construct :class:`SymExprs` from cSs"g|] }t|tr |nt|qSr )r,r ry.0er r r k"z'SymExprs.from_tuple..tuplelenlistr}clsr shape_exprs_instr r r from_tupled  zSymExprs.from_tuplecC t|jSr )iterr}rr r r__iter__p zSymExprs.__iter__cC |j|Sr )r}rrtr r r __getitem__srzSymExprs.__getitem__cCrFr r|rr r r__len__vzSymExprs.__len__cCs2||jkr tdt|tst|}||j|<dSNIndex out of range)r| IndexErrorr,r ryr})rrtrLr r r __setitem__ys  zSymExprs.__setitem__cCdddd|jDdS)Nz SymExprs[, cSg|]}|qSr rrrxr r rrz%SymExprs.__repr__..r>joinr}rr r rrzSymExprs.__repr__N)r"r#r$r'r2 classmethodrrr rrrrrrr r r rrzXs   rzcsfeZdZdfdd ZedeeeefddfddZ defd d Z d d Z d dZ ddZ ZS) ShapeExprsFcsR|tjjkrtdtjjd|dt|||_|r'tg||_dSdS)z Iterable holding :class:`ShapeExpr`\s, representing a tensor shape Args: length (int): Number of dimensions of the tensor z6ShapeExprs can only support up to trt.Dims.MAX_DIMS = z dimensions. z given.N) r/DimsMAX_DIMSrYr\r2r@rer})rr{r@r]r rr2s  zShapeExprs.__init__rrrecCr)z{ Args: shape_exprs (Tuple[Union[ShapeExpr, int]]): Tuple to construct :class:`ShapeExprs` from cS"g|] }t|tr |nt|qSr )r,rerr r rrrz)ShapeExprs.from_tuple..rrr r rrrzShapeExprs.from_tuplecCs td}|jD]}||9}q|S)zJ Returns a symbolic expression for the number of elements r)rer})rrmrxr r rnumels  zShapeExprs.numelcCP||jkr tdt|ts!t|tstdt|dt|}||j|<dS)Nrz'Value should be int or ShapeExpr. Got 'rv)r|rr,rer'rYrPr}rrtr*r r rr   zShapeExprs.__setitem__cCr)Nz ShapeExprs[rcSrr rrr r rrrz'ShapeExprs.__repr__..r>rrr r rrrzShapeExprs.__repr__cCs"tdd|jD}|j|_|S)Ncss|]}|VqdSr )rHrr r r sz$ShapeExprs._clone..)rrr}r@rlr r rrHszShapeExprs._clone)F)r"r#r$r2rrrrer'rrrrrHrar r r]rrs    rcsNeZdZfddZedeeeefddfddZ dd Z d d Z Z S) SymIntExprscst|dS)z Iterable holding :class:`SymIntExpr`\s Args: length (int): Number of symbolic expressions in the iterable Nr[r~r]r rr2szSymIntExprs.__init__rrr)cCr)z} Args: shape_exprs (Tuple[Union[SymIntExpr, int]]): Tuple to construct :class:`SymIntExprs` from cSrr )r,r)rr r rrrz*SymIntExprs.from_tuple..rrr r rrrzSymIntExprs.from_tuplecCr)Nrz(Value should be int or SymIntExpr. Got 'rv)r|rr,r)r'rYrPr}rr r rrrzSymIntExprs.__setitem__cCr)Nz SymIntExprs[rcSrr rrr r rrrz(SymIntExprs.__repr__..r>rrr r rrrzSymIntExprs.__repr__) r"r#r$r2rrrr)r'rrrrar r r]rrs     rc@seZdZdZ ddeeeejej ffddZ defddZ d d Z d d Z d dZddZedefddZedeefddZedeefddZedeefddZddZddZdS)Shapez4 Numerical representation of a tensor shape N tensor_desccCsd|_t|tjrt|jj|_|jj|_||_ dSt|tj r,t|j|_|j|_dSt|t r?t ||_t|j|_dS|durNd|_t d|_dSt d)NrzUnsupported type used for constructing trt.plugin.Shape! tensor_desc must be a Tuple[int], trt.DynamicPluginTensorDesc, or trt.PluginTensorDesc) _is_dynamicr,r/DynamicPluginTensorDescrdescdimsr|_shapes_descPluginTensorDescrrrY)rrr r rr2s        zShape.__init__rcC|jrtdtt|jS)zy Number of elements contained Raises: ValueError: When :attr:`is_dynamic` is `True` z)Shape has at least one dynamic dimension.) is_dynamicrYr'npprodrrr r rrsz Shape.numelccs|jEdHdSr rrr r rr szShape.__iter__cCrr rrr r rr rzShape.__getitem__cCrFr rrr r rrrz Shape.__len__cCsdtt|S)Nr)strrrr r r__str__r7z Shape.__str__cCs6|jdur|jSd|_|jD] }|dkrd|_q|jS)^ `True` if this tensor has at least one dynamic dimension, `False` otherwise. NFT)rr)rdr r rrs  zShape.is_dynamiccC,|jstdt|dstdt|jjS)zH Optimum value of dimensions specified for auto-tuning. z5opt property is only accessible if is_dynamic is truerzcShape object has at least one dynamic dimension, but no information is available on 'opt' property.)rrYhasattrAttributeErrorrrrqrr r rrq$  z Shape.optcCr)z6 Lower bounds on tensor's dimensions. z5min property is only accessible if is_dynamic is truerzcShape object has at least one dynamic dimension, but no information is available on 'min' property.)rrYrrrrminrr r rr1rz Shape.mincCr)z6 Upper bounds on tensor's dimensions. z5max property is only accessible if is_dynamic is truerzcShape object has at least one dynamic dimension, but no information is available on 'max' property.)rrYrrrrmaxrr r rr>rz Shape.maxcCs ||jkr td||j|<dSr)r|rr)rrtvalr r rrKs zShape.__setitem__cCst}|j|j|Sr )r__dict__updaterlr r rrHPsz Shape._cloner )r"r#r$rIrrr'r/rrr2rrrrrr%r&rrqrrrrHr r r rrs*     rc seZdZdZd5dedejdejdefddZ d e fd d Z e d e fd d Z e ddZd6ddZd6ddZd6ddZd6ddZd7ddZddZe d efddZe d ejfddZe d efd d!Ze d ejfd"d#Ze d efd$d%Zejd&dZejd'dZejd(d!Zejd)d#Zejd*d%Ze d efd+d,Ze d efd-d.Ze d efd/d0Ze d efd1d2Z fd3d4Z!Z"S)8 TensorDesczb Descriptor for a tensor A `TensorDesc` never contains nor refers to any tensor data. N shape_exprrTformatscalecCs.||_||_d|_||_||_d|_d|_dS)a Args: shape_expr (ShapeExprs): The data with which to initialize the tensor. dtype (trt.DataType): The data type of the tensor. format (trt.TensorFormat): Format (layout) of the tensor. scale (float): Scale for INT8 data type. .. code-block:: python :linenos: :caption: Creates a TensorDesc with constant shape expressions tensor = trt.TensorDesc((10, 2, 32, 32), dtype=trt.float32) .. code-block:: python :linenos: :caption: Creates a TensorDesc from shape expression of another TensorDesc tensor = trt.from_shape_expr(other.shape_expr, dtype=trt.float32) NF) _shape_expr_dtype_shape_format_scale _aliased_to _immutable)rrrTrrr r rr2^s zTensorDesc.__init__rcCs|jstdtt|jS)a! Returns: Returns an int with the number of elements of the tensor. .. warning:: Should only be called when TensorDesc.has_shape is true. If a symbolic expression for the number of elements is required, query TensorDesc.shape_expr.numel(). tTensorDesc has no shape information available at this stage. Inspect TensorDesc.has_shape to determine availability.) has_shaperYr'rrshaperr r rrs zTensorDesc.numelcCrz& Number of dimensions )rrrr r rndim zTensorDesc.ndimcCdSNFr rr r rrirzTensorDesc.is_size_tensorcCs|}d|_|S)a Returns: Returns a TensorDesc which has identical properties to this tensor, and is mutable. .. code-block:: python :linenos: :caption: Communicate that output tensor has identical properties to the input tensor @tensorrt.plugin.register("my::plugin") def _(inp: tensorrt.plugin.TensorDesc) -> tensorrt.plugin.TensorDesc: return inp.like() F)rHrrclonedr r rlikes zTensorDesc.likecCs|}d|_||_d|_|S)a4 Returns: Returns a TensorDesc which has identical properties and is aliased to this tensor (would result in a `Tensor` during enqueue sharing the same data buffer). Returned TensorDesc is immutable. .. code-block:: python :linenos: :caption: Communicate that output tensor has identical properties to the input tensor @tensorrt.plugin.register("my::plugin") def _(inp: tensorrt.plugin.TensorDesc) -> tensorrt.plugin.TensorDesc: return inp.aliased() FT)rHrrrr r raliaseds zTensorDesc.aliasedcCsFt}|j|jd|_|j|_|jdur|j|_d|_|S)NFT)rrrrrrHrrr r rrHs   zTensorDesc._clonecCrF)z Returns: Returns a TensorDesc for the tensor which this tensor is aliased to. Returns None is this tensor is not aliased to any other tensor. rrr r r get_aliasedrjzTensorDesc.get_aliasedcCs|jstddS)Nr)rrYrr r r_validate_has_shapes zTensorDesc._validate_has_shapecCs t|dr |jrtddSdS)Nrz"Cannot modify immutable TensorDesc)rrrYrr r r_validate_not_immutablesz"TensorDesc._validate_not_immutablecCrF)z< Symbolic expressions for the tensor shape. rrr r rrrjzTensorDesc.shape_exprcCrFz* Data type of the tensor. rrr r rrTrjzTensorDesc.dtypecC||jS)z The (concrete) shape of the tensor. .. warning:: Only accessible when TensorDesc.has_shape is true. )rrrr r rrzTensorDesc.shapecCr)z The format of the tensor. .. warning:: Only accessible when TensorDesc.has_shape is true. )rrrr r rrrzTensorDesc.formatcCr)z Scale for INT8 data type. .. warning:: Only accessible when TensorDesc.has_shape is true. )rrrr r rrrzTensorDesc.scalecC ||_dSr rr1r r rr  cCrr rr1r r rrTrcC|||_dSr )rrr1r r rr cCrr )rrr1r r rrrcCrr )rrr1r r rrrcC |jduSzT True if this tensor is aliased to another tensor, False otherwise. Nrrr r r is_aliased!rzTensorDesc.is_aliasedcCr)zV True if this tensor has concrete shape information, False otherwise. Nrrr r rr(rzTensorDesc.has_shapecCs|jstd|jjS)rr)rrYrrrr r rr/s zTensorDesc.is_dynamiccCr)zV True if this tensor has symbolic shape expressions, False otherwise. N)rrr r rhas_shape_expr:rzTensorDesc.has_shape_exprc2t|dr|jr|dkrtdt||dS)Nrz-Cannot modify immutable TensorDesc propertiesrrrYr\ __setattr__rnamer*r]r rrAzTensorDesc.__setattr__)NNNN)rr)rN)#r"r#r$rIrr/DataType TensorFormatrwr2r'rr%rrirrrHrrrrrTrrrrsetterr&rrrrrrar r r]rrXsV !             rcseZdZdZdedeffdd ZeddZedefd d Zedefd d Z ede fd dZ de fddZ de fddZZS)rpz Extends :class:`TensorDesc` Descriptor for a size tensor: a scalar of either INT32 or INT64 data type used to express the extent of a data-dependent dimension. rqrucs4ttdtj||_||_d|_t||_ dS)a Args: opt (ShapeExpr): Symbolic expression for the extent of this size tensor to use in the autotune process of the engine build upper_bound (ShapeExpr): Symbolic expression for the upper-bound of this size tensor .. note:: It is recommended to construct a size tensor using :func:`size_tensor` instead of using this constructor directly rN) r\r2rr/int32_opt _upper_bound_indexrnr!)rrqrur]r rr2Ms zSizeTensorDesc.__init__cCr)NTr rr r rri[rzSizeTensorDesc.is_size_tensorrcCrF)z{ Symbolic expression for the extent of this size tensor to use in the autotune process of the engine build )rrr r rrq_rjzSizeTensorDesc.optcCrF)zM Symbolic expression for the upper-bound of this size tensor )rrr r rrufrjzSizeTensorDesc.upper_boundcCrF)z@ Output index at which this size tensor resides rrr r rrtmrjzSizeTensorDesc.indexidxcCrr r)rrr r r _set_indextrzSizeTensorDesc._set_indexcCrF)z: Symbolic expression for this size tensor )r!rr r rrLwszSizeTensorDesc.expr)r"r#r$rIrer2r%rirqrur'rtrrnrLrar r r]rrpFs rpcsbeZdZdZddZedefddZedefddZede j fd d Z ede fd d Z ede jfd dZedefddZedeefddZejddZe jdd Z e jdd Z ejddZejddZejddZdefddZeddZfddZd)dd Zed!d"Zed#d$Zd*d&ee eee jfddfd'd(ZZS)+Tensoraa Representation of a tensor that carries data :class:`Tensor` objects are strictly *descriptors* of a tensor with an underlying data buffer. `tensorrt.plugin` does not provide any APIs that perform standard data-altering operations on :class:`Tensor`\s. Supports `__cuda_array_interface__` for interoperability with other frameworks. cCs@d|_d|_d|_d|_d|_d|_d|_d|_d|_d|_ dSr) _data_ptrrrrr_stridesr_stream _read_onlyrrr r rr2s zTensor.__init__rcCrr)rrrr r rrrz Tensor.ndimcCrF)z; Pointer to the data buffer of this tensor rrr r rdata_ptrrjzTensor.data_ptrcCrFrrrr r rrTrjz Tensor.dtypecCrF)z5 The (concrete) shape of the tensor. rrr r rrrjz Tensor.shapecCrF)z+ The format of the tensor. rrr r rrrjz Tensor.formatcCrF)z+ Scale for INT8 data type. rrr r rrrjz Tensor.scalecCrF)z) Strides of this tensor. r rr r rstridesrjzTensor.stridescCrr r r1r r rr rcCrr rr1r r rrTrcCrr rr1r r rrrcCrr rr1r r rrrcCrr rr1r r rrrcCrr rr1r r rrrcCr)a. Returns the number of elements of the tensor Raises: ValueError: If the tensor has a data-dependent dimension. Examine :attr:`is_data_dependent` to determine whether the tensor is data-dependent. Returns: int: Number of elements of the tensor z|Tensor has a data-dependent dimension. Examine Tensor.shape to determine wildcards (representing data-dependent dimensions).)is_data_dependentrYr'rrrrr r rrs  z Tensor.numelcsjtjjtjjtjjfvrtdjdtjt t jj d}j |d<d|d<jdf|d<tfd d jD|d <|S) Nz Handling z0 via '__cuda_array_interface__' is not supported)rtypestrstreamversionFdatacs$g|]}|ttjjqSr )rrTr/nptyperitemsizerrr rrs$z3Tensor.__cuda_array_interface__..r)rr/rBF16FP8INT4rYrrrrTrrr rr )rrr rr__cuda_array_interface__s   zTensor.__cuda_array_interface__cr)Nrz)Cannot modify immutable Tensor propertiesrrr]r rrrzTensor.__setattr__cCrF)z Returns: Returns :class:`Tensor` of the tensor which this tensor is aliased to. Returns None is this tensor is not aliased to any other tensor. rrr r rr rjzTensor.get_aliasedcCs |jduSrrrr r rrrzTensor.is_aliasedcCs|jjS)zf True if this tensor contains at least one data-dependent dimension, False otherwise. )rrrr r rrszTensor.is_data_dependentNrcCst}|j|jd|_t|tjrt||_n0t|tr"||_n't|t r@t}||_ |j |_ |j |_|j|_t||_n |durEntd|js\|jr\|j|kr\td||_|S)a Return a :class:`Tensor` which has the same :attr:`data_ptr` as this but has the provided `shape`. Args: shape (Union[Shape, Tuple[int], trt.PluginTensorDesc], optional): Required shape of the new tensor (must have the same volume). Defaults to same shape. Raises: ValueError: If `shape` is not a supported type or if it does not have the same volume FNzUnsupported type for 'shape'z8Volume of this tensor is less than the provided 'shape'.)rrrrr,r/rrrrrrrPrrrrrYrrr)rrrrr r rr!s,       zTensor.aliased)rrr )r"r#r$rIr2r%r'rr r/rrTrrrrrwrrrrrrrrrrrrrrar r r]rrsN            ,rc@seZdZdZ       ddeeejefdeeejefdeeejefdeeejefdeeejefd eeejefd eeejeffd d Z d dZ dS)KernelLaunchParamsac Args: grid_x (Union[int, trt.IDimensionExpr, SymInt32], optional): The grid x dimension. Defaults to 1. grid_y (Union[int, trt.IDimensionExpr, SymInt32], optional): The grid y dimension. Defaults to 1. grid_z (Union[int, trt.IDimensionExpr, SymInt32], optional): The grid z dimension. Defaults to 1. block_x (Union[int, trt.IDimensionExpr, SymInt32], optional): The x dimension of each thread block. Defaults to 1. block_y (Union[int, trt.IDimensionExpr, SymInt32], optional): The y dimension of each thread block. Defaults to 1. block_z (Union[int, trt.IDimensionExpr, SymInt32], optional): The z dimension of each thread block. Defaults to 1. shared_mem (Union[int, trt.IDimensionExpr, SymInt32], optional): Shared-memory per thread block in bytes. Defaults to 0. rrgrid_xgrid_ygrid_zblock_xblock_yblock_z shared_memcCsJt||_t||_t||_t||_t||_t||_t||_dSr )rQrr r!r"r#r$r%)rrr r!r"r#r$r%r r rr2Ss      zKernelLaunchParams.__init__cCs*|dvr t||j|<dStd|d)N)rr r!r"r#r$r%z,KernelLaunchParams object has no attribute 'rv)rQrrrr r rrdszKernelLaunchParams.__setattr__N)rrrrrrr) r"r#r$rIrr'r/r0rQr2rr r r rrGs2  r)!tensorrtr/typingrrnumpyr_exportrrabcrrr rPr(r)rMrKrQrWrUrernryrzrrrrrprrr r r rsP2Y X& ,9%rn8G