o iVL @sddlZddlZddlZddlZddlmZmZmZm Z ddl m Z m Z m Z ddlmZer4ddl mZddlmZeeeeefZejejejejejejejeej f Z!hdZ"hd Z#d ed efd d Z$ddZ%ddZ&ddZ'ddZ(ddZ)dS)N)_is_numpy_array _join_with_infer_numpy_type_is_npt_ndarray) TensorDescTensorSymExprs)IS_AOT_ENABLED)KernelLaunchParams)AutoTuneCombination>stdtrttensorrt>streamtacticoutputsnsnamecCsdd|vrtd|d|d|dd|vr$td|d|d|d|tvr0td|ddS)N.zProvided namespace z- cannot have any '.' in trt.plugin.register("z::z", ...)zProvided name z is a reserved namespace) ValueErrorRESERVED_NAMESPACES)rrrV/home/ubuntu/.local/lib/python3.10/site-packages/tensorrt_bindings/plugin/_validate.py_validate_name_and_namespace9s rc Csg}t}g}d}i}t|}t|jD]\}\} } | jtjjtjj fvr0t d| d| j tjj kr?t d| d| j tjj urNt d| dt| j trl|r^t d|d|| |d| q|d krxt d |d| tvrt d | d | j tvrt| j r|s| j tjkrt d t| j rt| j } | tvrt d| dtdd| f|| <nt d| d| j dtdtd d| j f|| <d}|| j d| | j || <q||dt|d|fS)NFz Argument z3 is not a positional-or-keyword or keyword-only argzg does not have a type annotation. Please mark as TensorDesc or one of the serializable attribute types.z; has a default value. Default values are not supported yet.z]TensorDescs args and attribute args cannot be interspersed. Received function with signature rz TensorDesc rz]TensorDescs args should come first, followed by attributes. Received function with signature 'z,' is not allowed as a plugin attribute name.zIf using non-lazy registration, annotate numpy array attributes using 'numpy.typing.NDArray[dtype]', where 'dtype' is the expected numpy dtype of the array. Attribute 'zG' is not a supported numpy array type. Supported numpy arrays type are z ' of type z; is not a supported serializable type. Supported types are z or numpy arrays of type T ())dictinspect signature enumerate parametersitemskind ParameterPOSITIONAL_OR_KEYWORD KEYWORD_ONLYr annotationemptydefault issubclassrappendDISALLOWED_ATTR_NAMESSERIALIZABLE_BUILTIN_TYPESrnpndarrayrrSERIALIZABLE_NP_DTYPESr) register_func lazy_register tensor_names input_attrs schema_chunkssaw_first_attr attrs_typessigidxrparamnp_dtyperrr_parse_register_inputsKs                r@cCst|}|j}|tjjkrtd|dt|tur3t |r't |t s/td|dd}|St |}|D]}t |t sItd|dq:t |}|S)NzENo return annotation found for register function. Received signature rReturn argument is of type z;. Return types can only be TensorDesc or Tuple[TensorDesc].r)r"r#return_annotationr(r,rtyping get_origintupleisclassr.rget_argslen)r5r<ret_annotation num_outputsargsargrrr_parse_register_returns0        rMc s2gd}t|}|j}|jD]\}}|dkrd}|jtjjkr|dkrYt |jt ur9t d|jdt |j}|D]}t|tsWt d|d|jd |d qAq|d krht|jtsgt d q|dkrwt|jtsvt d qt|jtr||jvrt d|d|jdq||jvrt d|dt|d|j|j|krt d|d|j|d|q||jvrLj|qfdd|D} dt|jt| dd} |r| d7} n| d7} dd|jd| krt d|d| |jtjjkr|jdurt d|fS)NFrTrz4'outputs' should be of type Tuple[Tensor]. Received rz'Argument for receiving output Tensor, ' ' contains a . 'z' should be a Tuple[Tensor].rz('stream' input argument should be an int('tactic' input argument should be an intUnexpected tensor '2' specified in autotune function. Expected one of Unexpected attribute 'z.' specified in impl function. Expected one of rT' has a type annotation different from the one specified at registration. Expected ''.cg|]}|vr|qSrr.0nimpl_attr_namesrr z"_validate_impl..rz, outputs, streamz , tactic)r , z Signature of the impl function '0' does not match the expected input arg schema: z!Return annotation should be None.)r"r#r8keysr%r&r+r(r,rCrDrErrGr.rintinput_tensor_nameslistr/rjoinrB) impl_func plugin_def found_tacticr<registered_attr_namesrr>rKrLexpected_attr_schema_chunksexpected_schemarrZr_validate_impls               rkc sgt|}|j}|jD]\}}|jtjjkr|dkrQt |jt ur1t d|jdt |jD]}t|tsOt d|d|jd|dq9q|dkr`t|jts_t d qt|jtrx||jvrwt d |d |jdq||jvrt d |d t|d|j|j|krt d|d|j|d|q||jvr|qfdd|D}dt|jt|dd}dd|jd|krt d|d||j} | tjjkrt d|dd} | tjjkrVt | t ur t d| d| dt | tdkr$t d| d| dfdd } | d!| d"td#tsDt d$d#d%td&tsVt d'd&d(S))Nr8'outputs' should be of type Tuple[TensorDesc]. Received rz+Argument for receiving output TensorDesc, 'rNrO ' should be a Tuple[TensorDesc].rrPrQrRrSz2' specified in aot_impl function. Expected one of rrTrUcrVrrrW)aot_impl_attr_namesrrr\Gr]z&_validate_aot_impl..rTz, outputs, tactic)r^r z$Signature of the aot_impl function 'r_zENo return annotation found for aot_impl function. Received signature z`tuple[str | bytes, str | bytes, tensorrt.plugin.KernelLaunchParams, tensorrt.plugin.SymIntExprs]zReturn annotation is z . Expected cs^fdd}t}|tjus|tjur'tD]}||qdS|dS)Ncs.|tur|turtdd|ddSdS)Nz"Return annotation for argument at z is 'z'. Expected 'str' or 'bytes'.)strbytesr)arg_indexrrvalidate_str_or_bytesos zV_validate_aot_impl..validate_union_str_or_bytes..validate_str_or_bytes)rCrDUniontypes UnionTyperG)rtruoriga)rKrsrvalidate_union_str_or_bytesns  z7_validate_aot_impl..validate_union_str_or_bytesrrz-Argument at index 2 of return annotation is 'z1'. Expected 'tensorrt.plugin.KernelLaunchParams'.z-Argument at index 3 of return annotation is 'z5'. Expected a descendent of tensorrt.plugin.SymExprs.)r"r#r8r`r%r&r+r(r,rCrDrErrGr.rrarbrcr/rrdrBrHr r ) aot_impl_funcrfr<rhrr>rLrirjrIexpected_return_schemar{r)rnrKr_validate_aot_impls                 rc s"t|}|j}g|jD]\}}|jtjjkr|dkrQt |jt ur1t d|jdt |j}|D]}t|tsOt d|d|jd|dq9qt|jtri||jvrht d|d |jdq||jvr{t d |d t|d|j|j|krt d |d |j|d |q||jvr|qfdd|D}dt|jt|dd} dd|jd| krt d|d| d|j} | tjjkrt | turt| rt| tst d| dSt | }|D]}t|tst d| dqS)Nrrlrz,Argument for receiving output TensorDescs, 'rNrOrmrQrRrSrrTrUcrVrrrWautotune_attr_namesrrr\r]z&_validate_autotune..rTz , outputs)r^r z&Specified autotune function signature z6 is not consistent with the expected input arg schema rAzL. Return types can only be AutoTuneCombination or List[AutoTuneCombination].)r"r#r8r`r%r&r+r(r,rCrDrErrGr.rrbrcr/rrdrBrFr ) autotune_funcrfr<rhrr>rKrLrirjrIrrr_validate_autotunes                 r)*r"numpyr2rCrw_utilsrrrr_tensorrrr _exportr r _autotuner rafloatrqboolrpr1int8int16int32int64float16float32float64bool_r4rr0rr@rMrkrrrrrrs:    `!N s