o wi@s"UddlmZddlZddlZddlZddlmZddlm Z m Z m Z m Z m Z mZddlZddlZddlZddlmZddlmZmZmZmZmZmZmZmZm Z m!Z!m"Z"m#Z#m$Z$m%Z%m&Z&m'Z'm(Z(m)Z)m*Z*e ruddlm+Z+m,Z,ddl-m.Z.e e/e0e1e1e1fe/e0e1e1e1e1ffZ2e3e2Z4e3e/e0e0fZ5gdZ6d e7d <e8e/e0e1fe1fZ9dddZ:e:e6Z; dd ddZ<    d d d%d&Z=d d)d*Z>    d d d5d6Z?d d7d8Z@     ddd@dAZAddDdEZBddFdGZCddMdNZDddPdQZEddUdVZFejGdWeHdXddYdZZIddd^d_ZJejGdWeHdXdd`daZK b c  cdddhdiZLejGdWeHdXddkdlZM b   cdddmdnZNejGdWeHdXddsdtZOddudvZPejGdWeHdXddwdxZQddydzZR ddddZSdddZTdddZUdddZVd ddZWd!ddZX  d"d#ddZY d$d%ddZZd&ddZ[d'ddZ\d(ddZ] d$d)ddZ^ d*d+ddZ_ d$d)ddZ` d*d+ddZad,ddZbd,dd„Zcd-ddńZd d.d/ddȄZed0dd˄Zf d*d1dd΄Zg dd2dd҄Zhd3ddքZid4ddلZjd5dd܄Zkd6ddބZl d7d8ddZmd.d9ddZnd:ddZod;ddZpdddZsd>ddZtd?ddZud@ddZvddejwxDZyde7d<dAddZzdS(B) annotationsN)isnan) TYPE_CHECKINGAnyCallableTypeVarUnioncast) IR_VERSIONAttributeProto FunctionProto GraphProtoMapProto ModelProto NodeProtoOperatorSetIdProto OptionalProto SequenceProtoSparseTensorProto TensorProtoTensorShapeProtoTrainingInfoProto TypeProtoValueInfoProtodefsmappingsubbyte)KeysViewSequence)RepeatedCompositeFieldContainer))z1.0r!)z1.1r r!)z1.1.2r r!)z1.2r r!)z1.3r r!)z1.4.1 r!)z1.5.0r" r!)z1.6.0r# )z1.7.0r$ r*r!)z1.8.0r$ r*r!)z1.8.1r$r,r*r!)z1.9.0r$r*r!)z1.10.0r%r*r!)z1.10.1r%r.r*r!)z1.10.2r%r.r*r!)z1.11.0r%r r!)z1.12.0r%r r!)z1.13.0r%r r!)z1.13.1r%r1r r!)z1.14.0r'r r!)z1.14.1r'r2r r!)z1.15.0r'r&r!)z1.16.0r(r"r!)z1.17.0r(r"r!)z1.18.0r)r"r!VersionTableType VERSION_TABLEtablereturnVersionMapTypecs(id fd d }|D]}||q S) zOCreate a map from (opset-domain, opset-version) to ir-version from above table.release_versionstr ir_versionintargsrr:NonecsF~tgd|D]}|vr ||<|ddkr |d|df<qdS)N)ai.onnxz ai.onnx.mlai.onnx.trainingrrCzai.onnx.preview.trainingr!)zip)r<r>r@pairresultH/home/ubuntu/sommelier/.venv/lib/python3.10/site-packages/onnx/helper.pyprocessVs z-create_op_set_id_version_map..processN)r<r=r>r?r@rr:rArH)r9rJrowrHrFrIcreate_op_set_id_version_mapRs  rLF opsetidlistSequence[OperatorSetIdProto]ignore_unknownboolr?cs2dd fdd |rtfd d |DSS) a=Given list of opset ids, determine minimum IR version required. Args: opsetidlist: A sequence of OperatorSetIdProto. ignore_unknown: If True, ignore unknown domain and return default minimum version for that domain. Returns: The minimum IR version required (integer) r domain str | Noneversionr?r:cs,|pd|f}|tvrt|SrStd)NrBzUnsupported opset-version.)OP_SET_ID_VERSION_MAP ValueError)rQrSkey)default_min_versionrOrHrIfind_minus z)find_min_ir_version_for..find_minc3s|] }|j|jVqdSN)rQrS.0x)rXrHrI ~sz*find_min_ir_version_for..N)rQrRrSr?r:r?)max)rMrOrH)rWrXrOrIfind_min_ir_version_forfs  r_op_typer=inputs Sequence[str]outputsnamerR doc_stringrQoverloadkwargsrrc Kszt}||_|j||j||r||_|r||_|dur#||_|dur*||_|r;|j ddt | D|S)aConstruct a NodeProto. Args: op_type (string): The name of the operator to construct inputs (list of string): list of input names outputs (list of string): list of output names name (string, default None): optional unique identifier for NodeProto doc_string (string, default None): optional documentation string for NodeProto domain (string, default None): optional domain for NodeProto. If it's None, we will just use default domain (which is empty) overload (string, default None): optional field, used to resolve calls to model-local functions **kwargs (dict): the attributes of the node. The acceptable values are documented in :func:`make_attribute`. Returns: NodeProto Ncss&|]\}}|durt||VqdSrY)make_attribute)r[rVvaluerHrHrIr]szmake_node..) rr`inputextendoutputrdrerQrf attributesorteditems) r`rarcrdrerQrfrgnoderHrHrI make_nodes"    rqrSrcCt}||_||_|SzConstruct an OperatorSetIdProto. Args: domain (string): The domain of the operator set id version (integer): Version of operator set id Returns: OperatorSetIdProto rrQrS)rQrS operatorsetidrHrHrImake_operatorsetids rvnodesSequence[NodeProto]Sequence[ValueInfoProto] initializerSequence[TensorProto] | None value_infoSequence[ValueInfoProto] | Nonesparse_initializer"Sequence[SparseTensorProto] | Noner c Cs|durg}|dur g}|durg}t}|j|||_|j||j||j||j||j||rA||_ |S)aConstruct a GraphProto Args: nodes: list of NodeProto name (string): graph name inputs: list of ValueInfoProto outputs: list of ValueInfoProto initializer: list of TensorProto doc_string (string): graph documentation value_info: list of ValueInfoProto sparse_initializer: list of SparseTensorProto Returns: GraphProto N) r rprkrdrjrlrzr~r|re) rwrdrarcrzrer|r~graphrHrHrI make_graphs"      rcCrrrsrt)rQrSopsetidrHrHrI make_opsetids rfname opset_imports attributesSequence[str] | Noneattribute_protosSequence[AttributeProto] | Noner c Cs|durg}|dur g}| durg} t} || _|| _| j|| j|| j|| j|| j|| j ||rD|| _ | durK| | _ | j | | SrY) r rQrdrjrkrlrp opset_importrmattribute_protorerfr|) rQrrarcrwrrrrerfr|frHrHrI make_functions*        rrrcKst}t|_|j||dd}|dur|j|n |j}t |_ |dd}|dur7|j || D] \}}t|||q;|S)zConstruct a ModelProto Args: graph (GraphProto): *make_graph* returns **kwargs: any attribute to add to the returned instance Returns: ModelProto rN functions)rr r>rCopyFrompoprrkaddronnx_opset_versionrSrrosetattr)rrgmodelrimprkvrHrHrI make_model#s       rcKs8d}||vrd}||g}t|||<t|fi|S)Nr>r)getr_r)rrgir_version_fieldopset_imports_fieldimportsrHrHrImake_model_gen_versionHs   rprotoRModelProto | GraphProto | FunctionProto | NodeProto | TensorProto | ValueInfoProto dict_valuedict[str, str]rAcCs8|jdd=|D]\}}|j}||_||_q dSrY)metadata_propsrorrVri)rrrrentryrHrHrIset_metadata_propsQs  rrcCst||dSrY)r)rrrHrHrIset_model_propscrcaSequence[np.complex64] Sequence[int]csfddttdDS)Ncs4g|]}|ddkr|djn|djqS)r*r)realimagr[irrHrI hs&z+_split_complex_to_pairs..r*)rangelenrrHrrI_split_complex_to_pairsgs rzpDeprecated since 1.18. Scheduled to remove in 1.20. Consider using libraries like ml_dtypes for dtype conversion)categorycOt|i|SrY)_float32_to_bfloat16r@rgrHrHrIfloat32_to_bfloat16nrfvalfloattruncatecCsHttd|d}|r|d?St|rdS|d?d@d}||d?S)NO}|| d| ?O}n | d krn|dO}nd }dd| >} | | @r|d@s| | d@d ks| | @r| | d>@r| | d@d kr|d7}t|S|dkr|d} | d kr|dO}|| d?O}n || d>O}|| d?O}| d@r| d@s| d@r|d@dkr|d7}t|S|sdSt|S|r|dO}t|Sd}t|S|d@dkrd|BSt|r|r |dBSd|BS|d @d ?}|d @} |d kr|dkr) t|S|dkr|d} | dkrH|dd| >O}|| d| ?O}n | d krQ|dO}dd| >} | | @r|d@s| | d@d ks| | @r| | d>@r| | d@d kr|d7}t|S|dkr|d} | d kr|dO}|| d?O}n|| d>O}|| d?O}|d@dkr|dM}| d@r| d@s| d@r|d@dkr|d7}t|S|s|dO}t|S|r|dO}t|S|dO}t|S) aConvert a float32 value to a float8, e4m3 (as int). See :ref:`onnx-detail-float8` for technical details. Args: fval: float to convert scale: scale, divide *fval* by *scale* before casting it fn: no infinite values uz: no negative zero saturate: if True, any value out of range included inf becomes the maximum value, otherwise, it becomes NaN. The description of operator Cast fully describes the differences. Returns: converted float z4float32_to_float8e4m3 not implemented with fn=False.rrr6trxwr!r*r4r3r&r ii~uy)NotImplementedErrorr?rrrnpfloat32isinf rrrrrr\bretemexmaskrHrHrIrs    &           &          rr@cOrrY_float32_to_float8e5m2rrHrHrIfloat32_to_float8e5m2rrc Cs||}ttdt|d}|d@d?}|r|r|d@dkr#dS|d@dkr1|r/|d BSdS|d@d ?}|d @} |d krEd }t|S|dkr|d} | dkrb|dd| >O}|| d| ?O}n | d krk|dO}nd }dd| >} | | @r|d@s| | d@d ks| | @r| | d>@r| | d@d kr|d7}t|S|dkr|d} || d>O}|| d?O}| d@r| d@s| d@r|d @d kr|d7}t|S|sd}t|S|dkr| d krd}t|S|r|d O}t|Sd}t|S|s|s|d@dkrd |BSt|r|rd|BSd|BS|d@d ?}|d @} |d kr|dkr, t|S|dkr|d} | dkrK|dd| >O}|| d| ?O}n | d krT|dO}dd| >} | | @r|d@s| | d@d ks| | @r| | d>@r| | d@d kr|d7}t|S|dkr|d} || d>O}|| d?O}| d@r| d@s| d@r|d @dkr|d7}t|S|r|dO}t|S|dO}t|S|r|dO}t|S|dO}t|Std)aConvert a float32 value to a float8, e5m2 (as int). Args: fval: float to convert scale: scale, divide *fval* by *scale* before casting it fn: no infinite values uz: no negative zero saturate: if True, any value out of range included inf becomes the maximum value, otherwise, it becomes NaN. The description of operator Cast fully describes the differences. Returns: converted float rrrrrrirrr6rmrpor!r5r4r*rii {|nqz%fn and uz must be both False or True.)r?rrrrrrrrrHrHrIrs    $            "          rarraynp.ndarray | Sequencesigned np.ndarraycCs t||SrY)_pack_float32_to_4bit)rrrHrHrIpack_float32_to_4bits rcst|tjstj|tjd}|}t|jddk}|r(t|t dg}d fdd }t |dd}||dd d|dd d}| tj S) axConvert an array of float32 value to a 4bit data-type and pack every two concecutive elements in a byte. See :ref:`onnx-detail-int4` for technical details. Args: array: array of float to convert and pack signed: Whether the 4 bit variant is signed or unsigned Returns: Packed array with size `ceil(farray.size/2)` (single dimension). dtyper*r!rr:rcst||SrY)r_float32x2_to_4bitx2)r\yrrHrI single_funcrz*_pack_float32_to_4bit..single_funcN)r:r) isinstancerndarrayasarrayrravelprodshapeappendr frompyfuncastypeuint8)rr array_flat is_odd_volumerfuncarrrHrrIrs  rcCt|SrY)_pack_float32_to_float4e2m1)rrHrHrIpack_float32_to_float4e2m1srcCs|t|tjstj|tjd}|}t|jddk}|r(t|t dg}t |ddd|ddd}| tj S)aMConvert an array of float32 value to float4e2m1 and pack every two concecutive elements in a byte. See :ref:`onnx-detail-float4` for technical details. Args: array: array of float to convert and pack Returns: Packed array of float4e2m1 (as uint8) with size `ceil(farray.size/2)` (single dimension). rr*r!rN)rrrrrrrrrrr_float32x2_to_float4e2m1x2r r )rr r rrHrHrIrs   r data_typedimsvalsrawrc Csvt}||_||_|tjkr|rtdt|}d}|rC|tjkr$d}n|tjtjtj tj fvr3d}n|tj tj tj fvr@d}n|j}t|tjrTt|jdkrT|}|D]}||9}qVt||kr|tj tj tj fvrut||dkstd|dt|d|r||_n|tjtjfvrt|}n|tjkrt||jtjd}n{|tjtjtjtj tj fvrtjt tjt!tjd d tj t"tj d d i|} t#t$| t||}nD|tj tj fvr|tj k} t%|| d }n,|tj kr t&|}n|tj'krt|t(}n|tjkr't|t)}t*|} t+|| ,||j-,||S) aMake a TensorProto with specified arguments. If raw is False, this function will choose the corresponding proto field to store the values based on data_type. If raw is True, use "raw_data" proto field to store the values, and values should be of type bytes in this case. Args: name (string): tensor name data_type (int): a value such as onnx.TensorProto.FLOAT dims (List[int]): shape vals: values raw (bool): if True, vals contains the serialized content of the tensor, otherwise, vals should be a list of values of the type defined by *data_type* Returns: TensorProto z*Can not use raw_data to store string type.r!r*g?z8Number of values does not match tensor's size. Expected z , but it is z. rcWst|ddiS)NrTrr@rHrHrI1s zmake_tensor..cWst|dddS)NT)rrrrrHrHrIr5sr).rrrdSTRING TypeErrortensor_dtype_to_np_dtypeBFLOAT16 FLOAT8E4M3FNFLOAT8E4M3FNUZ FLOAT8E5M2FLOAT8E5M2FNUZUINT4INT4 FLOAT4E2M1itemsizerrrrrflattenrUraw_data COMPLEX64 COMPLEX128rFLOAT16rr viewuint16tolistrrrlistmaprrBOOLr?bytestensor_dtype_to_fieldgetattrrkr) rdrrrrtensornp_dtype expected_sizedfcastrfieldrHrHrI make_tensors               r9valuesindicesrcCs.t}|j||j||j||S)zConstruct a SparseTensorProto Args: values (TensorProto): the values indices (TensorProto): the indices dims: the shape Returns: SparseTensorProto )rr:rr;rrk)r:r;rsparserHrHrImake_sparse_tensorYs    r= elem_typeSequenceProto.DataType Sequence[Any]rcCst}||_||_|tjkr|Sd}|tjkr|j}n(|tjkr$|j}n|tjkr-|j }n|tj kr6|j }n |t j kr?|j}ntd|||S)z/Make a Sequence with specified value arguments.Nz8The element type in the input sequence is not supported.)rrdr> UNDEFINEDTENSOR tensor_values SPARSE_TENSORsparse_tensor_valuesSEQUENCEsequence_valuesMAP map_valuesrOPTIONALoptional_valuesrrk)rdr>r:sequencermrHrHrI make_sequencems&       rMkey_typekeys list[Any]rcCsrt}tjtjtjtjtjtjtjtj g}||_ ||_ |tj kr'|j |n ||vr1|j||j||S)zMake a Map with specified key-value pair arguments. Criteria for conversion: - Keys and Values must have the same number of elements - Every key in keys must be of the same type - Every value in values must be of the same type )rrINT8INT16INT32INT64UINT8UINT16UINT32UINT64rdrNr string_keysrkrOr:r)rdrNrOr: map_protovalid_key_int_typesrHrHrImake_maps$     r\OptionalProto.DataTyperi&google.protobuf.message.Message | NonercCst}||_||_|tjkr|Sd}|tjkr|j}n(|tjkr$|j}n|tjkr-|j }n|tj kr6|j }n |tj kr?|j }ntd|dusIJ|||S)z0Make an Optional with specified value arguments.Nz8The element type in the input optional is not supported.)rrdr>rArB tensor_valuerDsparse_tensor_valuerFsequence_valuerH map_valuerJoptional_valuerr)rdr>rioptionalrmrHrHrI make_optionals(        re str | bytesr0cCst|tr |dS|S)z2Coerce a string (or bytes) value into UTF-8 bytes.utf-8)rr=encode)rirHrHrI _to_bytess  rirV attr_type int | Noner c s$t}||_|r ||_t|tjrt||_tj|_ nRt|tj r-t ||_ tj |_ nAt|ttfr?t||_tj|_ n/t|trP|j|tj|_ nt|tra|j|tj|_ n t|trq|j|tj|_ nt|tr|j|tj|_ nt|t j!j"rft#|}t$|dkr|durt%d|d|durdd|D}tjtj&ftj tj'fttftj(fttj)fttj*fttj+fttj,ffD]\}t-fdd|Dr|}nq|durt%d |tj&kr|j./|tj&|_ nv|tj'kr |j0/|tj'|_ ne|tj(kr|j1/d d|Dtj(|_ nO|tj)kr0|j2/|tj)|_ n>|tj*krA|j3/|tj*|_ n-|tj+krR|j4/|tj+|_ n|tj,krc|j5/|tj,|_ n t6t7d |d |dur|j |krt7d t8|j d|j dt8|d|d |S)z0Makes an AttributeProto based on the value type.rNzCould not infer attribute `z` type from empty iteratorcSsh|]}t|qSrH)typer[rrHrHrI sz!make_attribute..c3s|]}t|VqdSrY) issubclassr[texp_trHrIr]sz!make_attribute..zRCould not infer the attribute type from the elements of the passed Iterable value.css|]}t|VqdSrY)rirmrHrHrIr]s'z%' is not an accepted attribute value.zInferred attribute type 'z'(z") mismatched with specified type '))9r rdrernumbersIntegralr?rINTrlRealrrFLOATr=r0risrrrqrrBr sparse_tensorrDr gGRAPHrtp TYPE_PROTO collectionsabcIterabler-rrUINTSFLOATSSTRINGSTENSORSSPARSE_TENSORSGRAPHS TYPE_PROTOSallintsrkfloatsstringstensorssparse_tensorsgraphs type_protosAssertionErrorr_attr_type_to_str)rVrirerjattrtypesexp_enumrHrrrIrhs                                              (rhAttributeProto.AttributeTypecCs t}||_||_|r||_|S)zeMake an AttributeProto holding a reference to the parent function's attribute of given name and type.)r rdrlre)rdrjrerrHrHrImake_attribute_ref/s rrcCsJ|jr td||jtjkr|jS|jtjkr|jS|jtjkr%|j S|jtj kr.|j S|jtj kr7|j S|jtjkr@|jS|jtjkrI|jS|jtjkrTt|jS|jtjkr_t|jS|jtjkrjt|jS|jtjkrut|jS|jtjkrt|jS|jtjkrt|jS|jtjkrt|j S|jtj!krdStd|)Nz)Cannot get value of reference attribute: zUnsupported ONNX attribute: )" ref_attr_namerUrlr rzrrxrrr{rBrqrDr|r~r}rrrr-rrrrrrrrrrrrrrA)rrHrHrIget_attribute_value;sB                      rrp attr_namecsTfdd|jD}t|dkrtdt|dkr$tdt|dS)Ncsg|] }|jkr|qSrHrdrZrrHrIr`sz'get_node_attr_value..r!z'Node has multiple attributes with name z Node has no attribute with name r)rmrrUr)rprmatchingrHrrIget_node_attr_value_s    rrcCst}||_|SrY)rrd)rdvalue_info_protorHrHrImake_empty_tensor_value_infohsrr!Sequence[str | int | None] | Noneshape_denotationlist[str] | Nonerc Ct}|j}||_|j}|durX|jg|r$t|t|kr$tdt|D]/\}}|j }|dur6nt |t r?||_ nt |t rH||_ntd|d|rW|||_q(|S)z:Makes a Tensor TypeProto based on the data type and shape.N>Invalid shape_denotation. Must be of the same length as shape.Invalid item in shape: z. Needs to be of int or str.)r tensor_typer>rdimrkrrU enumeraterrr? dim_valuer= dim_param denotation) r>rr type_prototensor_type_prototensor_shape_protorr6rrHrHrImake_tensor_type_proton2      rcCs2t}||_|r ||_t|||}|j||S)z8Makes a ValueInfoProto based on the data type and shape.)rrdrerrlr)rdr>rrerrrrHrHrImake_tensor_value_infos  rc Cr)z@Makes a SparseTensor TypeProto based on the data type and shape.Nrrz. Needs to be of int or text.)rsparse_tensor_typer>rrrkrrUrrrr?rr=rr) r>rrrsparse_tensor_type_protosparse_tensor_shape_protorr6rrHrHrImake_sparse_tensor_type_protorrcCs6t}||_|r ||_t|||}|jj|j|S)zEMakes a SparseTensor ValueInfoProto based on the data type and shape.)rrdrerrlrr)rdr>rrerrrrHrHrImake_sparse_tensor_value_infosrinner_type_protocCt}|jj||S)zMakes a sequence TypeProto.)r sequence_typer>rrrrHrHrImake_sequence_type_protorcCr)zMakes an optional TypeProto.)r optional_typer>rrrHrHrImake_optional_type_protorr value_typecCs t}||j_|jj||S)zMakes a map TypeProto.)rmap_typerNrr)rNrrrHrHrImake_map_type_protosrrcCs&t}||_|r ||_|j||S)z1Makes a ValueInfoProto with the given type_proto.)rrdrerlr)rdrrerrHrHrImake_value_info s  rr{cCsbt|tr|}nt|tr|jddd}nt|}t|dkr!|S|dddt|ddS)Nrgignore)errors@z ...<+len=>)rr=r0decoder)r{ sanitizedrHrHrI _sanitize_strs    relem_shape_denotationcCs>t}||_|r ||_t|||}t|}|jj|j|S)zJMakes a Sequence[Tensors] ValueInfoProto based on the data type and shape.)rrdrerrrlrr)rdr>rrerrrsequence_type_protorHrHrImake_tensor_sequence_value_info(s r subgraphs"str | tuple[str, list[GraphProto]]c Csg}||j|dd%dd}d&d d }td }d'dd}g}|dr1|||jn|dr@|||jn|drP|tt|jn|drwt |j j dkrc|dnt |j j }|dt|j |dn|dr|d|jjd||jn|dr|d|jdn|jr||||jn|jr||||jn|jr|tttt|jny|jr|dnp|jr|dt|jD]\} } | t |jdkrd nd!} |d| d| q|d"n?|jr=|dt|jD]\} } | t |jdkr!d nd!} |d| jd| q|d"||jn|d#|rLd$||fSd$|S)(N=rrr:r=cSs|dS)Nz.15grH)rrHrHrI str_floatCsz&printable_attribute..str_floatrr?cSrrY)r=)rrHrHrIstr_intIsz$printable_attribute..str_int_Tstr_elemCallable[[_T], str]xs Sequence[_T]cSsddt||dS)N[, ])joinr.)rrrHrHrIstr_listNsz%printable_attribute..str_listr{rqrzz, ...]rr!,rrz  )rrr:r=)rr?r:r=)rrrrr:r=)rrdrHasFieldrrreprrr{rrqrr1rr2r}rrrrr=r-r.rrrrrkr) rrcontentrrrrrr8rrcommar}rHrHrIprintable_attribute<sb                    rrTensorShapeProto.DimensioncCs$|d}|dur dStt||S)Nri?) WhichOneofr=r2)rwhichrHrHrI printable_dims rrqcCs|ddkr5tj|jj}|jdr3t|jjj r/|t dd t t |jjj 7}|S|d7}|S|ddur>dSd|dS) Nrirrrr\, scalarrz Unknown type )rrDataTypeNamerr>rrrrr=rr.rrqr{rHrHrIprintable_types "rrcCs,d|j}|jr|dt|jd}|S)N%rr)rdrlr)rr{rHrHrIprintable_value_infos rcCshd|jd}|tj|j7}|jdur.t|jr*|tddt t|j7}n|d7}|d7}|S)Nrrrr\rr) rdrrrrrrr=rr.rrHrHrIprintable_tensor_protos   rprefixc CsDg}t|jr|ddd|jD|dg}g}|jD]=}|rHt||}t|dts9tdtd| |d||dq!t|}t|t sYtd t d||q!dt |} dd d|j D} |jr||j d | d | d n ||j d| d |r|d||fS|d|S)NrcSg|]}d|qSrrHr[rdrHrHrIrz"printable_node..rr!z1printed_attr_subgraphs[1] must be an instance of .rzprinted must be an instance of cSrrrHrrHrHrIrrrz](ru(r)rrlrrrmrrr-rrkr=rnrjr`) rprrrr printed_attrsrprinted_attr_subgraphsprintedprinted_attributesprinted_inputsrHrHrIprintable_nodes6        rcsng}|d}d|jg}dd|jD}t|jr|dg}g}|jD]}|j|vr3|t|q$|t|q$|rW||d|g}|D] } ||d| qK|d|r|d||d|g}|D] } ||d| qq|dt|t|krd d|jDfd d |jD} |d ||d|g}| D] } ||d| q|d|d ||d|g} |jD]&} t| |dd} t | dt st dt d|| d| | dqdg}t|j r|ddd |j D||d|||d| D] }|dt|q%d|S)zDisplay a GraphProto as a string. Args: graph (GraphProto): the graph to display prefix (string): prefix of every line Returns: string z rcSh|]}|jqSrHrrprHrHrIrnz"printable_graph..rrruz,optional inputs with matching initializers (cSrrHrrrHrHrIrnrcsg|] }|jvrt|qSrH)rdrr graph_inputsrHrIrs  z#printable_graph..zinitializers ({T)rr!z-contents_subgraphs[1] must be an instance of rrr:rcSsg|]}d|jqSrr)r[outrHrHrIrs} )rdrzrrjrrrrprrr-rrkrlprintable_graph)rrrindentheader initializersin_strsin_with_init_strsinpline init_strsrrpcontents_subgraphstailr}rHrrIr sj                r google.protobuf.message.MessagecCst|tjjjstdtjjjd|jjD]6}|jdkr%| |jq|j |j krM|j |j kr?t||jD]}t|q7q||jrMtt||jqdS)z:Empties `doc_string` field on any nested protobuf messageszproto must be an instance of rreN)rgoogleprotobufmessageMessager DESCRIPTORfieldsrd ClearFieldrl TYPE_MESSAGElabelLABEL_REPEATEDr2strip_doc_stringr)r descriptorr\rHrHrIr s       r algorithmalgorithm_bindingsAssignmentBindingTypeinitializationGraphProto | Noneinitialization_bindingsAssignmentBindingType | NonercCsrt}|j||D]\}}|j}||_||_q |r#|j||r7|D]\}}|j}||_||_q'|SrY) rr!rupdate_bindingrrVrir$initialization_binding)r!r"r$r& training_inforrbindingrHrHrImake_training_info1s      r, tensor_dtypenp.dtypecC tj|jS)zConvert a TensorProto's data_type to corresponding numpy dtype. It can be used while making tensor. Args: tensor_dtype: TensorProto's data_type Returns: numpy's data_type )rTENSOR_TYPE_MAPr4r-rHrHrIrJ rcCr/)zConvert a TensorProto's data_type to corresponding data_type for storage. Args: tensor_dtype: TensorProto's data_type Returns: data_type for storage )rr0 storage_dtyper1rHrHrI$tensor_dtype_to_storage_tensor_dtypeVr2r4cCr/)zGet the name of given TensorProto's data_type. Args: tensor_dtype: TensorProto's data_type Returns: the name of data_type )rr0rdr1rHrHrItensor_dtype_to_stringbr2r5cCstjtj|jS)zConvert a TensorProto's data_type to corresponding field name for storage. It can be used while making tensors. Args: tensor_dtype: TensorProto's data_type Returns: field name )r_STORAGE_TENSOR_TYPE_TO_FIELDr0r3r1rHrHrIr1ns r1r4c Csz|tjvr tttj|St|tjrtjS|t j t j t j t j t jt jt jt jhvr5t j|jddStd|d)zConvert a numpy's dtype to corresponding tensor type. It can be used while converting numpy arrays to tensors. Args: np_dtype: numpy's data_type Returns: TensorsProto's data_type rzUnable to convert type z into TensorProto element type.)r_NP_TYPE_TO_TENSOR_TYPEr r?r issubdtypestr_rrcustom_np_typesbfloat16 float8e4m3fnfloat8e4m3fnuz float8e5m2float8e5m2fnuzint4uint4 float4e2m1mapping_name_to_data_typedescrrU)r4rHrHrInp_dtype_to_tensor_dtype|s*   rE KeysView[int]cCs tjS)zcGet all tensor types from TensorProto. Returns: all tensor types from TensorProto )rr0rOrHrHrHrIget_all_tensor_dtypess rGcCsi|]\}}||qSrHrH)r[rrrHrHrI s rHzdict[int, str]_ATTRIBUTE_TYPE_TO_STRcCs$|tjvr t|StjdS)zConvert AttributeProto type to string. Args: attr_type: AttributeProto type. Returns: String representing the supplied attr_type. r)r AttributeTyper:rIrO)rjrHrHrIrs r)r9r7r:r;)F)rMrNrOrPr:r?)NNNN)r`r=rarbrcrbrdrRrerRrQrRrfrRrgrr:r)rQr=rSr?r:r)rwrxrdr=raryrcryrzr{rerRr|r}r~rr:r )NNNNN)rQr=rr=rarbrcrbrwrxrrNrrrrrerRrfrRr|r}r:r )rr rgrr:r)rrrrr:rA)rrrrr:rA)rrr:r)r:r?)rrrrPr:r?)rTFT) rrrrrrPrrPrrPr:r?)r@rrgrr:r?)rFFT)rrrrPr:r)rrr:r) rdr=rr?rrrrrrPr:r)r:rr;rrrr:r)rdr=r>r?r:r@r:r) rdr=rNr?rOrPr:rr:r)rdr=r>r]rir^r:r)rirfr:r0)NN) rVr=rirrerRrjrkr:r rY)rdr=rjrrerRr:r )rr r:r)rprrr=r:r)rdr=r:r)r>r?rrrrr:r)rN) rdr=r>r?rrrer=rrr:r)rrr:r)rNr?rrr:r)r)rdr=rrrer=r:r)r{rfr:r=) rdr=r>r?rrrer=rrr:r)rr rrPr:r)rrr:r=)rqrr:r=)rrr:r=)rqrr:r=)rF)rprrr=rrPr:r)rr rr=r:r=)rrr:rA) r!r r"r#r$r%r&r'r:r)r-r?r:r.)r-r?r:r?)r-r?r:r=)r4r.r:r?)r:rF)rjr?r:r=){ __future__rcollections.abcrrvrcmathrtypingrrrrrr google.protobuf.messagernumpyrtyping_extensionsonnx._custom_element_types_custom_element_typesr:onnxr r r r rrrrrrrrrrrrrrrrr#google.protobuf.internal.containersrtupler=r?VersionRowTyper-r7r#r8__annotations__dictr;rLrTr_rqrvrrrrrrrr deprecatedDeprecationWarningrrrrrrrrrrr9r=rMr\rerirhrrrrrrrrrrrrrrrrrrrrr rr,rr4r5r1rErGrJrorIrrHrHrHrIs   T &   1 + $ %    ~   z     _ $  11    L    # M   #