o soinS@s ddlmZddlZddlmZmZddlZddlZddl mZ ddl Z ddl m Z er2ddlmZ  dOdPddZdQddZdRddZdQddZdRddZdSdTd"d#ZdUd%d&ZdVdWd)d*ZdXd.d/Z dYdZd3d4Zd[d8d9ZdVd\d;d<Zd]d@dAZ dYd^dCdDZ Ed_d`dKdLZdadMdNZdS)b) annotationsN) TYPE_CHECKINGAny)helper)SequenceTupx np.ndarraysaturatebool round_modestrreturncCstj|tjd}|tj}|d?d@}|tj}|dk}tj|tjd}d||<|}|dkr|d@dktj} |d@dktj} |d@dktj} |dktj} | d k| d k| d kB| d kB@} t|}d || |@<|r|d k| @|@}d||<||7}n/|d kr|d @dk}||@} |r|d k| @}d | |<|| tj7}n |dkrnt d||tj}||||<|t j S)arConvert float32 NumPy array to float8e8m0 representation. If the input is not a float32 array, it will be cast to one first. Args: x: Input array to convert. saturate: Whether to saturate at max/min float8e8m0 value. round_mode: "nearest", "up", or "down". Returns: np.ndarray: Array of ml_dtypes.float8_e8m0fnu values. dtypenearesti@ri iriOFdownzUnsupported rounding mode: ) npasarrayfloat32viewuint32astypeuint16 zeros_likeuint8 ValueError ml_dtypesfloat8_e8m0fnu)rr r x_f32f_bitsexponent special_maskoutput normal_maskgrslsbround_up incrementmax_mask has_fractionr1E/home/ubuntu/.local/lib/python3.10/site-packages/onnx/numpy_helper.py to_float8e8m0sF           r3datanpt.NDArray[np.uint8]dims Sequence[int]cCstj|jdg|jd}|td@}|td@}|tdL}||ddd<||ddd<|jt|dkr?|dd }|j|d d |S) aConvert a packed uint4 array to unpacked uint4 array represented as uint8. Args: data: A numpy array. dims: The dimensions are used to reshape the unpacked buffer. Returns: A numpy array of int8/uint8 reshaped to dims. rrNrFrefcheck)remptysizerrprodresize)r4r6result array_low array_highr1r1r2 _unpack_4bit_s  rFarraycCsx|tj}|j}|ddk}|r|j|dgdd|dM}|ddddK<|ddd|dddBS) z[Convert a numpy array to flatten, packed int4/uint4. Elements must be in the correct range.r8rFr=r9Nr;rravelrrrcopyr@rB)rG array_flatr@ odd_sizedr1r1r2 _pack_4bitx2xs rMcCstj|jdg|jd}|d@|ddd<|d?d@|ddd<|d?d@|ddd<|d?d@|ddd<|jt|krG|dt|}|j|d d |S) aConvert a packed uint2 array to unpacked uint2 array represented as uint8. Args: data: A numpy array. dims: The dimensions are used to reshape the unpacked buffer. Returns: A numpy array of int8/uint8 reshaped to dims. r;rrNr8rFr=)rr?r@rrArB)r4r6rCr1r1r2 _unpack_2bits rPcCs|tj}|j}|d}|r|j|d|gdd|dM}|ddddK<|ddddK<|ddddK<|d dd|dddB|dddB|dddBS) z[Convert a numpy array to flatten, packed int2/uint2. Elements must be in the correct range.r;Fr=rNrNr8rOrrH)rGrKr@pad_lenr1r1r2 _pack_2bitx4s8rRtensoronnx.TensorProtobase_dirc Cs|dr td|jtjjkrtd|j}t|}tt |}t |}|j }|jtjj krJt ||}dd|D}t|||Stj|rWtj|||dr|j} tjdkrotj| |d} |tjjtjjtjjhvrtj| tjd} t| | |S|tjj!tjj"hvrtj| tjd} t#| | |Stj| |d|S|tjj$tjj%tjj&tjj'hvrtj(|j)tj*d tj+tj,| |S|tjj-tjj.tjj/tjj0tjj1tjj2hvrtj(|j)tj*d tj+tj ||S|tjjtjjtjjhvr,tj(|j)tj*d tj+tj} t| | |S|tjj!tjj"hvrPtj(|j)tj*d tj+tj} t#| | |St ||} |tjj3tjj4fvrntj(| |dj |d|Stj| |d||S) a6Converts a tensor def object to a numpy array. This function uses ml_dtypes if the dtype is not a native numpy dtype. Args: tensor: a TensorProto object. base_dir: if external tensor exists, base_dir can help to find the path to it Returns: arr: the converted array. segmentz*Currently not supporting loading segments.z2The element type in the input tensor is UNDEFINED.cSsg|]}|dqS)utf-8)decode).0r+r1r1r2 szto_array..raw_databigr)5HasFieldr data_typeonnx TensorProto UNDEFINED TypeErrorrtensor_dtype_to_np_dtype$tensor_dtype_to_storage_tensor_dtypetensor_dtype_to_fieldr6STRINGgetattrrrrreshapeexternal_data_helperuses_external_dataload_external_data_for_tensorr\sys byteorder frombufferbyteswaptobytesINT4UINT4 FLOAT4E2M1rrFrUINT2INT2rPBFLOAT16FLOAT16INT16UINT16rG int32_dataint32rr FLOAT8E4M3FNFLOAT8E4M3FNUZ FLOAT8E5M2FLOAT8E5M2FNUZ FLOAT8E8M0BOOL COMPLEX64 COMPLEX128) rTrV tensor_dtypenp_dtypestorage_np_dtype storage_fieldr6 utf8_stringsssr\r4r1r1r2to_arrays           rbytescCs<|jjdkstjdkr|jjdkr||jd}|S)zConverts an array into bytes in little endian byte order. Args: array: a numpy array. Returns: bytes: Byte representation of passed array in little endian byte order. .. versionadded:: 1.20 >r]=<)rrnrmr newbyteorderrq)rGr1r1r2tobytes_little_endians rname str | NonecCst}|j|j|r||_|jtkst |jtj rPtjj |_ | }|D]%}t|tr9|j|dq(t|trE|j|q(tdtt||St|j}|tjjtjjtjjhvrgt|}|tjjtjjhvrut|}t||_ ||_ |S)zConverts an array into a TensorProto including Args: array: a numpy array. name: (optional) the name of the tensor. Returns: TensorProto: the converted tensor def. rXzMUnrecognized object in the object array, expect a string, or array of bytes: )!r`rar6extendshaperrobjectr issubdtypestr_rgr_flatten isinstancer string_dataappendencoderNotImplementedErrortypernp_dtype_to_tensor_dtyperrrsrtrMrurvrRrr\)rGrrT flat_arrayerr1r1r2 from_array2s@        rsequenceonnx.SequenceProto list[Any]cCs~|j}|tjjkrdd|jDS|tjjkrdd|jDS|tjjkr-dd|jDS|tjj kr;dd|j DSt d)zConverts a sequence def to a Python list. Args: sequence: a SequenceProto object. Returns: list: the converted list. cSg|]}t|qSr1rrZvr1r1r2r[xzto_list..cSrr1rrr1r1r2r[zrcSrr1)to_listrr1r1r2r[|rcSrr1)to_dictrr1r1r2r[~rz8The element type in the input sequence is not supported.) elem_typer` SequenceProtoTENSOR tensor_values SPARSE_TENSORsparse_tensor_valuesSEQUENCEsequence_valuesMAP map_valuesrc)rrr1r1r2rms    rlstr int | Nonec s,t}|r ||_|r|}n'tdkr1d}t|tr"tjj}nt|tr,tjj}n tjj }ntjj }||_ tdkrMt fddDsMt d|tjj krfD]}|j tt|gqU|S|tjjkr|D] }|jt|gqn|S|tjjkrD] }|jt|gq|St d)a]Converts a list into a sequence def. Args: lst: a Python list name: (optional) the name of the sequence. dtype: (optional) type of element in the input list, used for specifying sequence values when converting an empty list. Returns: SequenceProto: the converted sequence def. rc3s"|] }t|tdVqdS)rN)rr)rZelemrr1r2 s zfrom_list..zqThe element type in the input list is not the same for all elements and therefore is not supported as a sequence.zZThe element type in the input list is not a tensor, sequence, or map and is not supported.)r`rrlenrdictrlistrrrallrcrrrrrr from_listr from_dict) rrrrr first_elemrTseqmappingr1rr2rsB      "   r map_proto onnx.MapProtodict[Any, Any]cCsbg}|jtjjkrt|j}nt|j}t|j}t |t |kr(t d|j dt t ||ddS)zConverts a map def to a Python dictionary. Args: map_proto: a MapProto object. Returns: The converted dictionary. z2Length of keys and values for MapProto (map name: z) are not the same.F)strict)key_typer`rargr string_keyskeysrvaluesr IndexErrorrrzip)rkey_list value_listr1r1r2rs    rdict_cst}|r ||_t|}t|dt}tjj tjj tjj tjj tjj tjjtjjtjjh}tfdd|DsBtdt|}t|dtfdd|Ds^tdt|}||_|tjjkrr|j|n ||vr||j||j||S)zConverts a Python dictionary into a map def. Args: dict_: Python dictionary name: (optional) the name of the map. Returns: MapProto: the converted map def. rc3|] }t|kVqdSNr result_type)rZkey) raw_key_typer1r2rzfrom_dict..zfThe key type in the input dictionary is not the same for all keys and therefore is not valid as a map.c3rrr)rZval)raw_value_typer1r2rrzjThe value type in the input dictionary is not the same for all values and therefore is not valid as a map.)r`MapProtorrrrrrraINT8ryINT32INT64UINT8rzUINT32UINT64rrcrrrrgrrrCopyFrom)rrrrrvalid_key_int_typesr value_seqr1)rrr2rsB       roptionalonnx.OptionalProto Any | NonecCs|j}|tjjkr dS|tjjkrt|jS|tjjkr!t|jS|tjj kr,t |j S|tjj kr7t |jS|tjjkrBt|jStd)zConverts an optional def to a Python optional. Args: optional: an OptionalProto object. Returns: opt: the converted optional. Nz8The element type in the input optional is not supported.)rr` OptionalProtorbrr tensor_valuersparse_tensor_valuerrsequence_valuerr map_valueOPTIONAL to_optionaloptional_valuerc)rrr1r1r2r s           roptcCst}|r ||_|dur|tjjvrt|d|}n!t|tr)tjj}nt|t r3tjj }n |durs>     K    r  ; 9  5 4