o wi(@spddlZddlZddlmZddZddZGdd d eZd d Z d d Z ddZ ddZ ddZ ddZdS)N)SharedMemoryTensorcCs t|dd)z/ Raise error with the provided message msgN)InferenceServerExceptionrrX/home/ubuntu/sommelier/.venv/lib/python3.10/site-packages/tritonclient/utils/__init__.py raise_error$s r cCsR|jtjkr td|jdkr'd}tj|dgddD] }|t|7}q|SdS)a  Get the underlying number of bytes for a numpy ndarray. Parameters ---------- tensor_value : numpy.ndarray Numpy array to calculate the number of bytes for. Returns ------- int Number of bytes present in this tensor z)The tensor_value dtype must be np.object_rrefs_okCflagsorder)dtypenpobject_r sizenditerlenitem) tensor_value total_bytesobjrrrserialized_byte_size+s  rcsBeZdZdZd ddZfddZddZd d Zd d ZZ S)rzException indicating non-Success status. Parameters ---------- msg : str A brief description of error status : str The error code debug_details : str The additional details on the error NcCs||_||_||_dS)N)_msg_status_debug_details)selfrstatus debug_detailsrrr__init__Ws z!InferenceServerException.__init__cs:|jdur tn|j}|jdurd|jd|}|S)N[z] )rsuper__str__r)rr __class__rrr#\s z InferenceServerException.__str__cC|jS)zGet the exception message. Returns ------- str The message associated with this exception, or None if no message. )rrrrrmessageb z InferenceServerException.messagecCr&)zGet the status of the exception. Returns ------- str Returns the status of the exception )rr'rrrrmr)zInferenceServerException.statuscCr&)zGet the detailed information about the exception for debugging purposes Returns ------- str Returns the exception details )rr'rrrrxs z&InferenceServerException.debug_details)NN) __name__ __module__ __qualname____doc__r r#r(rr __classcell__rrr$rrGs    rcCs|tkrdS|tjkr dS|tjkrdS|tjkrdS|tjkr"dS|tjkr)dS|tjkr0dS|tjkr7dS|tj kr>d S|tj krEd S|tj krLd S|tj krSd S|tj ks^|jtjkr`d SdS)NBOOLINT8INT16INT32INT64UINT8UINT16UINT32UINT64FP16FP32FP64BYTES)boolrint8int16int32int64uint8uint16uint32uint64float16float32float64rtypebytes_)np_dtyperrrnp_to_triton_dtypes6           rKcCs|dkrtS|dkr tjS|dkrtjS|dkrtjS|dkr"tjS|dkr)tjS|dkr0tjS|dkr7tjS|d kr>tj S|d krEtj S|d ksM|d krPtj S|d krWtj S|dkr^tj SdS)Nr/r0r1r2r3r4r5r6r7r8r9BF16r:r;)r<rr=r>r?r@rArBrCrDrErFrGrrrrrtriton_to_np_dtypes6rNcCs|jdkrtjdgtjdS|jtjkr|jjtjkrtdg}tj|dgddD]3}|jtjkrIt| t kr?| }nt |  d}n| }| tdt|| |q*d |}tj|tjd}|jd sxtj|tjd}|S) aj Serializes a bytes tensor into a flat numpy array of length prepended bytes. The numpy array should use dtype of np.object. For np.bytes, numpy will remove trailing zeros at the end of byte sequence and because of this it should be avoided. Parameters ---------- input_tensor : np.array The bytes tensor to serialize. Returns ------- serialized_bytes_tensor : np.array The 1-D numpy array of type uint8 containing the serialized bytes in row-major form. Raises ------ InferenceServerException If unable to serialize the given tensor. rrMz/cannot serialize bytes tensor: invalid datatyper r r zutf-8s >8 ,