o `۷i@sUddlZddlZddlmZmZmZddlmZddlm Z zddl Z Wn e y0dZ Ynwzddl Z Wn e yBdZ Ynwe e ZGdddZiaeeeefdfed<Gd ddZd d ZdS) N)AnyDictTuple) cloudpickle)SERVE_LOGGER_NAMEc@s$eZdZdZdZdZdZdZdZdS)SerializationMethodz6Available serialization methods for RPC communication.rpicklemsgpackorjsonnoopN) __name__ __module__ __qualname____doc__ CLOUDPICKLEPICKLEMSGPACKORJSONNOOPrrV/home/ubuntu/vllm_env/lib/python3.10/site-packages/ray/serve/_private/serialization.pyrsr RPCSerializer_serializer_cachec@seZdZdZejejfdedefddZeejejfdededdfddZ d d Z d d Z d ede e e ffddZde e e ffddZde e e ffddZde e e ffddZde e e ffddZde defddZdede fddZde defddZdede fd d!Zd"S)#rzISerializer for RPC communication with configurable serialization methods.request_methodresponse_methodcCs(||_||_||dSN)lowerrr_validate_methods_setup_serializers)selfrrrrr__init__&s   zRPCSerializer.__init__returncCs6|}|}||f}|tvr|||t|<t|S)aGet a cached serializer instance to avoid per-request instantiation overhead. This method maintains a cache of serializer instances based on (request_method, response_method) pairs, significantly reducing overhead in high-throughput systems. )rr)clsrr req_method resp_method cache_keyrrrget_cached_serializer0s  z#RPCSerializer.get_cached_serializercCs\tjtjtjtjtjh}|j|vrtd|jd||j|vr,td|jd|dS)z6Validate that the serialization methods are supported.z*Unsupported request serialization method: z. Valid options: z+Unsupported response serialization method: N) rrrrrrr ValueErrorr)r valid_methodsrrrrFs&    zRPCSerializer._validate_methodscCs,||j\|_|_||j\|_|_dS)z@Setup the serialization functions based on the selected methods.N)_get_serializer_funcsr_request_dumps_request_loadsr_response_dumps_response_loads)rrrrr\s  z RPCSerializer._setup_serializersmethodcCsb|tjkr tjtjfS|tjkr|S|tjkr|S|tj kr&| S|tj kr/| SdS)z?Get dumps and loads functions for a given serialization method.N) rrrdumpsloadsr_get_pickle_funcsr_get_msgpack_funcsr_get_orjson_funcsr_get_noop_funcs)rr.rrrr)es      z#RPCSerializer._get_serializer_funcscC,dtdtfdd}dtdtfdd}||fS)z2Get no-op serialization functions for binary data.objr!cS$t|tstdt|jd|SNz%a bytes-like object is required, got z;. Use a different serialization method for non-binary data. isinstancebytes TypeErrortyper r6rrr _noop_dumpsu z2RPCSerializer._get_noop_funcs.._noop_dumpsdatacSr7r8r9rArrr _noop_loads}r@z2RPCSerializer._get_noop_funcs.._noop_loadsrr;)rr?rCrrrr4rszRPCSerializer._get_noop_funcscCr5)z9Get pickle serialization functions with highest protocol.r6r!cSstj|tjdS)N)protocol)rr/HIGHEST_PROTOCOLr>rrr _pickle_dumpssz6RPCSerializer._get_pickle_funcs.._pickle_dumpsrAcS t|Sr)rr0rBrrr _pickle_loads z6RPCSerializer._get_pickle_funcs.._pickle_loadsrD)rrGrIrrrr1szRPCSerializer._get_pickle_funcscC<tdurtddtdtfdd}dtdtfdd }||fS) z$Get msgpack serialization functions.NzKormsgpack is not installed. Please install it with `pip install ormsgpack`.r6r!cSrHr) ormsgpackpackbr>rrr_msgpack_dumpsrJz8RPCSerializer._get_msgpack_funcs.._msgpack_dumpsrAcSrHr)rLunpackbrBrrr_msgpack_loadsrJz8RPCSerializer._get_msgpack_funcs.._msgpack_loads)rL ImportErrorrr;)rrNrPrrrr2sz RPCSerializer._get_msgpack_funcscCrK) z#Get orjson serialization functions.NzEorjson is not installed. Please install it with `pip install orjson`.r6r!c Ss6zt|WSty}ztd|dd}~ww)Nzorjson serialization failed: zw. Only JSON-serializable types are supported with orjson. Consider using 'cloudpickle' or 'pickle' for complex objects.)r r/r<)r6errr _orjson_dumpss  z6RPCSerializer._get_orjson_funcs.._orjson_dumpsrAcSrHr)r r0rBrrr _orjson_loadsrJz6RPCSerializer._get_orjson_funcs.._orjson_loads)r rQrr;)rrSrTrrrr3s zRPCSerializer._get_orjson_funcsr6cC ||S)z$Serialize a request object to bytes.)r*rr6rrr dumps_request zRPCSerializer.dumps_requestrAcCrU)z&Deserialize bytes to a request object.)r+rrArrr loads_requestrXzRPCSerializer.loads_requestcCrU)z%Serialize a response object to bytes.)r,rVrrrdumps_responserXzRPCSerializer.dumps_responsecCrU)z'Deserialize bytes to a response object.)r-rYrrrloads_responserXzRPCSerializer.loads_responseN)r r rrrrstrr classmethodr&rrrrr)r4r1r2r3r;rWrZr[r\rrrrr#s<      cCs tdS)zOClear the cached serializer instances. Useful for testing or memory management.N)rclearrrrrclear_serializer_caches r`)loggingrtypingrrrrayrray.serve._private.constantsrr rQrL getLoggerloggerrrr]__annotations__rr`rrrrs*          *