o `۷i @sddlmZddlZddlmZddlmZddlmZeddGdd d e Z eddGd d d e Z ed dGd dde Z ed dGddde eZ ed dGddde ZdS))OptionalN)TaskCancelledError) DeploymentID) PublicAPIstable) stabilityc@s eZdZdS)RayServeExceptionN)__name__ __module__ __qualname__r r J/home/ubuntu/vllm_env/lib/python3.10/site-packages/ray/serve/exceptions.pyr srcseZdZdZ  ddedeejdeeffdd Z e defd d Z e deejfd d Z e deefd dZ defddZZS)gRPCStatusErroraInternal exception that wraps an exception with user-set gRPC status code. This is used to preserve user-set gRPC status codes when exceptions are raised in deployments. When a user sets a status code on the gRPC context before raising an exception, this wrapper carries that status code through the error handling path so the proxy can return the user's intended status code instead of INTERNAL. Noriginal_exceptioncodedetailscs&||_||_||_tt|dSN)_original_exception _grpc_code _grpc_detailssuper__init__str)selfrrr __class__r r rszgRPCStatusError.__init__returncC|jS)z'The original exception that was raised.)rrr r r r&z"gRPCStatusError.original_exceptioncCr)z&The user-set gRPC status code, if any.)rrr r r grpc_code+rzgRPCStatusError.grpc_codecCr)z)The user-set gRPC status details, if any.)rrr r r grpc_details0rzgRPCStatusError.grpc_detailscCs t|jSr)rrrr r r __str__5 zgRPCStatusError.__str__)NN)r r r __doc__ BaseExceptionrgrpc StatusCoderrpropertyrr r!r" __classcell__r r rr rs$  ralphacsJeZdZdZdedeffdd ZdefddZedefd d Z Z S) BackPressureErrorzBRaised when max_queued_requests is exceeded on a DeploymentHandle.num_queued_requestsmax_queued_requestscs&t||d|d|d|_dS)Nz9Request dropped due to backpressure (num_queued_requests=z, max_queued_requests=z).)rr_message)rr,r-rr r r=szBackPressureError.__init__rcCrrr.rr r r r"EszBackPressureError.__str__cCrrr/rr r r messageHszBackPressureError.message) r r r r$intrrr"r(r0r)r r rr r+9s r+c@s,eZdZdZddeefddZddZdS) RequestCancelledErrorz(Raise when a Serve request is cancelled.N request_idcC ||_dSr _request_id)rr3r r r rQr#zRequestCancelledError.__init__cCs|jr d|jdSdS)NzRequest z was cancelled.zRequest was cancelled.r5rr r r r"TszRequestCancelledError.__str__r)r r r r$rrrr"r r r r r2Ms r2c@s0eZdZdZdefddZedefddZdS) DeploymentUnavailableErrorzRaised when a Serve deployment is unavailable to receive requests. Currently this happens because the deployment failed to deploy. deployment_idcCr4r_deployment_id)rr8r r r rbr#z#DeploymentUnavailableError.__init__rcCs |jdS)Nz, is unavailable because it failed to deploy.r9rr r r r0es z"DeploymentUnavailableError.messageN) r r r r$rrr(rr0r r r r r7[s r7)typingrr&ray.exceptionsrray.serve._private.commonrray.util.annotationsr Exceptionrrr+r2r7r r r r s    )