o `۷i?@sLddlZddlZddlZddlmZddlmZmZddlZddl m m Z ddl m ZddlmZmZmZddlmZmZmZmZmZmZmZddlmZmZeeZ eGddde!Z"eGd d d e"Z#eGd d d e"Z$eGd dde"Z%eGddde"Z&eGddde"Z'eGddde"Z(eGddde(Z)eGddde(Z*eGddde"Z+eGddde"Z,eGddde"Z-eGdd d e"Z.eGd!d"d"e"Z/eGd#d$d$e"Z0eGd%d&d&e"Z1eGd'd(d(e"Z2eGd)d*d*e2Z3eGd+d,d,e"Z4eGd-d.d.e2e5Z6eGd/d0d0e2Z7eGd1d2d2e2Z8eGd3d4d4e2Z9eGd5d6d6e"e:Z;eGd7d8d8e"ZeGd=d>d>e"Z?eGd?d@d@e"Z@eGdAdBdBe"ZAeGdCdDdDe"ZBeGdEdFdFe"ZCeGdGdHdHe"ZDeGdIdJdJe"ZEedKdLGdMdNdNe+ZFedKdLGdOdPdPeFe:ZGedKdLGdQdRdRe+ZHedKdLGdSdTdTe+ZIedKdLGdUdVdVe"ZJeGdWdXdXeKe"ZLeGdYdZdZeKe"ZMee?e@eAe&eBe)eCe*eFeGeEeHeJeLeMe,gZNdS)[N)format_exception)OptionalUnion)ActorIDTaskIDWorkerID)PYTHONActorDiedErrorContextAddress ErrorTypeLanguage NodeDeathInfo RayException) DeveloperAPI PublicAPIc@s0eZdZdZddZeddZeddZdS) RayErrorz'Super class of all ray exception types.cCs6t|||jf}dt|}ttt||dS)N )languageserialized_exceptionformatted_exception_string) type __traceback__joinrrrpickledumpsSerializeToString)selfexc_inforrD/home/ubuntu/vllm_env/lib/python3.10/site-packages/ray/exceptions.pyto_bytesszRayError.to_bytescCst}||t|SN)rParseFromStringrfrom_ray_exception)b ray_exceptionrrr from_bytes(s  zRayError.from_bytescCsH|jtkr zt|jWStyt|dd}t|YSwt|S)Nrz(No formatted exception string available.) rrrloadsr ExceptiongetattrUnserializableExceptionCrossLanguageError)r%original_stacktracerrrr#.s    zRayError.from_ray_exceptionN)__name__ __module__ __qualname____doc__r staticmethodr&r#rrrrrs rc eZdZdZfddZZS)r+zRaised from another language.cs"tdt|j|jdS)NzAn exception raised from {}: {})super__init__formatr Namerr)rr% __class__rrr4Es  zCrossLanguageError.__init__)r-r.r/r0r4 __classcell__rrr7rr+Asr+c@s6eZdZdZ d deedeefddZddZdS) TaskCancelledErrorzRaised when this task is cancelled. Args: task_id: The TaskID of the function that was directly cancelled. Ntask_id error_messagecC||_||_dSr!)r;r<)rr;r<rrrr4Ws zTaskCancelledError.__init__cCs0d}|jrdt|jd}|jr||j7}|S)NzTask: z was cancelled. )r;strr<rmsgrrr__str__]s  zTaskCancelledError.__str__)NN) r-r.r/r0rrr?r4rBrrrrr:Ns r:c@sReZdZdZ     dddZdddZddd Zdd d Zd d ZddZ dS) RayTaskErroraIndicates that a task threw an exception during execution. If a task throws an exception during execution, a RayTaskError is stored in the object store for each of the task's outputs. When an object is retrieved from the object store, the Python method that retrieved it checks to see if the object is a RayTaskError and if it is then an exception is thrown propagating the error message. Nc Csddl} |r ||_n| j|_|pt|_|p| j|_ ||_ ||_ ||_ ||_ ||_zt|Wn9tjtfyn} z*|jjd|jj} d| d| d|} td| dt| |_WYd} ~ nd} ~ ww|||j|||f|_|dusJdS) zInitialize a RayTaskError.rN.z Exception z isn't serializable: z. Original exception details: z(The original cause of the RayTaskError (z) isn't serializable.)ray proctitle_raylet getproctitleosgetpidpidutilget_node_ip_addressip function_name traceback_str actor_repr _actor_idcauserr PicklingError TypeErrorr8r.r-logger exceptionrargs) rrOrPrSrFrKrNrQactor_idrEeerr_typeerr_msgrrrr4qs6   zRayTaskError.__init__returncCs&tjdkrt|jtr|S|S)zMakes a object instance that inherits from both RayTaskError and the type of `self.cause`. Raises TypeError if the cause class can't be subclassed) )sys version_info isinstancerSExceptionGroup,_make_exceptiongroup_dual_exception_instance$_make_normal_dual_exception_instancerrrrmake_dual_exception_instances z)RayTaskError.make_dual_exception_instancecL|jj}t|Gfdddt|d|jd}|_|_|jS)NcsNeZdZddZeddZejddZfddZdd Zfd d Z d S) z>RayTaskError._make_normal_dual_exception_instance..clscS||_|f|_dSr!rS_ray_task_error_argsrrSrrrr4s zGRayTaskError._make_normal_dual_exception_instance..cls.__init__cS|jSr!rkrfrrrrXzCRayTaskError._make_normal_dual_exception_instance..cls.argscS ||_dSr!rnrvaluerrrrX c |jfSr!rnrfclsrr __reduce__ zIRayTaskError._make_normal_dual_exception_instance..cls.__reduce__cS t|j|Sr!r)rSrnamerrr __getattr__ zJRayTaskError._make_normal_dual_exception_instance..cls.__getattr__cSr!rrf error_msgrrrBzFRayTaskError._make_normal_dual_exception_instance..cls.__str__N) r-r.r/r4propertyrXsetterrwr}rBrrvrrrrvs   rv RayTaskError()rSr8r?rCr-r/r cause_clsr|rrrres z1RayTaskError._make_normal_dual_exception_instancecrh)Ncs^eZdZfddZddZeddZejddZfdd Zd d Z fd d Z Z S)zFRayTaskError._make_exceptiongroup_dual_exception_instance..clscst||j|j}|Sr!)r3__new__message exceptions)rvrSrr7rrrszNRayTaskError._make_exceptiongroup_dual_exception_instance..cls.__new__cSrir!rjrlrrrr4s zORayTaskError._make_exceptiongroup_dual_exception_instance..cls.__init__cSrmr!rnrfrrrrXrozKRayTaskError._make_exceptiongroup_dual_exception_instance..cls.argscSrpr!rnrqrrrrXrscrtr!rnrfrurrrwrxzQRayTaskError._make_exceptiongroup_dual_exception_instance..cls.__reduce__cSryr!rzr{rrrr}r~zRRayTaskError._make_exceptiongroup_dual_exception_instance..cls.__getattr__crr!rrfrrrrBrzNRayTaskError._make_exceptiongroup_dual_exception_instance..cls.__str__) r-r.r/rr4rrXrrwr}rBr9rrr7rrvs    rvrrrrrrrrds z9RayTaskError._make_exceptiongroup_dual_exception_instancec Cs|jj}tt|r |Sz|WSty2}ztdt|jd||WYd}~Sd}~wt yS}ztdt|jd||WYd}~Sd}~ww)a;Returns an exception that's an instance of the cause's class. The returned exception inherits from both RayTaskError and the cause class and contains all of the attributes of the cause exception. If the cause class can't be subclassed, issues a warning and returns `self`. zUser exception type z in RayTaskError can't be subclassed! This exception is raised as RayTaskError only. You can use `ray_task_error.cause` to access the user exception. Failure in subclassing: Nz8Failed to combine RayTaskError with user exception type z; raising RayTaskError only. This can happen when the user exception overrides attributes like `args` or otherwise blocks subclass construction. Failure in subclassing: ) rSr8 issubclassrCrgrUrVwarningrr()rrrZrrras_instanceof_causes0  z RayTaskError.as_instanceof_causec Cs|jd}g}d}t|D]x\}}|drLtjj|jdtjj d|j d|j }|j r@|d|j d|j d 7}n|d 7}d}||q|d r~d |vsad |vsad |vsad|vr~d|vrj|d|dt|kr}||ddr}d}q|rd}q||qd|S)z"Format a RayTaskError as a string.rFz Traceback z()z (pid=z, ip=z , actor_id=z, repr=rz File z ray/worker.pyz ray/_private/zray/util/tracing/zray/_raylet.pyxz&ray._raylet.raise_if_dependency_failedzJ At least one of the input arguments for this task could not be computed:z T)rPstripsplit enumerate startswithcoloramaForeCYANrFRESETrKrNrQrRappendlenr)rlinesoutcode_from_internal_fileilinetraceback_linerrrrBsL   "  zRayTaskError.__str__)NNNNN)r]rC) r-r.r/r0r4rgrerdrrBrrrrrCfs 0  "$ !rCc@eZdZdZddZdS)LocalRayletDiedErrorz,Indicates that the task's local raylet died.cCdS)NzDThe task's local raylet died. Check raylet.out for more information.rrfrrrrB\rzLocalRayletDiedError.__str__Nr-r.r/r0rBrrrrrX rc@r)WorkerCrashedErrorzCIndicates that the worker died unexpectedly while executing a task.cCs dS)NzrThe worker died unexpectedly while executing this task. Check python-core-worker-*.log files for more information.rrfrrrrBdszWorkerCrashedError.__str__Nrrrrrr`rrc @sjeZdZdZdZdeddfdedededefd d Zd efd d Ze d efddZ e d efddZ dS) RayActorErroraIndicates that the actor has outages unexpectedly before finishing a task. This exception could happen because the actor process is dead, or is unavailable for the moment. Ray raises subclasses `ActorDiedError` and `ActorUnavailableError` respectively. z:The actor experienced an error before finishing this task.NFrYractor_init_failed preemptedcCs||_||_||_||_dSr!)rYr_actor_init_failed _preempted)rrYrrrrrrr4vs zRayActorError.__init__r]cCrmr!rrfrrrrBzRayActorError.__str__cCrmr!)rrfrrrrrozRayActorError.preemptedcCrmr!)rrfrrrrrozRayActorError.actor_init_failed) r-r.r/r0BASE_ERROR_MSGr?boolr4rBrrrrrrrrks* rcsLeZdZdZdZ d deeeefffdd Z e defdd Z Z S) ActorDiedErroraiIndicates that the actor died unexpectedly before finishing a task. This exception could happen either because the actor process dies while executing a task, or because a task is submitted to a dead actor. Args: cause: The cause of the actor error. `RayTaskError` type means the actor has died because of an exception within `__init__`. `ActorDiedErrorContext` means the actor has died because of an unexpected system error. None means the cause isn't known. Theoretically, this shouldn't happen, but it's there as a safety check. z7The actor died unexpectedly before finishing this task.NrScsPd}tj}d}d}|s nt|trd}|j}d|}nt|ts%Jtjg}|d|j|dt |j  |j dkrM|d|j |j d kr[|d |j |jd kri|d |j|jd krw|d |j||j|jr|d |jr|jjtjkrd}d|}t |j  }t||||dS)zF Construct a RayActorError by building the arguments. NFTz@The actor died because of an error raised in its creation task, z class_name: z actor_id: rz pid: r>z name: z namespace: z ip: zAThe actor never ran - it was cancelled before it started running.r)rrrbrCrRrBr r class_namerrYhexrKr| ray_namespacenode_ip_addressr< never_startednode_death_inforeasonr AUTOSCALER_DRAIN_PREEMPTEDrr3r4)rrSrYrrrerror_msg_linesr7rrr4sN       zActorDiedError.__init__ task_errorcCst|Sr!)r)rrrrfrom_task_errorszActorDiedError.from_task_errorr!) r-r.r/r0rrrrCr r4r1rr9rrr7rrs5rcs.eZdZdZdedeeffdd ZZS)ActorUnavailableErrorzLRaised when the actor is temporarily unavailable but may be available later.r<rYcsH|dur t|nd}d|d|d}d}d}t||||dS)Nz The actor z is unavailable: z:. The task may or may not have been executed on the actor.F)rrr3r4)rr<rYrrrr7rrr4s zActorUnavailableError.__init__) r-r.r/r0r?rbytesr4r9rrr7rrs"rc@"eZdZdZdddZddZdS)RaySystemErrorzpIndicates that Ray encountered a system error. This exception can be thrown when the raylet is killed. NcCr=r! client_excrP)rrrPrrrr4 zRaySystemError.__init__cCs&d|j}|jr|d|j7}|S)NzSystem error: z traceback: r)rrrrrrBs zRaySystemError.__str__r!r-r.r/r0r4rBrrrrrs  rcs4eZdZdZdeffdd ZdefddZZS)AuthenticationErroraIndicates that an authentication error occurred. Most commonly, this is caused by a missing or mismatching token set on the client (e.g., a Ray CLI command interacting with a remote cluster). Only applicable when `RAY_AUTH_MODE` is not set to `disabled`. rcs||_d|_t|dS)NT)r__suppress_context__r3r4rrr7rrr4 szAuthenticationError.__init__r]cCsZd}ddlm}ddlm}m}|}||jkr"||}d|d}d}|jd||S) Nr>r)get_authentication_mode_name)AuthenticationModeget_authentication_modez# Note: RAY_AUTH_MODE is currently 'z' (not 'token').a Ensure that the token for the cluster is available in a local file (e.g., ~/.ray/auth_token or via RAY_AUTH_TOKEN_PATH) or as the `RAY_AUTH_TOKEN` environment variable. To generate a token for local development, use `ray get-auth-token --generate` For remote clusters, ensure that the token is propagated to all nodes of the cluster when token authentication is enabled. For more information, see: https://docs.ray.io/en/latest/ray-security/token-auth.htmlrD)0ray._private.authentication.authentication_utilsr ray._rayletrrTOKENr)rauth_mode_noterrr current_mode mode_name help_textrrrrBs   zAuthenticationError.__str__r-r.r/r0r?r4rBr9rrr7rrsrc@eZdZdZdS)UserCodeExceptiona Indicates that an exception occurred while executing user code. For example, this exception can be used to wrap user code exceptions from a remote task or actor. The `retry_exceptions` parameter will still respect the underlying cause of this exception.Nr-r.r/r0rrrrr+srcr2)ObjectStoreFullErrorzIndicates that the object store is full. This is raised if the attempt to store the object fails because the object store is full even after multiple retries. ctt|dS)Nz The local object store is full of objects that are still in scope and cannot be evicted. Tip: Use the `ray memory` command to list active objects in the cluster.)r3rrBrfr7rrrB=s zObjectStoreFullError.__str__r-r.r/r0rBr9rrr7rr5rcr2)OutOfDiskErrorzIndicates that the local disk is full. This is raised if the attempt to store the object fails because both the object store and disk are full. cr)Nz The object cannot be created because the local object store is full and the local disk's utilization is over capacity (95% by default).Tip: Use `df` on this node to check disk usage and `ray memory` to check object store memory usage.)r3rrBrfr7rrrBNs zOutOfDiskError.__str__rrrr7rrFrrc@ eZdZdZddZddZdS)OutOfMemoryErrorzIndicates that the node is running out of memory and is close to full. This is raised if the node is low on memory and tasks or actors are being evicted to free up memory. cCrpr!rrrrrr4crxzOutOfMemoryError.__init__cCrmr!rrfrrrrBfrzOutOfMemoryError.__str__NrrrrrrZs rc@r) NodeDiedErrorz6Indicates that the node is either dead or unreachable.cCrpr!rrrrrr4orxzNodeDiedError.__init__cCrmr!rrfrrrrBrrzNodeDiedError.__str__Nrrrrrrjs rc@s(eZdZdZddZddZddZdS) ObjectLostErrorzIndicates that the object is lost from distributed memory, due to node failure or system error. Args: object_ref_hex: Hex ID of the object. cCs ||_||_|tjd|_dS)Nz )object_ref_hex owner_addressreplace ray_constantsCALL_STACK_LINE_DELIMITER call_site)rrrrrrrr4s  zObjectLostError.__init__cCs4d|jd}|jr|d|j7}|S|d7}|S)NzFailed to retrieve object z. zThe ObjectRef was created at: zTo see information about where this ObjectRef was created in Python, set the environment variable RAY_record_ref_creation_sites=1 during `ray start` and `ray.init()`.)rrr@rrr _base_strszObjectLostError._base_strcC|dd|jdS)N zAll copies of z have been lost due to node failure. Check cluster logs (`/tmp/ray/session_latest/logs`) for more information about the failure.rrrfrrrrB  zObjectLostError.__str__N)r-r.r/r0r4rrBrrrrrvs  rc@r)ObjectFetchTimedOutErrorzgIndicates that an object fetch timed out. Args: object_ref_hex: Hex ID of the object. cCr)NrzFetch for object z` timed out because no locations were found for the object. This may indicate a system-level bug.rrfrrrrBrz ObjectFetchTimedOutError.__str__Nrrrrrr rc@r)RpcErrorz0Indicates an error in the underlying RPC system.NcCr=r!)rrpc_code)rrrrrrr4rzRpcError.__init__cCrmr!rrfrrrrBrzRpcError.__str__r!rrrrrrs  rc@r)ReferenceCountingAssertionErrorzIndicates that an object has been deleted while there was still a reference to it. Args: object_ref_hex: Hex ID of the object. cC|ddS)Nrz_The object has already been deleted by the reference counting protocol. This should not happen.rrfrrrrB z'ReferenceCountingAssertionError.__str__Nrrrrrr rc@r)ObjectFreedErrorzIndicates that an object was manually freed by the application. Attributes: object_ref_hex: Hex ID of the object. cCr)NrzThe object was manually freed using the internal `free` call. Please ensure that `free` is only called once the object is no longer needed.rrfrrrrBrzObjectFreedError.__str__Nrrrrrrrrc@r)OwnerDiedErrorzIndicates that the owner of the object has died while there is still a reference to the object. Args: object_ref_hex: Hex ID of the object. cCspd}|jr,zt}||j|j}t|j}d|d|}Wn ty+Ynw|dd|dS)Nz`/tmp/ray/session_latest/logs`z`/tmp/ray/session_latest/logs/*z*` at IP address rzThe object's owner has exited. This is the Python worker that first created the ObjectRef via `.remote()` or `ray.put()`. Check cluster logs (z7) for more information about the Python worker failure.) rr r" ip_addressr worker_idrr(r)rlog_locaddrip_addrrrrrrBs,    zOwnerDiedError.__str__NrrrrrrrrcseZdZdZejdejdejdejdej dej dej dej d ej d i Z dd edddedeedef fdd ZddZZS)ObjectReconstructionFailedErrorz2Indicates that the object cannot be reconstructed.zThe object cannot be reconstructed because the maximum number of task retries has been exceeded. Consider increasing the number of retries using `@ray.remote(max_retries=N)`.zThe object cannot be reconstructed because its lineage has been evicted to reduce memory pressure. To prevent this error, set the environment variable RAY_max_lineage_bytes= (default 1GB) during `ray start`.zThe object cannot be reconstructed because it was created by ray.put(), which has no task lineage. To prevent this error, return the value from a task instead.zThe object cannot be reconstructed because the task was created with max_retries=0. Consider enabling retries using `@ray.remote(max_retries=N)`.zThe object cannot be reconstructed because it crossed an ownership boundary. Only the owner of an object can trigger reconstruction, but this worker borrowed the object from another worker.z{The object cannot be reconstructed because Ray is running in local mode. Local mode does not support object reconstruction.zThe object cannot be reconstructed because its reference was not found in the reference counter. Please file an issue at https://github.com/ray-project/ray/issues.zXThe object cannot be reconstructed because the task that would produce it was cancelled.zThe object cannot be reconstructed because lineage reconstruction is disabled system-wide (object_reconstruction_enabled=False).Nr>rrr reason_messagerrcs0t|||||_|p|j|jd|_dS)aInitialize ObjectReconstructionFailedError. Args: object_ref_hex: Hex string of the object reference. reason: ErrorType enum value indicating why reconstruction failed. reason_message: Human-readable explanation of the failure. owner_address: Address of the object's owner. call_site: Call site where the object was created. zpUnknown error reason. This should not happen, please file an issue at https://github.com/ray-project/ray/issues.N)r3r4rREASON_MESSAGESgetr)rrrrrrr7rrr4@s   z(ObjectReconstructionFailedError.__init__cCs>|}|jr|jrt|jnd}|d|d|jS|S)NUNKNOWNz [z] )rrrr r6)rbase reason_namerrrrBYs z'ObjectReconstructionFailedError.__str__)NNNr>)r-r.r/r0r .OBJECT_UNRECONSTRUCTABLE_MAX_ATTEMPTS_EXCEEDED(OBJECT_UNRECONSTRUCTABLE_LINEAGE_EVICTEDOBJECT_UNRECONSTRUCTABLE_PUT)OBJECT_UNRECONSTRUCTABLE_RETRIES_DISABLED!OBJECT_UNRECONSTRUCTABLE_BORROWED#OBJECT_UNRECONSTRUCTABLE_LOCAL_MODE&OBJECT_UNRECONSTRUCTABLE_REF_NOT_FOUND'OBJECT_UNRECONSTRUCTABLE_TASK_CANCELLED)OBJECT_UNRECONSTRUCTABLE_LINEAGE_DISABLEDrr?rr r4rBr9rrr7rrsJ1rc@r)GetTimeoutErrorz.Indicates that a call to the worker timed out.Nrrrrrr ar c@r)PlasmaObjectNotAvailablezACalled when an object was not available within the given timeout.Nrrrrrr hr r c@r)AsyncioActorExitzBRaised when an asyncio actor intentionally exits via exit_actor().Nrrrrrr or r c@s(eZdZdZddefddZddZdS) RuntimeEnvSetupErrorzRaised when a runtime environment fails to be set up. Args: error_message: The error message that explains why runtime env setup has failed. Nr<cCrpr!r<rr<rrrr4rxzRuntimeEnvSetupError.__init__cCs"dg}|jr ||jd|S)Nz%Failed to set up runtime environment.r)r<rr)rmsgsrrrrBs  zRuntimeEnvSetupError.__str__r!r-r.r/r0r?r4rBrrrrrvs rc@r)TaskPlacementGroupRemoved:Raised when the corresponding placement group was removed.cCr)Nz@The placement group corresponding to this task has been removed.rrfrrrrBrz!TaskPlacementGroupRemoved.__str__Nrrrrrrrrc@r)ActorPlacementGroupRemovedrcCr)NzAThe placement group corresponding to this Actor has been removed.rrfrrrrBrz"ActorPlacementGroupRemoved.__str__Nrrrrrrrrc@r)PendingCallsLimitExceededzRaised when the pending actor calls exceeds `max_pending_calls` option. This exception could happen probably because the caller calls the callee too frequently. Nrrrrrrsrc@&eZdZdZdefddZddZdS)TaskUnschedulableErrorzRaised when the task cannot be scheduled. One example is that the node specified through NodeAffinitySchedulingStrategy is dead. r<cCrpr!rrrrrr4rxzTaskUnschedulableError.__init__cC d|jS)NzThe task is not schedulable: rrfrrrrBr~zTaskUnschedulableError.__str__Nrrrrrr rc@r)ActorUnschedulableErrorzRaised when the actor cannot be scheduled. One example is that the node specified through NodeAffinitySchedulingStrategy is dead. r<cCrpr!rrrrrr4rxz ActorUnschedulableError.__init__cCr)NzThe actor is not schedulable: rrfrrrrBr~zActorUnschedulableError.__str__Nrrrrrrrrc@r)ObjectRefStreamEndOfStreamErrorzWRaised by streaming generator tasks when there are no more ObjectRefs to read. Nrrrrrrrc@r)(OufOfBandObjectRefSerializationExceptionznRaised when an `ray.ObjectRef` is out of band serialized by `ray.cloudpickle`. It is an anti pattern. Nrrrrrrrralpha) stabilityc@r)RayChannelErrorz[Indicates that Ray encountered a system error related to ray.experimental.channel. Nrrrrrr!rr!c@r)RayChannelTimeoutErrorz;Raised when the Compiled Graph channel operation times out.Nrrrrrr"r r"c@r)RayCgraphCapacityExceededzBRaised when the Compiled Graph channel's buffer is at max capacityNrrrrrr#r r#c@r)RayDirectTransportErrorzERaised when there is an error during a Ray direct transport transfer.Nrrrrrr$r r$c@r)r*aRaised when there is an error deserializing a serialized exception. This occurs when deserializing (unpickling) a previously serialized exception fails. In this case, we fall back to raising the string representation of the original exception along with its stack trace that was captured at the time of serialization. For more details and how to handle this with custom serializers, :ref:`configuring custom exception serializers ` Args: original_stack_trace: The string representation and stack trace of the original exception that was captured during serialization. original_stack_tracecCrpr!_original_stack_trace)rr%rrrr4rxz UnserializableException.__init__cCr)NzFailed to deserialize exception. Refer to https://docs.ray.io/en/latest/ray-core/objects/serialization.html#custom-serializers-for-exceptions for more information. Original exception: r&rfrrrrBszUnserializableException.__str__Nrrrrrr*s r*c.eZdZdZdeffdd ZddZZS)ActorAlreadyExistsErrora%Raised when a named actor already exists. Note that this error is not only a subclass of RayError, but also a subclass of ValueError, to maintain backward compatibility. Args: error_message: The error message that contains information about the actor name and namespace. r<ct|||_dSr!r3r4r<rr7rrr4  z ActorAlreadyExistsError.__init__cCrmr!rrfrrrrBrzActorAlreadyExistsError.__str__rrrr7rr) sr)cr()ActorHandleNotFoundErroraRaised when trying to kill an actor handle that doesn't exist. This typically happens when using an actor handle from a previous Ray session after calling ray.shutdown() and ray.init(). Note that this error is not only a subclass of RayError, but also a subclass of ValueError, to maintain backward compatibility. Args: error_message: The error message that contains information about the actor handle. r<cr*r!r+rr7rrr4-r,z!ActorHandleNotFoundError.__init__cCrmr!rrfrrrrB1rz ActorHandleNotFoundError.__str__rrrr7rr-s r-)OloggingrIr` tracebackrtypingrrrray._private.ray_constants_privaterray.cloudpickle cloudpicklerrrrrray.core.generated.common_pb2rr r r r r rray.util.annotationsrr getLoggerr-rVr(rr+r:rCrrrrrrrrrrrrrrrAssertionErrorrrrr TimeoutErrorr r r rrrrrrrrr!r"r#r$r* ValueErrorr)r-RAY_EXCEPTION_TYPESrrrrs  $ & r &K*  ( &R