o ci @sdZddlZddlmZddlmZmZmZmZddl Z ddl Z ddl m Z ddlmZeddZGdd d ZeGd d d Zd d ZddZe   ddedeededeedeeeeff ddZdeeeeffddZdS)z-A utility for debugging serialization issues.N)contextmanager)AnyOptionalSetTuple) DeveloperAPIccs(|jd7_dV|jd8_dS)N)level)printerr L/home/ubuntu/.local/lib/python3.10/site-packages/ray/util/check_serialize.py_indent sr c@s$eZdZddZddZddZdS)_PrintercCsd|_||_dS)Nr)r print_file)selfrr r r __init__s z_Printer.__init__cCst|SN)r rr r r indentsz_Printer.indentcCs d|j}t|||jddS)Nz )file)r printr)rmsgrr r r rs z_Printer.printN)__name__ __module__ __qualname__rrrr r r r rs rc@s.eZdZdZdededefddZddZd S) FailureTuplezRepresents the serialization 'frame'. Attributes: obj: The object that fails serialization. name: The variable name of the object. parent: The object that references the `obj`. objnameparentcCs||_||_||_dSr)rrr)rrrrr r r r+s zFailureTuple.__init__cCsd|jd|jd|jdS)Nz FailTuple(z [obj=z , parent=z]))rrrrr r r __repr__0szFailureTuple.__repr__N)rrr__doc__rstrrrr r r r r!s rc CsFt|sJt|}d}|jrR|dt|jd|)|jD]\}}t|||d|||d\} } |p=| }|rBnq'Wdn1sMwY|j r|dt|j d|)|j D]\}}t|||d|||d\} } |p| }|rnqkWdn1swY|s|d|d |S) AAdds the first-found non-serializable element to the failure_set.Fz Detected z. global variables. Checking serializability...rrdepthr failure_setr Nz0 nonlocal variables. Checking serializability...1WARNING: Did not find non-serializable object in . This may be an oversight.) inspect isfunctiongetclosurevarsglobalsrlenritems_inspect_serializability nonlocals) base_objr$rr%r closurefoundrr serializable_r r r _inspect_func_serialization4s`       r5c Cs.t|rJtj|tjd}d}|&|D]\}}t|||d|||d\} } |p.| }|r3nqWdn1s>wY|;t|} | D]+\}}|dr]|dsbt|rcqOt|||d|||d\} } |pu| }|rznqOWdn1swY|s|d|d|S) r") predicateFrr#N__r&r') r(r) getmembersrr. startswithendswith isbuiltinr) r0r$rr%r functionsr2rrr3r4membersr r r _inspect_generic_serializationgsV        r>r0rr$rreturncCst|}t|||dd|S)aIdentifies what objects are preventing serialization. Args: base_obj: Object to be serialized. name: Optional name of string. depth: Depth of the scope stack to walk through. Defaults to 3. print_file: file argument that will be passed to print(). Returns: bool: True if serializable. set[FailureTuple]: Set of unserializable objects. .. versionadded:: 1.1.0 N)rr.)r0rr$rr r r r inspect_serializabilitysrAc CsDtd}d}d}|dur>d}t}d|}|dtt|d|||dtt|d|dur=t|}n |d|d|d z t|d|fWSt y} z2|tj j d tj j d | d}z|d kr}| t|||Wn t yYnwWYd} ~ nd} ~ ww|d krd|fSt|rt|||||d n t|||||d |s| t||||r|dtt|d|s|dn&dtjjddd|Dtjjd} |d| d|d|dtt|d|d|d|dtt|d| |fS)NFTzChecking Serializability of =Pz Serializing 'z' z...z!!! FAILz serialization: r)r$rr%r zTNothing failed the inspect_serialization test, though serialization did not succeed.z  css|]}t|VqdSr)r!).0kr r r sz+_inspect_serializability..z z Variable: zowas found to be non-serializable. There may be multiple other undetected variables that were non-serializable. zConsider either removing the instantiation/imports of these variables or moving the instantiation into the scope of the function/class. zmCheck https://docs.ray.io/en/master/ray-core/objects/serialization.html#troubleshooting for more information.zIf you have any suggestions on how to improve this error message, please reach out to the Ray developers on github.com/ray-project/ray/issues/)coloramainitsetrminr,r!cpdumps ExceptionForeREDRESETaddrr(r)r5r>StyleBRIGHTjoin RESET_ALL) r0rr$rr%r top_level declarationr2e fail_varsr r r r.s           r.)Nr?N)r r( contextlibrtypingrrrrrayrIray.cloudpickle cloudpicklerMray.util.annotationsrr rrr5r>r!intboolrAr.r r r r sB     3+