o `۷i\@sUddlZddlZddlmZmZmZmZmZmZm Z m Z ddl Z ddl m Z iZeedfed<e dZe dZded ed efd d ZGd dde jjeeefZdS)N)AnyDictGenericListTupleTypeTypeVarUnion) DAGNodeBase _PyObjScanner _instances SourceTypeTransformedType instance_id node_indexreturncCst||S)zGet the node instance. Note: This function should be static and globally importable, otherwise the serialization overhead would be very significant. )r _replace_index)rrrL/home/ubuntu/vllm_env/lib/python3.10/site-packages/ray/dag/py_obj_scanner.py _get_nodesrcseZdZdZefdeeefffdd ZfddZ de de e fd d Z d ee efde fd d Zdede fddZddZddZZS)r aUtility to find and replace the `source_type` in Python objects. `source_type` can either be a single type or a tuple of multiple types. The caller must first call `find_nodes()`, then compute a replacement table and pass it to `replace_nodes`. This uses cloudpickle under the hood, so all sub-objects that are not `source_type` must be serializable. Args: source_type: the type(s) of object to find and replace. Default to DAGNodeBase. source_typecs@||_t|_d|_g|_d|_|tt|<t |jdSN) rioBytesIO_buf_found_objects_replace_tabler idsuper__init__)selfr __class__rrr (s  z_PyObjScanner.__init__cs>t||jrt|j}|j|tt||ffSt|S)zHook for reducing objects. Objects of `self.source_type` are saved to `self._found` and a global map so they can later be replaced. All other objects fall back to the default `CloudPickler` serialization. ) isinstancerlenrappendrrrreducer_override)r!objindexr"rrr'7s    z_PyObjScanner.reducer_overrider(rcCs.|jdus Jdg|_g|_|||jS)z Serialize `obj` and store all instances of `source_type` found in `_found`. Args: obj: The object to scan for `source_type`. Returns: A list of all instances of `source_type` found in `obj`. NzDfind_nodes cannot be called twice on the same PyObjScanner instance.)rrdump)r!r(rrr find_nodesFs  z_PyObjScanner.find_nodestablecCs0|jdus Jd||_|jdt|jS)z6Replace previously found DAGNodes per the given table.Nzfind_nodes must be called firstr)rrrseekpickleload)r!r,rrr replace_nodesWs  z_PyObjScanner.replace_nodesicCs|j|j|Sr)rr)r!r1rrrr^sz_PyObjScanner._replace_indexcCst|tvr tt|=dSdS)z%Clear the scanner from the _instancesN)rr r!rrrclearas z_PyObjScanner.clearcCs |dSr)r3r2rrr__del__fs z_PyObjScanner.__del__)__name__ __module__ __qualname____doc__r r rrr r'rrr r+rrr0intrr3r4 __classcell__rrr"rr s )rr.typingrrrrrrrr ray ray.dag.baser r r9__annotations__r rr cloudpickle CloudPicklerr rrrrs ( "