o `۷i @sddlZddlmZddlmZddlmZmZmZm Z m Z m Z m Z m Z ddlmZddlmZddlmZmZddlmZdd lmZeeZe d Ze d ZGd d d ee eefZeddGdddZdede defddZ!dddddddede de e de e eefde ee efde eee gefde"defd d!Z#dd"dede d#eee fd$eeefde ee efdeee gefde efd%d&Z$d'ede ee efdefd(d)Z%ded#eee fde fd*d+Z&dS),N)deepcopy) dataclass)AnyCallableDictGenericListOptionalTypeVarUnion) _PyObjScanner)SERVE_LOGGER_NAME) Application Deployment)DeploymentHandle) LoggingConfigKVcsdeZdZdZdedeffdd Zdedeffdd Zdeffd d Zde ffd d Z Z S) IDDictzDictionary that uses id() for keys instead of hash(). This is necessary because Application objects aren't hashable and we want each instance to map to a unique key. keyreturnct|ts t|}t|SN) isinstanceintidsuper __getitem__selfr __class__R/home/ubuntu/vllm_env/lib/python3.10/site-packages/ray/serve/_private/build_app.pyr  zIDDict.__getitem__valuecs t|ts t|}t||Sr)rrrr __setitem__)rrr%r r"r#r&s zIDDict.__setitem__crr)rrrr __delitem__rr r"r#r'#r$zIDDict.__delitem__crr)rrrr __contains__rr r"r#r((r$zIDDict.__contains__) __name__ __module__ __qualname____doc__rrrr&r'objectr( __classcell__r"r"r r#rs rT)frozenc@sZeZdZUeed<eeed<eeed<eed<eeed<e ee fed<e ed<dS) BuiltApplicationname route_prefixlogging_configingress_deployment_name deploymentsdeployment_handlesexternal_scaler_enabledN) r)r*r+str__annotations__r rrrrrboolr"r"r"r#r0.s     r0 deploymentapp_namercCst|j|dS)N)r<)rr1)r;r<r"r"r#_make_deployment_handle_default?sr=F)r2r3default_runtime_envmake_deployment_handler7appr1r2r3r>r?r7c sX|durt}t}tt|||||d}t|||||fdd|D|dS)aBuilds the application into a list of finalized deployments. The following transformations are made: - Application objects in constructor args/kwargs are converted to DeploymentHandles for injection at runtime. - Name conflicts from deployments that use the same class are handled by appending a monotonically increasing suffix (e.g., SomeClass_1). Returns: BuiltApplication N)r<handlesdeployment_namesr>r?csi|] \}}||qSr"r").0r@handlerBr"r# qszbuild_app..)r1r2r3r4r5r6r7)r=r_build_app_recursiver0items) r@r1r2r3r>r?r7rAr5r"rEr# build_appHs. rI)r>rBrAc Cs||vrgSg}ttd}zF||jj|jjf}|D]} |t| |||||dq||\} } |jj t ||| | d} t | |} || |||<|| gW| S| w)aNRecursively traverses the graph of Application objects. Each Application will have an associated DeploymentHandle created that will replace it in any occurrences in other Applications' args or kwargs. Also collects a list of the unique Applications encountered and returns them as deployable Deployment objects. ) source_type)r<rArBr?r>)r1 _init_args _init_kwargs) r r find_nodes_bound_deployment init_args init_kwargsextendrG replace_nodesoptions$_get_unique_deployment_name_memoized_set_default_runtime_envclear) r@r<rBrAr>r?r5scanner child_apps child_app new_init_argsnew_init_kwargsfinal_deploymentr"r"r#rGxsD   rGdcCsX|s|St|jp i}|dd}d|vr||d<n |dur&|dd||j|dS)ahConfigures the deployment with the provided default runtime_env. If the deployment does not have a runtime_env configured, the default will be set. If it does have a runtime_env configured but that runtime_env does not have a working_dir, only the working_dir field will be set. Else the deployment's runtime_env will be left untouched. working_dirN runtime_env)ray_actor_options)rr`get setdefaultrS)r]r>r`default_working_dirr"r"r#rUs    rUcCs~||vr||Sd}|jj}||vr'|jjd|}|d7}||vs|dkr9td|jjd|d|||<|S)aGenerates a name for the deployment. This is used to handle collisions when the user does not specify a name explicitly, so typically we'd use the class name as the default. In that case, we append a monotonically increasing suffix to the name, e.g., Deployment, then Deployment_1, then Deployment_2, ... Names are memoized in the `deployment_names` dict, which should be passed to subsequent calls to this function. _z3There are multiple deployments with the same name 'z'. Renaming one to 'z'.)rNr1valuesloggerwarning)r@rBidxr1r"r"r#rTs$  rT)'loggingcopyr dataclassesrtypingrrrrrr r r ray.dag.py_obj_scannerr ray.serve._private.constantsr ray.serve.deploymentrrray.serve.handlerray.serve.schemar getLoggerrgrrdictrr0r8r=r:rIrGrUrTr"r"r"r#s  (         6   A