o ci@stddlZddlmZmZmZmZmZddlmZm Z m Z ddl m Z ddl mZee ZdZdZGdd d ZdS) N)CallableDictListOptionalTuple)ApplicationName DeploymentID EndpointInfo)SERVE_LOGGER_NAME)DeploymentHandlez!Route table is not populated yet.zNo replicas are available yet.c@seZdZdZdeeegeffddZdede eeffddZ d e e e ffd d Zd edee eeeffd dZdedee eeeffddZdS) ProxyRouterz&Router interface for the proxy to use. get_handlecCs8||_t|_d|_t|_t|_t|_t|_dS)NF) _get_handledicthandles_route_table_populatedlist sorted_routes route_infoapp_to_is_cross_language endpoints)selfr rS/home/ubuntu/.local/lib/python3.10/site-packages/ray/serve/_private/proxy_router.py__init__s zProxyRouter.__init__is_headreturncCs<|jsdtfS|r dS|jD] }|rdSqdtfS)aWhether the proxy router is ready to serve traffic. The first return value will be false if any of the following hold: - The route table has not been populated yet with a non-empty set of routes - The route table has been populated, but none of the handles have received running replicas yet AND it lives on a worker node. Otherwise, the first return value will be true. F)T)rNO_ROUTES_MESSAGErvaluesrunning_replicas_populatedNO_REPLICAS_MESSAGE)rrhandlerrrready_for_traffic)s zProxyRouter.ready_for_trafficrcCstjd|dddid|rd|_||_t|j}g}i}i}|D])\}}||j |||j <|j ||j <||jvrF| |q&| |||j|<q&t|dkretjdt|ddd id|D]}|j|=qgt|d d dd |_||_||_dS) NzGot updated endpoints: . log_to_stderrT)extrarz Deleting z unused handles.FcSst|S)N)len)xrrrgsz+ProxyRouter.update_routes..)keyreverse)loggerinforrsetrkeysitemsappendrouteapp_is_cross_languageapp_nameremoverr'sortedrrr)rrexisting_handlesroutesrrendpointr-rrr update_routesFs6        zProxyRouter.update_routes target_routecCs||jD]8}||r;d}|drd}nt|t|ks$|t|dkr&d}|r;|j|}||j||j|jfSqdS)zReturn the longest prefix match among existing routes for the route. Args: target_route: route to match against. Returns: (route, handle, is_cross_language) if found, else None. F/TN)r startswithendswithr'rrrr4)rr;r2matchedr9rrr match_routeks     zProxyRouter.match_routetarget_app_namecCsL|jD]\}}||jkst|jdkr#|j|}|j||jfSqdS)a2Return the handle that matches with endpoint. Args: target_app_name: app_name to match against. Returns: (route, handle, is_cross_language) for the single app if there is only one, else find the app and handle for exact match. Else return None. N)rr0r4r'rr2r3)rrA endpoint_tagr" endpoint_inforrrget_handle_for_endpoints  z#ProxyRouter.get_handle_for_endpointN)__name__ __module__ __qualname____doc__rstrr rboolrr#rrr r:rr@rErrrrr s" % $r )loggingtypingrrrrrray.serve._private.commonrrr ray.serve._private.constantsr ray.serve.handler getLoggerr,rr!r rrrrs