o bi2' @s ddlZddlZddlZddlZddlZddlZddlmZddlmZm Z m Z m Z m Z m Z mZddlmZddlmZddlmZmZmZmZddlmZmZmZddlmZzddlZdd lm Z m!Z!Wne"yudZdZ dZ!Ynwe#e$Z%d Z&d Z'd ed e e(fddZ)de e(efd e e(effddZ*de(d e(fddZ+de(d e e e e(fddZ,de ded eee!ffddZ-  d'd ede e(de e.d e e e(efe e(efffdd Z/d ed!ede(d e efd"d#Z0d ed!ed$e e(d e e(effd%d&Z1dS)(N) dataclass)Any AsyncIteratorDictListOptionalTupleUnion) ray_constants) GcsClient)JOB_ID_METADATA_KEYJobInfoStorageClient JobStatusvalidate_request_type) DriverInfo JobDetailsJobType) RuntimeEnv)RequestResponse i N gcs_clientreturncs0|jtjtjddIdH}|durdS|S)z%Fetches Head node id persisted in GCS) namespacetimeoutN)async_internal_kv_getr KV_HEAD_NODE_ID_KEYKV_NAMESPACE_JOBdecode)rhead_node_id_hex_bytesr!S/home/ubuntu/.local/lib/python3.10/site-packages/ray/dashboard/modules/job/utils.pyget_head_node_id%s r#dcCsdd|DS)z-Strip keys with value None from a dictionary.cSsi|] \}}|dur||qSNr!).0kvr!r!r" 3z.strip_keys_with_value_none..)items)r$r!r!r"strip_keys_with_value_none1sr,urlcCs4td|}t|dkr|d|ddd}|S)zRedact any passwords in a URL.zhttps?:\/\/.*:(.*)@.*r:@z :@)refindalllenreplace)r-secretr!r!r"redact_url_password6s  r5pathcCst|tstdt|dtj|s(td|ddVtj|rd}t |d<}g}d}d} t |d ksE|t ksE||krN|pHdVg}d}| }||krb| ||t |7}ntd IdHq71snwYdS) awYield lines from a file as it's written. Returns lines in batches of up to 10 lines or 20000 characters, whichever comes first. If it's a chunk of 20000 characters, then the last line that is yielded could be an incomplete line. New line characters are kept in the line string. Returns None until the file exists or if no new line has been written. zpath must be a string, got .zPath z doesn't exist yet.NrrTr) isinstancestr TypeErrortypeosr6existsloggerdebugopenr2MAX_CHUNK_CHAR_LENGTHreadlineappendasynciosleep)r6EOFflineschunk_char_count curr_liner!r!r"file_tail_iterator?s4       rNreq request_typec stddl}t|IdH}zt||WSty9}ztd|tt |j j j dWYd}~Sd}~ww)aParse request and cast to request type. Remove keys with value None to allow newer client versions with new optional fields to work with older servers. If parsing failed, return a Response object with status 400 and stacktrace instead. Args: req: aiohttp request object. request_type: dataclass type to cast request to. Returns: Parsed request object or Response object with status 400 and stacktrace. rNzGot invalid request type: )textstatus) aiohttpr,jsonr ExceptionrAinfor traceback format_excwebHTTPBadRequest status_code)rOrPrS json_dataer!r!r"parse_and_validate_requestxs r^job_or_submission_idrc s|j|dd|dIdH}t|ddd}i}i}|D]^}|jjtjr(q|j }t |jj } | t } | skt||jjt|jd} t|tj|jrPtjntj|j|j|j| t|jjj !| d } | ||<qt||jjt|jd} | || <q||fS) aReturns a tuple of dictionaries related to drivers. The first dictionary contains all driver jobs and is keyed by the job's id. The second dictionary contains drivers that belong to submission jobs. It's keyed by the submission job's submission id. Only the last driver of a submission job is returned. An optional job_or_submission_id filter can be provided to only return jobs with the job id or submission id. T)r_skip_submission_job_info_fieldskip_is_running_tasks_fieldrNcSs |jSr%)job_idhex)job_table_entryr!r!r"s z!get_driver_jobs..)key)idnode_ip_addresspid) rbr>rR entrypoint start_timeend_timemetadata runtime_env driver_info)"async_get_all_job_infosortedvaluesconfig ray_namespace startswithr RAY_INTERNAL_NAMESPACE_PREFIXrbrcdictrmgetr rdriver_address ip_addressr< driver_pidrrDRIVERis_deadr SUCCEEDEDRUNNINGrjrkrlr deserializeruntime_env_infoserialized_runtime_envto_dict) rr_r job_infossorted_job_infosjobssubmission_job_driversrdrbrmjob_submission_iddriverjobr!r!r"get_driver_jobssd       rjob_info_clientc st|dIdH\}}|}|r|Stfdd|Dd}|s'}||IdH}|rO||}tdit|||rD|jnd|t j d}|SdS)zH Attempts to find the job with a given submission_id or job id. r_Nc3s"|] \}}|jkr|VqdSr%rg)r&rgrrr!r" s z"find_job_by_ids.. submission_idrbror>r!) rrxnextr+get_infor dataclassesasdictrgr SUBMISSION) rrr_ driver_jobsrrrjob_inforr!rr"find_job_by_idss8       rjob_idscst|IdH\}fdd|D}fddD}tjfdd|DIdH}i|fddt||DS)z Returns a dictionary of submission jobs with the given job ids, keyed by the job id. This only accepts job ids and not submission ids. Ncsi|] \}}|vr||qSr!r!r&rfrrr!r"r)r*z(find_jobs_by_job_ids..cs i|] \}}|jvr||qSr!rrrr!r"r)scsg|]}|qSr!)r)r&r)rr!r" sz(find_jobs_by_job_ids..c sLi|]"\}}|jtdit|||j|tjdqS)rr!)rxrgrrrrr)r&rr)rr!r"r)'s )rr+keysrGgatherzip)rrrrjob_submission_idsrr!)rrrr"find_jobs_by_job_ids s&     r)NN)2rGrloggingr?r0rWrtypingrrrrrrr ray._privater ray._rayletr ray.dashboard.modules.job.commonr r rr)ray.dashboard.modules.job.pydantic_modelsrrrray.runtime_envrrS aiohttp.webrrrU getLogger__name__rAMAX_CHUNK_LINE_LENGTHrDr<r#r,r5rNr^intrrrr!r!r!r"s $     "  9    G -