o xi)G@stdZddlmZddlZddlZddlZddlZddlZddlm Z ddl m Z ddl m Z mZddlZddlZddlmZddlZddlmZdd lmZd d lmZd Zd Zd ZdZdZeZ ddZ!dWddZ"dXddZ#dYd d!Z$dZd%d&Z%d[d(d)Z&d\d*d+Z'd]d1d2Z(d^d6d7Z) 8d_d`d=d>Z*dadEdFZ+dbdGdHZ,dcdJdKZ-dbdLdMZ.dddNdOZ/d\dPdQZ0dedUdVZ1dS)fzUtilities for wandb verify.) annotationsN)partial)Path)AnyCallable)gql)Artifact)runid)Apiverify u✅u❌cCs td|S)N-) ID_PREFIX)namerK/home/ubuntu/.local/lib/python3.10/site-packages/wandb/sdk/verify/verify.pynice_id s rfailed_test_or_testsstr | list[str] | NonewarningboolreturnNonecs|rdndt|trttttj|dddSt|tr;t|dkr;tttdfdd|DdStt dS) NyellowredTfgboldr csg|] }tj|ddqS)Tr)clickstyle).0fcolorrr 0sz!print_results..) isinstancestrprintRED_Xr r!listlenjoin CHECKMARK)rrrr$r print_results$s  r/hostr(cCs|dvr tdddSdS)N)z api.wandb.aizhttp://api.wandb.aizhttps://api.wandb.aiz,Cannot run wandb verify against api.wandb.aiFT)r/)r0rrr check_host7s r1apir cCsjtdddddd}d}|jdurdtj|dd d }n |j}|s,d |d }t|d |duS)NzChecking if logged inH.endz)https://docs.wandb.ai/ref/cli/wandb-loginzBNot logged in. Please log in using `wandb login`. See the docs: {}Tblue) underlinerzPCould not get viewer with default API key. Please relogin using `WANDB_BASE_URL=z% wandb login --relogin` and try againF) r)ljustapi_keyformatr r!r2viewerr/)r2r0 login_doc_url fail_stringresrrrcheck_logged_in>s    rAurltest_url_stringfailure_outputcCs4t|ddddd}|ds|}t|ddS)Nr3r4r5r6httpsT)r)r: startswithr/)rBrCrDr?rrrcheck_secure_requestsVs  rGorigincCsTtdddddd}tj||ddd}|jd dur#d |}t|d dS) Nz)Checking CORs configuration of the bucketr3r4r5r6GET)OriginzAccess-Control-Request-Method)headerszAccess-Control-Allow-OriginzbYour object store does not have a valid CORs configuration, you must allow GET and PUT to Origin: T)r)r:requestsoptionsrKgetr/)rBrHr?res_getrrrcheck_cors_configuration_s rPc Cstdddddg}d}d}dd d }gd }||||d }d }t|d}|d|tjtdd|tdf} | j } | j } d} z%t ddD] } | j dd| i| dqJddd}| j d|i| ddWnt yyd} |dYnwz | dtdiWnt y|dYnw| |Wdn1swYt}|| dtd| }|dur|d t|ddS|D]\}}|j||kr|d!nq| r|jd"dd#d$ks|jd%dks|jd"d&d#dks|jd"d'd#dkr|d(| r&|jdd$kr&|d)ztt|j|}tt|jdd*}Wnt yN|d+t|dYdSw|}|dkr]|d,t|dt|d-kS).Nz6Checking logged metrics, saving and downloading a filer3r4r5r6z A test configz config string) config_val config_string)rone2)epochs stringTestdictTestlistTestz"./test with_special-characters.txtwtest check_runT)idreinitconfigproject lossg?)step)val1val2dictFz5Failed to log values to run. Contact W&B for support.zHT%3ML z!Linkz0Failed to log to media. Contact W&B for support./z:Failed to access run through API. Contact W&B for support.zCRead config values don't match run config. Contact W&B for support.keys previousValue皙?lastStepz dict.val1z dict.val2zCHistory metrics don't match logged values. Check database encoding.zdRead summary values don't match expected value. Check database encoding, or contact W&B for support.replacez]Unable to download file. Check SQS configuration, topic configuration and bucket permissions.zTContents of downloaded file do not match uploaded contents. Contact W&B for support.r)r)r:openwriteclosewandbinitr PROJECT_NAMEr^entityrangelog ExceptionappendHtmlsaver runr/itemsr`rN history_keyssummaryretry_fnrfiledownloadreadr,)r2failed_test_stringsn_epochs string_test dict_test list_testr`filepathr#r}run_idrvloggedilog_dict public_apiprev_runkeyvalue read_filecontentsrrrr]os             r]downloaded_manifestdict[str, Any]computed_manifest fails_list list[str]cCshz$|D]}||d||dksJ||d||dks!JqWdSty3|dYdSw)NdigestsizezGArtifact manifest does not appear as expected. Contact W&B for support.)AssertionErrorrz)rrrrrrrverify_manifests  r downloadedrcomputedcCs|j|jkr |ddSdS)NzEArtifact digest does not appear as expected. Contact W&B for support.)rrz)rrrrrr verify_digests rFr verify_dir str | NonesingularcCs$tjd|d}tdd}|d|||jWdn1s&wY|r/|S|dur5d}|d }|dWdn1sJwYtj |sZt |t|d d }|d Wdn1srwY| |t |d }|d |||S) Nartsy)typerverify_int_test.txtr[ztest 1z./ verify_a.txtztest 2z /verify_1.txt1 verify_3.txt3)rsrrprqrradd_filernew_fileospathexistsmakedirsadd_dirr write_text add_referenceresolveas_uri)rrrartr#file3rrrartifact_with_path_or_pathss.          rartifactalias download_dirradd_extra_file'tuple[bool, Artifact | None, list[str]]c Cstjtddtddid^}|r4tdd}|d|||jWdn1s/wYz |j ||d Wn&t yc}z| d |d d|fWYd}~WdSd}~wwWdn1snwYtjtd tdd id^} z | |d|} Wn&t y}z| d|d d|fWYd}~WdSd}~wwz| j |dWnt y| dd d|fYWdSwWdn1swYd| |fS)N log_artifactTr\z artifact logr^r_rar` verify_2.txtr[rV)aliaseszUnable to log artifact. F use_artifactz artifact use)r^rar`:zUnable to use artifact. rootz6Unable to download artifact. Check bucket permissions.)rsrtrrurprqrrrrrryrzrr) rrrrrr log_art_runr#e use_art_runused_artrrrlog_use_download_artifact sb      rc Csftdddddg}d}d}td}t|d d }t|||||d \}}}|r,|dur3t|d d Sz|j|d WntyI|d Ynwd}d}td}t|dd d }t|||||d \}}}|rk|durrt|d d St t |hdkr|dt j ddd} | |t|| || jd} |jd} t| | |t|d t|dkS)Nz-Checking artifact save and download workflowsr3r4r5r6z./verify_sing_art sing_art1z sing-artysT)rFrzEArtifact does not contain expected checksum. Contact W&B for support.z ./verify_artart1zmy-artysz./verify_art_dir> verify_1.txtrrrrz=Artifact directory is missing files. Contact W&B for support.rdataset)rrr)r)r:rrrr/r ValueErrorrzsetrlistdirrsrrrmanifestto_manifest_jsonrr,) r sing_art_dirrr singular_art cont_testdownload_artifact multi_art_dirrrrrrrrcheck_artifacts;sR             rtuple[bool, str | None]c Cshtdddddg}d}t|d}|d|tjtd d td d id  }| |Wdn1s9wYt }| |j dtd|j }|dura|dt|ddSztt|j|}|j} tt|jd d}Wnty|dt|dYdSw|} z| dksJWnty|dYnwt|dt|dk| fS)NzChecking signed URL uploadr3r4r5r6zgql_test_file.txtr[test2 graphql_putTr\zput to graphqlrrizJUnable to access previous run through public API. Contact W&B for support.F)FNrnz}Unable to read file successfully saved through a put request. Check SQS configurations, bucket permissions and topic configs.zMRead file contents do not match saved file contents. Contact W&B for support.r)r)r:rprqrrrsrtrrur|r r}rvr^rzr/rrrrBrryrrr,) r2r0rgql_fpr#r}rrrrBrrrrcheck_graphql_putssX        rc Cstddddddtd}t}g}td}t}|j}z|j ||t d|d d d Wn2t yb}z&t |t jrO|jdurO|jjd krO|d n |d|dWYd}~nd}~wwt|dt|dkS)Nz5Checking ability to send large payloads through proxyr3r4r5r6aia6 query Project($entity: String!, $name: String!, $runName: String!, $desc: String!){ project(entityName: $entity, name: $name) { run(name: $runName, desc: $desc) { name summaryMetrics } } } )rvrrunNamedesc<)variable_valuestimeoutizYFailed to send a large payload. Check nginx.ingress.kubernetes.io/proxy-body-size is "0".z+Failed to send a large payload with error: Fr)r)r:intgetpassgetuserrrsr _base_client _get_resultruryr'rL HTTPErrorresponse status_coderzr/r,)descyusernamerqueryrclientrrrrcheck_large_postsH         rcCstddddd|\}}d}d}|didd}|did d }d d lm}|tj||kr=d |}n|tj||krNd|d}d}t||dS)Nz,Checking wandb package version is up to dater3r4r5r6FcliVersionInfomax_cli_versionmin_cli_versionz0.0.1r)parsezCwandb version out of date, please run pip install --upgrade wandb==zwandb version is not supported by your local installation. This could cause some issues. If you're having problems try: please run `pip install --upgrade wandb==`T) r)r:viewer_server_inforNpackaging.versionrrs __version__r/)r2_ server_infor?rrrrrrrcheck_wandb_versions$    rc sdtdddddg}dddd d gd id gd id dd}z"tttj|t|j d}Wdn1s=wYWn t yc}z| d|t |dWYd}~dSd}~ww|sr| dt |ddSzddfdd}tj ||ddWn t y}z| d|t |dWYd}~dSd}~wwt |dt|dkS)Nz+Checking sweep creation and agent executionr3r4r5r6randomminimizescore)goalrvalues)g{Gz?g?rl)rbrRr xy verify_sweep)methodmetric parametersr)sweeprarvzFailed to create sweep: Fz&Sweep creation returned an invalid ID.cSs|jd|j}|S)Nr r)r`rrrr objective szcheck_sweeps..objectivecsJtjtd}|j}|d|iWddS1swYdS)N)rar)rsrtrur`rx)r}rr rrmains "zcheck_sweeps..mainr )functioncountzFailed to run sweep agent: r)r)r: contextlibredirect_stdoutioStringIOrsr rudefault_entityryrzr/agentr,)r2r sweep_configsweep_idrr rr r check_sweepssL          rfnrrcCs^t}d}d}|tkst|tkr-|d7}z|}W|Sty,tdYqw|S)Nrrb)time MIN_RETRYSGET_RUN_MAX_TIMErysleep)rini_timer@rrrrrs r)rrrrrr)r0r(rr)r2r r0r(rr)rBr(rCr(rDr(rr)rBr(rHr(rr)r2r rr)rrrrrrrr)rrrrrrrr)NF)rr(rrrrrr)rrrr(rr(rr(rrrrrr)rr)r2r r0r(rr)r2r rr)rrrr)2__doc__ __future__rrrrrr functoolsrpathlibrtypingrrr rL wandb_gqlrrswandb.sdk.artifacts.artifactr wandb.sdk.libr apis.internalr rurrr.r* generate_idrrr/r1rArGrPr]rrrrrrrrrrrrrrsR             f   / 8 . 3 2