o xi$ @sddlmZddlZddlZddlmZddlmZddlZddl m Z ddl m Z zddlmZWneyCZzed edZ[wwzdd l mZWne jyeZz edZWYdZ[ndZ[wwzdd l mZWne jyZz edZWYdZ[ndZ[wwzdd l mZWne jyZz edZWYdZ[ndZ[wwGd ddZ d2d3ddZ d2d4ddZ d2d5ddZ     d6d7d$d%Z     d6d8d&d'Z d2d4d(d)Z d2d5d*d+Zd,d-Z     d9d:d0d1Z!dS);) annotationsNwraps)Path) telemetry)errors)currentzqError: `metaflow` not installed >> This integration requires metaflow! To fix, please `pip install -Uqq metaflow`) data_pandas) data_pytorch) data_sklearnc@s$eZdZddZddZddZdS) ArtifactProxyc s4|jiittfddtjDddS)Ncsi|]}|t|qS)getattr).0pflowrW/home/ubuntu/.local/lib/python3.10/site-packages/wandb/integration/metaflow/metaflow.py 2sz*ArtifactProxy.__init__..)rinputsoutputsbaseparams)__dict__updatesetdirr parameter_names)selfrrrr__init__*s zArtifactProxy.__init__cCs||j|<t|j||SN)rsetattrr)rkeyvalrrr __setattr__6s zArtifactProxy.__setattr__cCs2||jvr||jvrt|j||j|<t|j|Sr!)rrrrr)rr#rrr __getattr__:s zArtifactProxy.__getattr__N)__name__ __module__ __qualname__r r%r&rrrrr )s r Fnamestrdata,dict | list | set | str | int | float | booltestingboolreturn str | NonecCs|rdS|||idS)Nscalar)logr*r,runr.rrr _track_scalar@sr6rcCsf|rdStj|dd}|r||n |r||||td|dt|ddS)NrdatasettypeLogging artifact:  ()) wandbArtifactis_diradd_diris_fileadd_file log_artifacttermlogr9)r*r,r5r.artifactrrr _track_pathMs   rFcCs~|rdStj|dd}||dd}t||Wdn1s%wY||td|dt|ddS) Ngenericotherr8z.pklwbr:r;r<)r=r>new_filepickledumprCrDr9)r*r,r5r.rEfrrr_track_generic`s rNdatasetsmodelsothersr5wandb.Run | Nonec Cstrt|r|rt||||Str"t|r"|r"t||||Str3t|r3|r3t||||St |t rA|rAt ||||St |t t tttttfrTt||||S|r]t||||SdS)z6Track data as wandb artifacts based on type and flags.N)r is_dataframetrack_dataframer is_nn_moduletrack_nn_moduler is_estimatortrack_estimator isinstancerrFdictlistrr+intfloatr/r6rNr*r,rOrPrQr5r.rrr wandb_trackqs r_c Cst|tttttttfrdSzOtr t |r |r t |||WSt r1t |r1|r1t |||WStrBt|rB|rBt|||WSt|trQ|rQt||||WS|r[t||||WSWdStjyvtd|dt|dYdSw)z1Use wandb artifacts based on data type and flags.NzThis artifact (z, z) does not exist in the wandb datastore! If you created an instance inline (e.g. sklearn.ensemble.RandomForestClassifier), then you can safely ignore this. Otherwise you may want to check your internet connection!)rYrZr[rr+r\r]r/r rS use_dataframer rU use_nn_moduler rW use_estimatorr _use_path _use_genericr= CommErrortermwarnr9r^rrr wandb_uses( rgcC8|rdS||dtd|dt|ddS)NrO:latestUsing artifact: r;r< use_artifactr=rDr9r4rrrrc rccCrh)NrQrirjr;r<rkr4rrrrdrmrdcGstdd|DdS)Ncss|] }|dur|VqdSr!r)rarrr szcoalesce..)next)argrrrcoalescesrrsettingswandb.Settings | Nonecs0t|fdd|durS|S)aAutomatically log parameters and artifacts to W&B. This decorator can be applied to a flow, step, or both: - Decorating a step enables or disables logging within that step - Decorating a flow is equivalent to decorating all steps - Decorating a step after decorating its flow overwrites the flow decoration Args: func: The step method or flow class to decorate. datasets: Whether to log `pd.DataFrame` and `pathlib.Path` types. Defaults to False. models: Whether to log `nn.Module` and `sklearn.base.BaseEstimator` types. Defaults to False. others: If `True`, log anything pickle-able. Defaults to False. settings: Custom settings to pass to `wandb.init`. If `run_group` is `None`, it is set to `{flow_name}/{run_id}`. If `run_job_type` is `None`, it is set to `{run_job_type}/{step_name}`. cstr&}|jD]}tt||r#t|ds#t||t||q |Stdr-Stdfdd }|_d|_ |S)N _base_funcrsc s*t|tjjjs t}|t|jtj dtj t|j tj dtj |da}tj|d }d|j_Wdn1s@wYt|}|j|j|g|Ri||jD]\}}t|||dq`|jD]\}}t|||dqtWddS1swYdS)N/) run_group run_job_typerv)r5T)rOrPrQr5)rYr=sdkwandb_settingsSettingsupdate_from_dictrrrxr flow_namerun_idry step_nameinit wb_telemetrycontextfeaturemetaflowr configrrritemsrgrr_) rrsargskwargsr5telproxyr*r,)rOfuncrPrQrrwrappersH    "z-wandb_log..decorator..wrapper)rOrPrQrs) inspectisclassrcallablerhasattrr"rru_kwargs)rclsattrrrO decoratorrPrQrs)rrrs$   (zwandb_log..decoratorNr)rrOrPrQrsrrr wandb_logs Ar)F)r*r+r,r-r.r/r0r1)r*r+r,rr.r/r0r1)r*r+r.r/r0r1)FFFNF)r*r+rOr/rPr/rQr/r5rRr.r/r0r1) r*r+rOr/rPr/rQr/r.r/r0r1)NFFFN)rOr/rPr/rQr/rsrt)" __future__rrrK functoolsrpathlibrr= wandb.sdk.librrrrr ImportErrore Exceptionr MissingDependencyErrorwarnr r r r6rFrNr_rgrcrdrrrrrrrs         ) 3