o ci '@sddlZddlZddlZddlZddlZddlmZddlmZddlm Z m Z ddl Z ddl Z ddlmZmZddlmZddlmZddlmZdd lmZdd lmZmZmZeeZe d d Z!d Z"eeZ#dZ$ej%dd\Z&Z'ej(ej)ej*ej+ej,ej-dZ.ddZ/ddZ0      d(de1de e e1de e1de e1de e e1de2de3fddZ4      d(d e1de e e1de1de1de e e1de2de3fd!d"Z5d)d$e1d%e1fd&d'Z6dS)*N)datetime)Path)ListOptional)is_numeric_dtypeis_string_dtype)tabulateEXPR_RESULT_FILE) TuneError)ExperimentAnalysis) CONFIG_PREFIXDEFAULT_EXPERIMENT_INFO_KEYSDEFAULT_RESULT_KEYSEDITORvimz%Y-%m-%d %H:%M:%S (%A))name total_trials last_updated)dr)fallback)=>cCstdurtddS)z%Checks whether tabulate is installed.Nz:Tabulate not installed. Please run `pip install tabulate`.)r ImportErrorrrI/home/ubuntu/.local/lib/python3.10/site-packages/ray/tune/cli/commands.py_check_tabulate2srcCst}g}g}t|D]=\}}||r||g7}q ||||<t|ddd}t|dtkrI|j |ddd|t |j |d7}nq t|ddd d }t ||rgt jd |d d t d|rst jd|d d |||fS)zPrints output of given dataframe to fit into terminal. Returns: table: Final outputted dataframe. dropped_cols: Columns dropped due to terminal size. empty_cols: Empty columns (dropped on default). keyspsql)headerstablefmt T)axisinplaceNnever)rr showindexzDropped columns: {}yellowfgz=Please increase your terminal size to view remaining columns.zEmpty columns: {})pd DataFrame enumerateisnullallrstrindex TERM_WIDTHdroplistcolumnsprintclicksechoformat) dataframeprint_df dropped_cols empty_colsicol test_tabletablerrrprint_format_output8s,    rAFexperiment_pathsortoutput filter_op info_keyslimitdescc sntzt|}Wnty}ztd|d}~wwtdfddfdd|jD} rRD]} | |jvrGtd| |jq6fd d|jD} | sYtd || }d |vrt d d |d  } Wdn1sxwY| dd} | |d <d|vr|dj |d|d<|r|d\} } }|| j}t|rt|}nt|rt |}n td||t| } | || |}||}|r|D]}||vrtd|t|q| }|j||d}|r|d|}t||r5tj|d}|dvr||n|dkr!|j|ddntd|tjd|dddSdS)a Lists trials in the directory subtree starting at the given path. Args: experiment_path: Directory where trials are located. Like Experiment.local_dir/Experiment.name/experiment*.json. sort: Keys to sort by. output: Name of file where output is saved. filter_op: Filter operation in the format " ". info_keys: Keys that are displayed. limit: Number of rows to display. desc: Sort ascending vs. descending. zNo trial data found!N/cs|tvp|SN)DEFAULT_CLI_KEYS startswith)k) config_prefixrr key_filter}szlist_trials..key_filtercsg|]}|r|qSrr.0rM)rOrr zlist_trials..z-Provided key invalid: {}. Available keys: {}.cg|]}|vr|qSrrrP)rFrrrRrSzNo columns to output.last_update_timezmode.use_inf_as_nullTcSst|tSrJ)r fromtimestampstrftimeTIMESTAMP_FORMAT)trrrszlist_trials..logdir Unsupported dtype for {}: {} {} not in: {}by ascendingr"z.pz.pklz.pickle.csvFr0Unsupported filetype: {}Output saved at {}greenr()rr r9r r6ClickExceptionr r4r8r*option_contextdropnaapplyr/replacesplitdtyperfloatr OPERATORSr3 sort_valuesrAospathsplitextlower to_pickleto_csvr7)rBrCrDrErFrGrHcheckpoints_dfecol_keysrMdatetime_seriesr>opvalcol_typefiltered_indexkeyrbfile_extensionr)rNrFrOr list_trials^s              r project_pathc sttt|\}}} g} |D]} tddttj|| D} | | d} | | q| s6t dt | |s?t }fddt |D}|sTt d|||r|d\}}}|j}t|rpt|}nt|ryt|}n t d ||t|}|||}||r|D]}|vrt d |t q| }j||d |rd |t|rtj|d }|dvrӈ|n|dkr߈j|ddnt d|tjd|ddd Sd S)aLists experiments in the directory subtree. Args: project_path: Directory where experiments are located. Corresponds to Experiment.local_dir. sort: Keys to sort by. output: Name of file where output is saved. filter_op: Filter operation in the format " ". info_keys: Keys that are displayed. limit: Number of rows to display. desc: Sort ascending vs. descending. css|] \}}}t|vVqdSrJr )rQ_filesrrr s  z#list_experiments..)rrzNo experiments found!crTrrrPinfo_dfrrrRrSz$list_experiments..z#None of keys {} in experiment data!r]r^r_r`Nr"rcrdFrerfrgrhr()rnextrswalksumrtjoinappendr6rir*r+DEFAULT_PROJECT_INFO_KEYSr3r8rnrorrprr/rqrrrArurvrwrxr7)rrCrDrErFrGrHbaseexperiment_foldersrexperiment_data_collectionexperiment_dir num_trialsexperiment_datar{r>r}r~rrrrbrrrrlist_experimentssh          rnote.txtrtfilenamec Cst|}|sJd|||}z tt|gWnty>}zt j dt |ddWYd}~nd}~ww| rLt d|dSt d|dS)zOpens a txt file at the given path where user can add and save notes. Args: path: Directory where note will be saved. filename: Name of note. Defaults to "note.txt" z{} is not a valid directory.zEditing note failed: {}redr(NzNote updated at:zNote created at:)r expanduseris_dirr8 subprocesscallras_posix Exceptionr6r7r/existsr5)rtrfilepathexcrrradd_notes $r)NNNNNF)r)7loggingoperatorrsshutilrrpathlibrtypingrrr6pandasr*pandas.api.typesrr)ray._private.thirdparty.tabulate.tabulaterray.air.constantsr ray.tuner ray.tune.analysisr ray.tune.resultr rr getLogger__name__loggergetenvrrXrKrget_terminal_sizer1 TERM_HEIGHTltleeqnegegtrqrrAr/intboolrrrrrrrs         (   k   X