o wi=@sddlZddlZddlZddlmZddlZddlmZddl m Z zddl Z da ddl mZWn ey;da YnweeZGd d d ZdS) N)BytesIO) MessageToJson) _clean_tagT)ImageFc@s0eZdZddifddZddZeddZe d,d d Zed-d d Zed.ddZe  d/ddZ ed.ddZ e d0ddZ ed1ddZ ed2ddZ ed1ddZe  d3ddZe d4dd Ze ! d5d"d#Zed$d%Zed1d&d'Zed1d(d)Ze d1d*d+Zd S)6 CometLoggerdisabledTcCsFd|_||_|ddurd|_dS|ddurtdur!tddSdS)NrTFzRComet and/or Python Image Library not installed. Run 'pip install comet-ml pillow')_logging _comet_configcomet_installed Exception)self comet_configrU/home/ubuntu/sommelier/.venv/lib/python3.10/site-packages/tensorboardX/comet_utils.py__init__s  zCometLogger.__init__cstfdd}|S)Nc s|d}|jdurPtrPd|_z*d|jvrttdur#tdtjdi|j|_ d|_|j ddWnt yO}z t|WYd}~nd}~ww|jdur\|i|SdS) NrFapi_keyzYou have already created a comet experiment manually, which might cause clashesTz Created from tensorboardXr) r r r comet_mlinitget_global_experimentloggerwarning Experiment _experiment log_otherr )argskwargsr emethodrrwrappers$    z+CometLogger._requiresComet..wrapper) functoolswraps)r r!rrr_requiresCometszCometLogger._requiresCometcCs|jdtj_dS)zEnds an experiment.N)rendrconfig experiment)r rrrr%6s  zCometLogger.endNcCs,|dkrt|n|}|j|||||dS)a'Logs a general metric (i.e accuracy, f1).. Args: tag: String - Data identifier display_name: The title of the plot. If empty string is passed, `tag` will be used. value: Float/Integer/Boolean/String step: Optional. Used as the X axis when plotting on comet.ml epoch: Optional. Used as the X axis when plotting on comet.ml include_context: Optional. If set to True (the default), the current context will be logged along the metric. N)rr log_metric)r tag display_namevaluestepepochinclude_contextnamerrrr)<szCometLogger.log_metriccCs|j||||dS)a3Logs a key,value dictionary of metrics. Args: dic: key,value dictionary of metrics prefix: prefix added to metric name step: Optional. Used as the X axis when plotting on comet.ml epoch: Optional. Used as the X axis when plotting on comet.ml N)r log_metrics)r dicprefixr-r.rrrr1Os zCometLogger.log_metricscC|j|||dS)aLogs a dictionary (or dictionary-like object) of multiple parameters. Args: parameters: key,value dictionary of parameters prefix: prefix added to metric name step: Optional. Used as the X axis when plotting on comet.ml N)rlog_parameters)r parametersr3r-rrrr5[s zCometLogger.log_parametersFc Cs|j|||||||dS)a:Logs the audio Asset determined by audio data. Args: audio_data: String or a numpy array - either the file path of the file you want to log, or a numpy array given to scipy.io.wavfile.write for wav conversion. sample_rate: Integer - Optional. The sampling rate given to scipy.io.wavfile.write for creating the wav file. file_name: String - Optional. A custom file name to be displayed. If not provided, the filename from the audio_data argument will be used. metadata: Some additional data to attach to the the audio asset. Must be a JSON-encodable dict. overwrite: if True will overwrite all existing assets with the same name. copy_to_tmp: If audio_data is a numpy array, then this flag determines if the WAV file is first copied to a temporary file before upload. If copy_to_tmp is False, then it is sent directly to the cloud. step: Optional. Used to associate the audio asset to a specific step. N)r log_audio)r audio_data sample_rate file_namemetadata overwrite copy_to_tmpr-rrrr7fs zCometLogger.log_audiocCr4)a3Logs the text. These strings appear on the Text Tab in the Comet UI. Args: text: string to be stored step: Optional. Used to associate the asset to a specific step. metadata: Some additional data to attach to the the text. Must be a JSON-encodable dict. N)rlog_text)r textr-r;rrrr>s zCometLogger.log_textcKs |jj|||||fi|dS)aLogs a histogram of values for a 3D chart as an asset for this experiment. Calling this method multiple times with the same name and incremented steps will add additional histograms to the 3D chart on Comet.ml. Args: values: a list, tuple, array (any shape) to summarize, or a Histogram object name: str (optional), name of summary step: Optional. Used as the Z axis when plotting on Comet.ml. epoch: Optional. Used as the Z axis when plotting on Comet.ml. metadata: Optional: Used for items like prefix for histogram name. kwargs: Optional. Additional keyword arguments for histogram. N)rlog_histogram_3d)r valuesr0r-r.r;rrrr log_histograms  zCometLogger.log_histogramcCs0|jdj}t|}||d<|j|||ddS)aLog Raw Histogram Data to Comet as an Asset. Args: tag: Name given to the logged asset summary: TensorboardX Summary protocol buffer with histogram data step: The Global Step for this experiment run. Defaults to None. rr0)datar0r-N)r,historlog_asset_data)r r*summaryr-histogram_protohistogram_raw_datarrrlog_histogram_raws zCometLogger.log_histogram_rawcCs |j|||||dS)aLog timeseries data. Args: name: (str) name of data x: array of x-axis values y: array of y-axis values overwrite: (optional, bool) if True, overwrite previous log step: (optional, int) the step value N)r log_curvetolist)r r0xyr<r-rrrrJs zCometLogger.log_curvecCs0t|}t|}t|}|jj|||ddS)aLogs the image. Images are displayed on the Graphics tab on Comet.ml. Args: encoded_image_string: Required. An encoded image string tag: String - Data identifier step: Optional. Used to associate the image asset to a specific step. r-N)rropenrr log_image)r encoded_image_stringr*r-buff image_pilr0rrrlog_image_encodeds zCometLogger.log_image_encodedcC|j||||||dS)aLogs the Asset determined by file_data. Args: file_data: String or File-like - either the file path of the file you want to log, or a file-like asset. file_name: String - Optional. A custom file name to be displayed. If not provided the filename from the file_data argument will be used. overwrite: if True will overwrite all existing assets with the same name. copy_to_tmp: If file_data is a file-like object, then this flag determines if the file is first copied to a temporary file before upload. If copy_to_tmp is False, then it is sent directly to the cloud. step: Optional. Used to associate the asset to a specific step. N)r log_asset)r file_datar:r<r=r-r;rrrrVs zCometLogger.log_assetcCrU)aLogs the data given (str, binary, or JSON). Args: data: data to be saved as asset name: String, optional. A custom file name to be displayed If not provided the filename from the temporary saved file will be used. overwrite: Boolean, optional. Default False. If True will overwrite all existing assets with the same name. step: Optional. Used to associate the asset to a specific step. epoch: Optional. Used to associate the asset to a specific epoch. metadata: Optional. Some additional data to attach to the asset data. Must be a JSON-encodable dict. N)rrE)r rCr0r<r-r;r.rrrrEszCometLogger.log_asset_dataComet Embeddingc Csd} |durdS|dur'|}|jdd} | ddkr'| dd} t|tkr3t|}n|}|j |||| |||||| dS)aLog a multi-dimensional dataset and metadata for viewing with Comet's Embedding Projector (experimental). Args: vectors: the tensors to visualize in 3D labels: labels for each tensor image_data: (optional) list of arrays or Images image_preprocess_function: (optional) if image_data is an array, apply this function to each element first image_transparent_color: a (red, green, blue) tuple image_background_color_function: a function that takes an index, and returns a (red, green, blue) color tuple title: (optional) name of tensor template_filename: (optional) name of template JSON file Nrr) cpudetachnumpyshapetypelistnparrayr log_embedding) r vectorslabels image_dataimage_preprocess_functionimage_transparent_colorimage_background_color_functiontitletemplate_filenamegroup image_sizerrrras$     zCometLogger.log_embeddingc Csfi}||d<||d<||d<||d<||d<||d<d|d<t|}|j|||d d S) aLogs a mesh as an asset Args: tag: Data identifier vertices: List of the 3D coordinates of vertices. colors: Colors for each vertex faces: Indices of vertices within each triangle. config_dict: Dictionary with ThreeJS classes names and configuration. step: step value to record walltime: Optional override default walltime (time.time()) seconds after epoch of event r*verticescolorsfaces config_dictwalltimemesh asset_typerNN)rKjsondumpsrE) r r*rlrmrnror-rp mesh_jsonrrrlog_meshs    zCometLogger.log_meshcKs |}||d<|j|||ddS)zLogs a histogram as an asset. Args: tag: Data identifier asset_type: List of the 3D coordinates of vertices. step: step value to record rrrNN)rE)r r*rrr-r file_jsonrrrlog_raw_figure8s zCometLogger.log_raw_figurec s|jdj}dd|jjD}tj|jtjd|}fddt D}t ddt ||j d\} } } } } }| | | | | |||d}|j |||d d S) Logs a Precision-Recall Curve Data as an asset. Args: tag: An identifier for the PR curve summary: TensorboardX Summary protocol buffer. step: step value to record rcSsg|]}|jqSr)size).0drrr Osz+CometLogger.log_pr_data..)dtypecg|]}d|qSg?rr{inum_thresholdsrrr}RcS |SNflattenrKrLrrrS z)CometLogger.log_pr_data..)TPFPTNFN precisionrecall thresholdsr0r0r-N)r,tensor tensor_shapedimr_fromiter float_valfloat32reshaperangemapvsplitr\rE)r r*rFrr- tensor_protor\rArtpfptnfnrrpr_datarrr log_pr_dataEs ( zCometLogger.log_pr_datac  shfddtD} tdd||||||g\} } }}}}| | ||||| | |d }|j||| ddS)rycrrrrrrrr}nrz/CometLogger.log_pr_raw_data..cSrrrrrrrrorz-CometLogger.log_pr_raw_data..) rrrrrrrweightsr0rN)rrrE)r r*true_positive_countsfalse_positive_countstrue_negative_countsfalse_negative_countsrrrrr-rrrrrrrrrlog_pr_raw_databs(   zCometLogger.log_pr_raw_data)NNT)NNN)NN)NNNFTN)NNNNr)FN)NFTNN)NFNNN)NNNNrXNN)__name__ __module__ __qualname__rr$r%r)r1r5r7r>rBrIrJrTrVrErarvrxrrrrrrrsl                 '   r)r"rsloggingiorr[r_google.protobuf.json_formatrrFrrr PILr ImportError getLoggerrrrrrrrs