o xi@sddlmZddlZddlZddlmZddlmZddlmZddl Z ddl Z ddl m Z ddl mZeeZgdZgd ZGd d d ZdS) ) annotationsN)Sequence)datetime)Any)Response) generate_id)text-classificationsentiment-analysisquestion-answering summarization translationztext2text-generationztext-generation)rr r c@sReZdZdZdZd%ddZd&ddZed'ddZd(ddZ d)d!d"Z d#d$Z dS)**HuggingFacePipelineRequestResponseResolverzResolver for HuggingFace's pipeline request and responses, providing necessary data transformations and formatting. This is based off (from wandb.sdk.integration_utils.auto_logging import RequestResponseResolver) Nargs Sequence[Any]kwargsdict[str, Any]responser start_timefloat time_elapsedreturndict[str, Any] | Nonec Cszf|dd\}}|j}|tvs|dr[||} | dur!WdS| j} ttj} | |||\}}| ||||} | | | | |} t j d|}|tj| d| dddiWStd|d WdSty~}z t|WYd}~dSd}~ww) aMain call method for this class. :param args: list of arguments :param kwargs: dictionary of keyword arguments :param response: the response from the request :param start_time: time when request started :param time_elapsed: time elapsed for the request :returns: packed data as a dictionary for logging to wandb, None if an exception occurred Nr WANDB_AUTOLOG_TABLE_NAMEr)columnsdataz The task: `zc` is not yet supported. Please contact `wandb` to notify us if you would like support for this task)taskSUPPORTED_PIPELINE_TASKS startswith _get_model name_or_pathrnowpytzutc_transform_task_specific_data _format_data _create_tableosenvirongetwandbTableloggerwarning Exception)selfrrrrrpipe input_datarmodel model_alias timestampformatted_data packed_data table_nameer:Z/home/ubuntu/.local/lib/python3.10/site-packages/wandb/integration/huggingface/resolver.py__call__+s<   z3HuggingFacePipelineRequestResponseResolver.__call__ Any | NonecCs0|j}z|jWStytd|YSw)zExtracts model from the pipeline. :param pipe: the HuggingFace pipeline :returns: Model if available, None otherwise zUModel does not have a `.model` attribute. Assuming `pipe.model` is the correct model.)r3AttributeErrorr-info)r0r1r3r:r:r;r cs z5HuggingFacePipelineRequestResponseResolver._get_modelrstrr2list[Any] | Any'tuple[list[Any] | Any, list[Any] | Any]cCs|dkrt|tr |n|g}dd|D}||fS|dkr?t|tr$|n|g}dd|D}t|tr5|n|g}dd|D}||fS)zTransform input and response data based on specific tasks. :param task: the task name :param input_data: the input data :param response: the response data :returns: tuple of transformed input_data and response r cSsg|]}|jqSr:__dict__.0rr:r:r; sz\HuggingFacePipelineRequestResponseResolver._transform_task_specific_data..conversationalcSg|] }|jddqS)past_user_inputsrCrEr:r:r;rGcSrI)generated_responsesrKrCrEr:r:r;rGrL) isinstancelist)rr2rr:r:r;r%rs  zHHuggingFacePipelineRequestResponseResolver._transform_task_specific_datalist[dict[str, Any]]cCs|t|tr|n|g}t|tr|n|g}g}t||D] \}}t|tr2t|dkr2|tvr2|d}||||dq|S)a?Formats input data, response, and kwargs into a list of dictionaries. :param task: the task name :param input_data: the input data :param response: the response data :param kwargs: dictionary of keyword arguments :returns: list of dictionaries containing formatted data rr)inputrr)rNrOziplenPIPELINES_WITH_TOP_Kappend)r0rr2rrr6i_textr_textr:r:r;r&s  z7HuggingFacePipelineRequestResponseResolver._format_datar6r4r5list[list[Any]]c CsTgd}|g}tdd}|D]}|||||d|d|dg} || q||_|S)aCreates a table from formatted data, model alias, timestamp, and elapsed time. :param formatted_data: list of dictionaries containing formatted data :param model_alias: alias of the model :param timestamp: timestamp of the data :param time_elapsed: time elapsed from the beginning :returns: list of lists, representing a table of data. [0]th element = columns. [1]st element = data )IDz Model Alias Timestampz Elapsed TimeInputrKwargs)lengthrQrr)rrU autolog_id) r0r6r4r5rheadertabler_rrowr:r:r;r's  z8HuggingFacePipelineRequestResponseResolver._create_tablecCs|jS)N)r_)r0r:r:r; get_latest_idsz8HuggingFacePipelineRequestResponseResolver.get_latest_id) rrrrrrrrrrrr)rr=)rr@r2rArrArrB) rr@r2rArrArrrrP) r6rPr4r@r5rrrrrX) __name__ __module__ __qualname____doc__r_r<r staticmethodr%r&r'rcr:r:r:r;r #s  8   " +r ) __future__rloggingr(collections.abcrrtypingrr#r+(wandb.sdk.integration_utils.auto_loggingrwandb.sdk.lib.runidr getLoggerrdr-rrTr r:r:r:r;s