o -wi@sddlZddlZddlmZddlmZmZmZmZmZm Z m Z ddl Z ddl Z ddl mZddlmZeeZgdZgdZGdd d ZdS) N)datetime)AnyDictListOptionalSequenceTupleUnion)Response) generate_id)text-classificationsentiment-analysisquestion-answering summarization translationztext2text-generationztext-generation)r r rc@s:eZdZdZdZdeedeeefde de de de eeeff d d Z de efd d Z ed edeeeefdeeeefdeeeeefeeeefffddZd edeeeefdeeeefdeeefdeeeeff ddZdeeeefdede de deeef ddZddZdS)*HuggingFacePipelineRequestResponseResolverzResolver for HuggingFace's pipeline request and responses, providing necessary data transformations and formatting. This is based off (from wandb.sdk.integration_utils.auto_logging import RequestResponseResolver) Nargskwargsresponse start_time time_elapsedreturnc Cszf|dd\}}|j}|tvs|dr[||} | dur!WdS| j} ttj} | |||\}}| ||||} | | | | |} t j d|}|tj| d| dddiWStd|d WdSty~}z t|WYd}~dSd}~ww) aMain call method for this class. :param args: list of arguments :param kwargs: dictionary of keyword arguments :param response: the response from the request :param start_time: time when request started :param time_elapsed: time elapsed for the request :returns: packed data as a dictionary for logging to wandb, None if an exception occurred NrWANDB_AUTOLOG_TABLE_NAMEr)columnsdataz The task: `zc` is not yet supported. Please contact `wandb` to notify us if you would like support for this task)taskSUPPORTED_PIPELINE_TASKS startswith _get_model name_or_pathrnowpytzutc_transform_task_specific_data _format_data _create_tableosenvirongetwandbTableloggerwarning Exception)selfrrrrrpipe input_datarmodel model_alias timestampformatted_data packed_data table_nameer:c/home/ubuntu/sommelier/.venv/lib/python3.10/site-packages/wandb/integration/huggingface/resolver.py__call__(s<   z3HuggingFacePipelineRequestResponseResolver.__call__cCs0|j}z|jWStytd|YSw)zExtracts model from the pipeline. :param pipe: the HuggingFace pipeline :returns: Model if available, None otherwise zUModel does not have a `.model` attribute. Assuming `pipe.model` is the correct model.)r3AttributeErrorr-info)r0r1r3r:r:r;r `s z5HuggingFacePipelineRequestResponseResolver._get_modelrr2cCs|dkrt|tr |n|g}dd|D}||fS|dkr?t|tr$|n|g}dd|D}t|tr5|n|g}dd|D}||fS)zTransform input and response data based on specific tasks. :param task: the task name :param input_data: the input data :param response: the response data :returns: tuple of transformed input_data and response rcSsg|]}|jqSr:__dict__.0rr:r:r; |sz\HuggingFacePipelineRequestResponseResolver._transform_task_specific_data..conversationalcSg|] }|jddqS)past_user_inputsr?rAr:r:r;rCcSrE)generated_responsesrGr?rAr:r:r;rCrH) isinstancelist)rr2rr:r:r;r%os  zHHuggingFacePipelineRequestResponseResolver._transform_task_specific_datacCs|t|tr|n|g}t|tr|n|g}g}t||D] \}}t|tr2t|dkr2|tvr2|d}||||dq|S)a?Formats input data, response, and kwargs into a list of dictionaries. :param task: the task name :param input_data: the input data :param response: the response data :param kwargs: dictionary of keyword arguments :returns: list of dictionaries containing formatted data rr)inputrr)rJrKziplenPIPELINES_WITH_TOP_Kappend)r0rr2rrr6i_textr_textr:r:r;r&s  z7HuggingFacePipelineRequestResponseResolver._format_datar6r4r5c CsTgd}|g}tdd}|D]}|||||d|d|dg} || q||_|S)aCreates a table from formatted data, model alias, timestamp, and elapsed time. :param formatted_data: list of dictionaries containing formatted data :param model_alias: alias of the model :param timestamp: timestamp of the data :param time_elapsed: time elapsed from the beginning :returns: list of lists, representing a table of data. [0]th element = columns. [1]st element = data )IDz Model Alias Timestampz Elapsed TimeInputr Kwargs)lengthrLrr)r rP autolog_id) r0r6r4r5rheadertablerYrrowr:r:r;r's  z8HuggingFacePipelineRequestResponseResolver._create_tablecCs|jS)N)rY)r0r:r:r; get_latest_idsz8HuggingFacePipelineRequestResponseResolver.get_latest_id)__name__ __module__ __qualname____doc__rYrrrstrr floatrr<r staticmethodr rrr%r&r'r]r:r:r:r;r sd  8"   "  +r)loggingr(rtypingrrrrrrr r#r+(wandb.sdk.integration_utils.auto_loggingr wandb.sdk.lib.runidr getLoggerr^r-rrOrr:r:r:r;s $