o 5ti@sddlmZddlZddlmZmZddlmZddlm Z ddl m Z e e Z        dd ed ed ed ed edededededededeeefdedeeefdefddZdS))DictN) dataset_info model_info)metadata_update)HF_HUB_ALLOWED_TASKS) get_loggerFmodel_id task_type dataset_type dataset_name metric_type metric_name metric_value task_namedataset_config dataset_splitdataset_revision dataset_args metric_config metric_args overwritec Csl|tvr tdtzt|Wntjjy'td|d|Ynwzt|WntjjyAtd|d|wd|i||d||dgd }|d ur[||d d <| d ure| |d d <| d uro| |d d<| d ury| |d d<|d ur||dd<|d ur||ddd<| d ur| |ddd <| d ur| |ddd<dd|gigi}t |||dS)a Pushes the result of a metric to the metadata of a model repository in the Hub. Args: model_id (`str`): Model id from https://hf.co/models. task_type (`str`): Task id, refer to the [Hub allowed tasks](https://github.com/huggingface/evaluate/blob/main/src/evaluate/config.py#L154) for allowed values. dataset_type (`str`): Dataset id from https://hf.co/datasets. dataset_name (`str`): Pretty name for the dataset. metric_type (`str`): Metric id from https://hf.co/metrics. metric_name (`str`): Pretty name for the metric. metric_value (`float`): Computed metric value. task_name (`str`, *optional*): Pretty name for the task. dataset_config (`str`, *optional*): Dataset configuration used in [`~datasets.load_dataset`]. See [`~datasets.load_dataset`] for more info. dataset_split (`str`, *optional*): Name of split used for metric computation. dataset_revision (`str`, *optional*): Git hash for the specific version of the dataset. dataset_args (`dict[str, int]`, *optional*): Additional arguments passed to [`~datasets.load_dataset`]. metric_config (`str`, *optional*): Configuration for the metric (e.g. the GLUE metric has a configuration for each subset). metric_args (`dict[str, int]`, *optional*): Arguments passed during [`~evaluate.EvaluationModule.compute`]. overwrite (`bool`, *optional*, defaults to `False`): If set to `True` an existing metric field can be overwritten, otherwise attempting to overwrite any existing fields will cause an error. Example: ```python >>> push_to_hub( ... model_id="huggingface/gpt2-wikitext2", ... metric_value=0.5 ... metric_type="bleu", ... metric_name="BLEU", ... dataset_name="WikiText", ... dataset_type="wikitext", ... dataset_split="test", ... task_type="text-generation", ... task_name="Text Generation" ... ) ```z/Task type not supported. Task has to be one of zDataset z( not found on the Hub at hf.co/datasets/zModel z not found on the Hub at hf.co/type)rname)rvalue)taskdatasetmetricsNrconfigsplitrevisionargsrrrrz model-indexresults)repo_idmetadatar) r ValueErrorrrequests exceptions HTTPErrorloggerwarningrr)r r r r r rrrrrrrrrrresultr$r,@/home/ubuntu/.local/lib/python3.10/site-packages/evaluate/hub.py push_to_hubsPE       r.)NNNNNNNF)typingrr&huggingface_hubrrhuggingface_hub.repocardrrr utils.loggingr__name__r)strfloatintboolr.r,r,r,r-s\