o Ti @sddlmZmZddlmZddlmZddlmZddl m Z eGdddZ dd Z d d Z ed Zed krse e ZedZedddZeje gdejdZee ZejdddZejrueejejejdddSdSdS)) dataclassfield)Optional) load_dataset) ModelCard)HfArgumentParserc@s^eZdZUdZedddidZeed<edddidZe ed <ed dd idZ e e ed <d S) ScriptArgumentsa Arguments for the script. Args: push_to_hub (`bool`, *optional*, defaults to `False`): Whether to push the dataset to the Hugging Face Hub. repo_id (`str`, *optional*, defaults to `"trl-lib/ultrafeedback-prompt"`): Hugging Face repository ID to push the dataset to. dataset_num_proc (`int` or `None`, *optional*, defaults to `None`): Number of workers to use for dataset processing. Fhelpz4Whether to push the dataset to the Hugging Face Hub.)defaultmetadata push_to_hubztrl-lib/ultrafeedback-promptz2Hugging Face repository ID to push the dataset to.repo_idNz0Number of workers to use for dataset processing.dataset_num_proc) __name__ __module__ __qualname____doc__rr bool__annotations__r strrrintrrZ/home/ubuntu/.local/lib/python3.10/site-packages/examples/datasets/ultrafeedback-prompt.pyrs  rcCsd|ddg}d|iS)Nuser instruction)rolecontentpromptr)examplerrrrto_unpaired_preference3srcCs t|ddddkrdSdS)NrrriFT)len)rrrrdrop_long_prompt8sr!a --- tags: [trl] --- # UltraFeedback - Prompts Dataset ## Summary The UltraFeedback - Prompts dataset is a processed version of the [UltraFeedback](https://huggingface.co/datasets/openbmb/UltraFeedback) dataset for model evaluation on specific aspects like helpfulness, honesty, and instruction-following. ## Data Structure - **Format**: [Conversational](https://huggingface.co/docs/trl/main/dataset_formats#conversational) - **Type**: [Prompt-only](https://huggingface.co/docs/trl/main/dataset_formats#prompt-only) Column: - `"prompt"`: The input question or instruction provided to the model. ## Generation script The script used to generate this dataset can be found [here](https://github.com/huggingface/trl/blob/main/examples/datasets/ultrafeedback-prompt.py). __main__zopenbmb/UltraFeedbacktrain)split)sourcermodels completionscorrect_answersincorrect_answers)remove_columnsnum_procg?*) test_sizeseeddataset) repo_typeN) dataclassesrrtypingrdatasetsrhuggingface_hubr transformersrrrr! model_cardrparserparse_args_into_dataclasses script_argsr/maprfiltertrain_test_splitr r rrrrs4