o 7ti @sddlZddlmZmZddlZgdZdedefddZdedefdd Z dedeefd d Z d ed e ddfddZ dddZ edkrJe dSdS)N)DictList)enfrjpptruzhdocreturncCsddd}||dS)a Return index of the correct choice. Note: We are using the "multiple input" mode of the multiple-choice output-type, which means we use different contexts with the same target for the different choices, rather than the same context and different targets. r)12answer)r answer_to_numrrQ/home/ubuntu/.local/lib/python3.10/site-packages/lm_eval/tasks/xwinograd/utils.py doc_to_text s  rcCs&|ddd}|d|dS)z Return the target completion. Note that this does not depend on the correct choice as we are using "multiple input" mode. sentence_r N)indexstripr idxrrr doc_to_targetsrcs2ddddg}fdd|DS)zJReturn the choices that will be used as contexts in "multiple input" mode.rroption1option2cs g|] }dd|qS)rNr).0optrrr (s z!doc_to_choice..)r)r optionsrrr doc_to_choice$sr! output_dir overwritec Csg}tD]J}d|d}z4t|d||rdnddd}|dtd |d|d |Wd n1s:wYWqtyN||Yqwt|d kr_td d|d S)z Generate a yaml file for each language. :param output_dir: The directory to output the files to. :param overwrite: Whether to overwrite files if they already exist. xwinograd_z.yaml/wxzutf-8)encodingz# Generated by utils.py xwinograd_common_yaml)include dataset_nametaskNrzJFiles were not created because they already exist (use --overwrite flag): z, ) LANGUAGESopenwriteyamldumpFileExistsErrorappendlenjoin)r"r#errlang file_namefrrrgen_lang_yamls+s8    r:cCsFt}|jddddd|jdddd |}t|j|jd d S) z9Parse CLI args and generate language-specific yaml files.z --overwriteF store_truez%Overwrite files if they already exist)defaultactionhelpz --output-dir.z Directory to write yaml files to)r<r>)r"r#N)argparseArgumentParser add_argument parse_argsr:r"r#)parserargsrrrmainLsrF__main__)r N)r@typingrrr0r-intrstrrr!boolr:rF__name__rrrrs   !