o 6tii@stddlZddlZddlZddlZdedefddZddZded ed eddfd d Zdd dZ e dkr8e dSdS)NcodereturncCs&tjjdidt||i}|jS)Nalpha_) pycountry languagesgetlenname)rlanguage_tuplerr`/home/ubuntu/.local/lib/python3.10/site-packages/lm_eval/tasks/afrobench/uhura-arc-easy/utils.pyget_language_from_codes r cCsdddddd}||S)NzYou are a virtual assistant that answers multiple-choice questions with the correct option only. Question: {{question}} Choices: {% for i in range(choices['text']|length) %} {{ 'ABCD'[i] }}: {{ choices['text'][i] }} {% endfor %} Answer: zChoose the correct option that answers the question below: Question: {{question}} Choices: {% for i in range(choices['text']|length) %} {{ 'ABCD'[i] }}: {{ choices['text'][i] }} {% endfor %} Answer: zAnswer the following multiple-choice question by picking 'A', 'B', 'C', or 'D'. Question: {{question}} Options: {% for i in range(choices['text']|length) %} {{ 'ABCD'[i] }}: {{ choices['text'][i] }} {% endfor %} Answer: zQuestion: {{question}} Options: {% for i in range(choices['text']|length) %} {{ 'ABCD'[i] }}: {{ choices['text'][i] }} {% endfor %} Answer: zWhich of the following options answers this question: {{question}} {% for i in range(choices['text']|length) %} {{ 'ABCD'[i] }}: {{ choices['text'][i] }} {% endfor %} Answer: prompt_1prompt_2prompt_3prompt_4prompt_5r)mode prompt_maprrr prompt_func s"r output_dir overwriterc Cs.g}hd}|D]|}zld|d}d|d|}d}|||d|dkr&dnd t|d } |d vr7d | d <tj||} tj| ddt|d|d||rSdnddd} | dtj| | ddWdn1spwYWqt y| |Yqwt |dkrt dd|dS)z Generate a yaml file for each language. :param output_dir: The directory to output the files to. :param overwrite: Whether to overwrite files if they already exist. >amenhaswyozunsozuhura-arc-easy_z.yaml_zuhura-arc-easy_multiple_choicer _unmatched)includetask dataset_name doc_to_text)rrtrain fewshot_splitT)exist_ok/wxutf8)encodingz# Generated by utils.py ) allow_unicodeNrzJFiles were not created because they already exist (use --overwrite flag): z, ) rospathjoinmakedirsopenwriteyamldumpFileExistsErrorappendr ) rrrerrrlang file_name task_name yaml_template yaml_details file_pathfrrr gen_lang_yamls3sP     rCcCspt}|jddddd|jdddd gd }|jd d ||d d|}|jD] }t|j|j|dq*dS)z9Parse CLI args and generate language-specific yaml files.z --overwriteT store_truez%Overwrite files if they already exist)defaultactionhelpz --output-dirz./z Directory to write yaml files to)rErGrz--mode*zPrompt number(s))nargsrEchoicesrG)rrrN)argparseArgumentParser add_argument parse_argsrrCrr)parserPROMPT_CHOICESargsrrrr maincs0 rR__main__)rN) rKr1rr7strr rboolrCrR__name__rrrr s& 0