o 6ti? @sZddlZddlZddlZddZdedededdfdd Zd d d Zed kr+edSdS)NcCsdddddd}||S)NztQ: {{Question.strip()}} A: {{A}} B: {{B}} C: {{C}} D: {{D}} Please choose the correct answer from the options above:z{Question: {{Question.strip()}} 1: {{A}} 2: {{B}} 3: {{C}} 4: {{D}} Please select the correct answer from the given choices:zInput Question: {{Question.strip()}} Option A: {{A}} Option B: {{B}} Option C: {{C}} Option D: {{D}} Please indicate the correct option from the list above:zCritically analyze the question and select the most probable answer from the list: {{Question.strip()}} Choices: A) {{A}} B) {{B}} C) {{C}} D) {{D}}zAnswer the question and pick the correct answer from the options: {{Question.strip()}} Options: A. {{A}} B. {{B}} C. {{C}} D. {{D}} Please choose the correct option from the above list:prompt_1prompt_2prompt_3prompt_4prompt_5)modelang prompt_maprr]/home/ubuntu/.local/lib/python3.10/site-packages/lm_eval/tasks/afrobench/openai_mmlu/utils.py prompt_funcsr output_dir overwriter returnc Cs&g}dddd}dddd}|D]n}z^d|d }d|d |}d } | |||t|||d } tj||} tj| d dt|d|d||rOdnddd} | dtj | | d dWdn1slwYWqt y| |Yqwt |dkrt dd|dS)z Generate a yaml file for each language. :param output_dir: The directory to output the files to. :param overwrite: Whether to overwrite files if they already exist. ArabicSwahiliYoruba)araswayorAR_XYSW_KEYO_NG openai_mmlu_z.yaml_ openai_mmlu)includetask dataset_name doc_to_textT)exist_ok/wxutf8)encodingz# Generated by utils.py ) allow_unicodeNrzJFiles were not created because they already exist (use --overwrite flag): z, ) keysr ospathjoinmakedirsopenwriteyamldumpFileExistsErrorappendlen) rrr err languages lang2_coder file_name task_name yaml_template yaml_details file_pathfrrr gen_lang_yamlssZ       r=cCs`t}|jddddd|jdddd |jd d gd d d|}t|j|j|jddS)z9Parse CLI args and generate language-specific yaml files.z --overwriteT store_truez%Overwrite files if they already exist)defaultactionhelpz --output-dirz./z Directory to write yaml files to)r?rAz--moderrz Prompt number)r?choicesrA)rrr N)argparseArgumentParser add_argument parse_argsr=rrr )parserargsrrr mainIs(rI__main__)rN) rCr)r/r strboolr=rI__name__rrrr s 7