o 6ti @sZddlZddlZddlZddZdedededdfdd Zd d d Zed kr+edSdS)NcCsdddddd}||S)NzP: {{story}} Q: {{question.strip()}} A: {{options_A}} B: {{options_B}} C: {{options_C}} D: {{options_D}} Please choose the correct answer from the options above:zPassage: {{story}} Question: {{question.strip()}} 1: {{options_A}} 2: {{options_B}} 3: {{options_C}} 4: {{options_D}} Please select the correct answer from the given choices:zContext: {{story}} Query: {{question.strip()}} Option A: {{options_A}} Option B: {{options_B}} Option C: {{options_C}} Option D: {{options_D}} Please indicate the correct option from the list above:z{{story}} Based on the above passage, answer the following question: {{question.strip()}} Choices: A) {{options_A}} B) {{options_B}} C) {{options_C}} D) {{options_D}} Please provide the correct answer from the choices given:zRead the passage: {{story}} Then answer the question: {{question.strip()}} Options: A. {{options_A}} B. {{options_B}} C. {{options_C}} D. {{options_D}} Please choose the correct option from the above list:prompt_1prompt_2prompt_3prompt_4prompt_5)modelang prompt_maprrY/home/ubuntu/.local/lib/python3.10/site-packages/lm_eval/tasks/afrobench/naijarc/utils.py prompt_funcsr output_dir overwriter returnc Csg}dddd}|D]l}z\d|d}d|d|}d}|||t|||d } tj||} tj| d d t|d |d ||rGd nddd} | dtj | | d dWdn1sdwYWq t yx| |Yq wt |dkrt dd|dS)z Generate a yaml file for each language. :param output_dir: The directory to output the files to. :param overwrite: Whether to overwrite files if they already exist. HausaIgboYoruba)hauiboyornaijarc_z.yaml_naijarc)includetask dataset_name doc_to_textT)exist_ok/wxutf8)encodingz# Generated by utils.py ) allow_unicodeNrzJFiles were not created because they already exist (use --overwrite flag): z, ) keysr ospathjoinmakedirsopenwriteyamldumpFileExistsErrorappendlen) rrr err languagesr file_name task_name yaml_template yaml_details file_pathfrrr gen_lang_yamlssR       r9cCs`t}|jddddd|jdddd |jd d gd d d|}t|j|j|jddS)z9Parse CLI args and generate language-specific yaml files.z --overwriteT store_truez%Overwrite files if they already exist)defaultactionhelpz --output-dirz./z Directory to write yaml files to)r;r=z--moderrz Prompt number)r;choicesr=)rrr N)argparseArgumentParser add_argument parse_argsr9rrr )parserargsrrr mainCs(rE__main__)rN) r?r&r,r strboolr9rE__name__rrrr s 1