o 6tiw@sZddlZddlZddlZddZdedededdfdd Zd d d Zed kr+edSdS)NcCsdddddd}||S)NzP: {{flores_passage}} Q: {{question.strip()}} A: {{mc_answer1}} B: {{mc_answer2}} C: {{mc_answer3}} D: {{mc_answer4}} Please choose the correct answer from the options above:zPassage: {{flores_passage}} Question: {{question.strip()}} 1: {{mc_answer1}} 2: {{mc_answer2}} 3: {{mc_answer3}} 4: {{mc_answer4}} Please select the correct answer from the given choices:zContext: {{flores_passage}} Query: {{question.strip()}} Option A: {{mc_answer1}} Option B: {{mc_answer2}} Option C: {{mc_answer3}} Option D: {{mc_answer4}} Please indicate the correct option from the list above:z{{flores_passage}} Based on the above passage, answer the following question: {{question.strip()}} Choices: A) {{mc_answer1}} B) {{mc_answer2}} C) {{mc_answer3}} D) {{mc_answer4}} Please provide the correct answer from the choices given:zRead the passage: {{flores_passage}} Then answer the question: {{question.strip()}} Options: A. {{mc_answer1}} B. {{mc_answer2}} C. {{mc_answer3}} D. {{mc_answer4}} Please choose the correct option from the above list:prompt_1prompt_2prompt_3prompt_4prompt_5)modelang prompt_maprrZ/home/ubuntu/.local/lib/python3.10/site-packages/lm_eval/tasks/afrobench/belebele/utils.py prompt_funcsr output_dir overwriter returnc Cs*g}iddddddddd d d d d ddddddddddddddddddd d!d"d#d$d%d&d'd(d)d*d+d,d-d.d/d0d1}idd2dd3dd4dd5d d6d d7d d8dd9dd:dd;dd<dd=dd>dd?dd@ddAd!dBdCdDdEdFdGdHdIdJdKdLdMdNdOdPd1}|D]o}z^dQ|dR}dQ|dS|}dT} | |||t|||dU} tj||} tj| dVdWt|dX|dX||rdYndZd[d\} | d]tj | | dVd^Wd_n1swYWqt y| |Yqwt |d`krt dadb|d_S)cz Generate a yaml file for each language. :param output_dir: The directory to output the files to. :param overwrite: Whether to overwrite files if they already exist. afr AfrikaansamhAmharicaryzMoroccan ArabicarzzEgyptian ArabicbamBambaraengEnglishfraFrenchhauHausaiboIgbolinLingalapor PortuguesesnaShonaswaSwahilitirTigrinyatsoTsongatsnTswanawolWolofXhosaYorubaZuluSwatizSouthern SothoSomalizPlateau MalagasyNyanjaLuoLuganda Kinyarwanda KabuverdianuOromozNigerian Fulfulde)xhoyorzulsswsotsompltnyaluolugkinkeagazfuvafr_Latnamh_Ethiary_Arabarz_Arabbam_Latneng_Latnfra_Latnhau_Latnibo_Latnlin_Latnpor_Latnsna_Latnswh_Latntir_Ethitso_Latntsn_Latnwol_Latnxho_Latnyor_Latnzul_Latnssw_Latnsot_Latnsom_Latnplt_Latnnya_Latnluo_Latnlug_Latnkin_Latnkea_Latngaz_Latnfuv_Latn belebele_z.yaml_belebele)includetask dataset_name doc_to_textT)exist_ok/wxutf8)encodingz# Generated by utils.py ) allow_unicodeNrzJFiles were not created because they already exist (use --overwrite flag): z, ) keysr ospathjoinmakedirsopenwriteyamldumpFileExistsErrorappendlen) rrr err languageslang_2_dataset_lang_coder file_name task_name yaml_template yaml_details file_pathfrrr gen_lang_yamlss     "      "     rcCs`t}|jddddd|jdddd |jd d gd d d|}t|j|j|jddS)z9Parse CLI args and generate language-specific yaml files.z --overwriteT store_truez%Overwrite files if they already exist)defaultactionhelpz --output-dirz./z Directory to write yaml files to)rrz--moderrz Prompt number)rchoicesr)rrr N)argparseArgumentParser add_argument parse_argsrrrr )parserargsrrr mains(r__main__)rN) rrxr~r strboolrr__name__rrrr s o