o 6ti@shddlZddlZddlZGdddZddZdededed dfd d Zdd d Ze dkr2edSdS)Nc@seZdZddZdS) FunctionTagcCs ||_dS)N)value)selfrrX/home/ubuntu/.local/lib/python3.10/site-packages/lm_eval/tasks/afrobench/afriqa/utils.py__init__s zFunctionTag.__init__N)__name__ __module__ __qualname__rrrrrrs rcCs dd|ddddd}||S)NzYour task is to answer a question given a context.Make sure you respond with the shortest span containing the answer in the context. Question: {{question_lang}} Context: {{context}} Answer:zFYour task is to answer a question given a context. The question is in z, while the context is in English or French.Make sure you respond with the shortest span in the context that contains the answer. Question: {{question_lang}} Context: {{context}} Answer:zGiven the context, provide the answer to the following question.Ensure your response is concise and directly from the context. Question: {{question_lang}} Context: {{context}} Answer:zYou are an AI assistant and your task is to answer the question based on the provided context.Your answer should be the shortest span that contains the answer within the context. Question: {{question_lang}} Context: {{context}} Answer:zUsing the context, find the answer to the question.Respond with the briefest span that includes the answer from the context. Question: {{question_lang}} Context: {{context}} Answer:prompt_1prompt_2prompt_3prompt_4prompt_5r)modelang prompt_maprrr prompt_func s r output_dir overwriterreturnc Cs$g}ddddddddd d d }|D]l}z\d |d }d |d|}d}|||t|||d} tj||} tj| ddt|d|d||rNdnddd} | dtj | | ddWdn1skwYWqt y| |Yqwt |dkrt dd|dS)z Generate a yaml file for each language. :param output_dir: The directory to output the files to. :param overwrite: Whether to overwrite files if they already exist. BembaFonHausaIgbo KinyarwandaSwahiliTwiWolofYorubaZulu) bemfonhauibokinswatwiwolyorzulafriqa_z.yaml_afriqa)includetask dataset_name doc_to_textT)exist_ok/wxutf8)encodingz# Generated by utils.py ) allow_unicodeNrzJFiles were not created because they already exist (use --overwrite flag): z, ) keysrospathjoinmakedirsopenwriteyamldumpFileExistsErrorappendlen) rrrerr languagesr file_name task_name yaml_template yaml_details file_pathfrrrgen_lang_yamls+s`       rNcCs`t}|jddddd|jdddd |jd d gd d d|}t|j|j|jddS)z9Parse CLI args and generate language-specific yaml files.z --overwriteT store_truez%Overwrite files if they already exist)defaultactionhelpz --output-dirz./z Directory to write yaml files to)rPrRz--moder r z Prompt number)rPchoicesrR)rrrN)argparseArgumentParser add_argument parse_argsrNrrr)parserargsrrrmaincs(rZ__main__)rN) rTr;rArrstrboolrNrZrrrrrs 8