o 6tiG@sZddlZddlZddlZddZdedededdfdd Zd d d Zed kr+edSdS)NcCsv|dkrd}d|d|d|dddd |d dd |d d|d dd}||S)NpidginzNigerian Pidginz-Provide a summary of the document written in z). Ensure that you provide the summary in z and nothing else. Document in z: z{{'text'}}\nSummary: zqSummarize the document below in triple backticks and return only the summary and nothing else. ```{{'text'}}```\nz[You are an advanced Summarizer, a specialized assistant designed to summarize documents in z. Your main goal is to ensure summaries are concise and informative. Ensure you return the summary only and nothing else. Document: zSummarize this z document: z document: prompt_1prompt_2prompt_3prompt_4prompt_5) capitalize)modelang prompt_mapr W/home/ubuntu/.local/lib/python3.10/site-packages/lm_eval/tasks/afrobench/xlsum/utils.py prompt_funcsr output_dir overwriter returnc Csg}d}|D]k}z[d|d}d|d|}d}|||t||dd} tj||} tj| dd t|d |d ||r@d nd d d} | dtj| | ddWdn1s]wYWqt yq| |Yqwt |dkrt dd|dS)z Generate a yaml file for each language. :param output_dir: The directory to output the files to. :param overwrite: Whether to overwrite files if they already exist. ) amharicarabichausaigbokirundioromorsomaliswahilitelugutigrinyayorubaxlsum_z.yaml_xlsumz {{summary}})includetask dataset_name doc_to_text doc_to_targetT)exist_ok/wxutf8)encodingz# Generated by utils.py ) allow_unicodeNrzJFiles were not created because they already exist (use --overwrite flag): z, ) rospathjoinmakedirsopenwriteyamldumpFileExistsErrorappendlen) rrr errXLSUM_LANGUAGESr file_name task_name yaml_template yaml_details file_pathfr r rgen_lang_yamlssN     r@cCspt}|jddddd|jdddd gd }|jd d ||d d|}|jD] }t|j|j|dq*dS)z9Parse CLI args and generate language-specific yaml files.z --overwriteT store_truez%Overwrite files if they already exist)defaultactionhelpz --output-dirz./z Directory to write yaml files to)rBrDrz--mode*zPrompt number(s))nargsrBchoicesrD)rrr N)argparseArgumentParser add_argument parse_argsr r@rr)parserPROMPT_CHOICESargsr r r rmainXs0 rO__main__)rN) rHr-r3rstrboolr@rO__name__r r r rs ;