o 6tii @s`ddlZddlZddlZGdddZdedededdfdd Zd d d Zed kr.edSdS)Nc@seZdZddZdS) FunctionTagcCs ||_dS)N)value)selfrrT/home/ubuntu/.local/lib/python3.10/site-packages/lm_eval/tasks/afrimmlu/gen_utils.py__init__s zFunctionTag.__init__N)__name__ __module__ __qualname__rrrrrrs r output_dir overwritemodereturnc Csg}iddddddddd d d d d ddddddddddddddddddd d!d"d#d$i}|D]}}zmd%|d&}d%|d'|}d(}|d)d*d+krkd,|d&}d,|d'|}d-}|||d.} tj|d)|d/d0t|d)|d)||rd1nd2d3d4} | d5tj| | d/d6Wd7n1swYWq?ty| |Yq?wt |d8krtd9d: |d7S);z Generate a yaml file for each language. :param output_dir: The directory to output the files to. :param overwrite: Whether to overwrite files if they already exist. engEnglishamhAmhariciboIgbofraFrenchsnachiShonawolWolofeweEwelinLingalalugLugandaxhoisiXhosakin KinyarwandatwiTwizulZuluormOromoyorYorubahauHausasotSesothoswaSwahiliafrimmlu_direct_z.yaml_afrimmlu_direct/ translateafrimmlu_translate_afrimmlu_translate)includetask dataset_nameT)exist_okwxutf8)encodingz# Generated by utils.py ) allow_unicodeNrzJFiles were not created because they already exist (use --overwrite flag): z, ) keyssplitosmakedirsopenwriteyamldumpFileExistsErrorappendlenjoin) r r r err languageslang file_name task_name yaml_template yaml_detailsfrrrgen_lang_yamls s            rXcCs`t}|jddddd|jdddd |jd d gd d d|}t|j|j|jddS)z9Parse CLI args and generate language-specific yaml files.z --overwriteT store_truez%Overwrite files if they already exist)defaultactionhelpz --output-dirz./directz Directory to write yaml files to)rZr\z--modeprompt_4)prompt_1prompt_2prompt_3r]prompt_5z Prompt number)rZchoicesr\)r r r N)argparseArgumentParser add_argument parse_argsrXr r r )parserargsrrrmainMs(ri__main__)rN) rcrFrJrstrboolrXrirrrrrs A