o 5tiU@s0ddlZddlZgdZiddddddd d d d d ddddddddddddddddddd d!d"d#d$d%d&iZiZeD]-Zedkr[d'd(d)eed*ee<qIedkrkd+d,d)eed*ee<qId-d.d)eed*ee<qId/d0Zd1ed2ed3ed4dfd5d6Z d:d7d8Z e d9kre dSdS);N)engamhibofrasnalinwolewelugxhokintwizulormyorhausotswarzThe answer is (\-?[0-9\.\,]+)ruመልሱ (\-?[0-9\.\,]+)ruAzịza ya bụ (\-?[0-9\.\,]+)ruLa réponse est(\-?[0-9\.\,]+)rz'Mhinduro kumubvunzo ndi (\-?[0-9\.\,]+)rzEyano ezali (\-?[0-9\.\,]+)rzTontu li (\-?[0-9\.\,]+)r uŋuɖoɖoae nye (\-?[0-9\.\,]+)r zAnsa eri (\-?[0-9\.\,]+)r zImpendulo ngu (\-?[0-9\.\,]+)r zIgisubizo ni (\-?[0-9\.\,]+)r uNe nnyiano yɛ (\-?[0-9\.\,]+)rzImpendulo ithi (\-?[0-9\.\,]+)rzDeebiin isaa (\-?[0-9\.\,]+)ru"Ìdáhùn náà ni (\-?[0-9\.\,]+)rzAmsar ita ce (\-?[0-9\.\,]+)rzKarabo ke (\-?[0-9\.\,]+)rzJibu ni (\-?[0-9\.\,]+)u ጥያቄ:u$በቅደም ተከተል መልስ:zAnswer:)QUESTIONANSWERDIRECTREGEXu Ìbéèrè:uÌdáhùn lẹ́sẹsẹ:z Question:zStep-by-Step Answer:cCsD|duriSddd|dddigdddd d d ddigdgiS) N filter_listz strict-matchregex)function regex_patternr take_first)namefilterzflexible-extractz(-?[$0-9.,]{2,})|(-?[0-9]+))rr group_select)rr!r!P/home/ubuntu/.local/lib/python3.10/site-packages/lm_eval/tasks/afrimgsm/utils.pyadd_regex_patternKs, r# output_dir overwritemodereturnc Cs\g}tD]}zd}i}d}|dkr*tdd}tdd} d} d|} d}|d krDt|d}t|d} d} d |} d }n]|d krlt|d }t|d} t|d} d|} t| }|dvridnd}n5|dkrtdd }tdd} tdd} d|} n|dkrtdd}tdd} d} d|} d}| d} tt|d d} t|d| |rdndddA}|dtj||| d|d | d!|d"d#| d$d%|d&| d'd(gd)d*i|rd+|ini|d,td-d.Wdn 1swYWqt y| | Yqwt|d/kr,t d0d1 |dS)2z Generate a yaml file for each language. :param output_dir: The directory to output the files to. :param overwrite: Whether to overwrite files if they already exist. cot_yamlNdirectrrrafrimgsm_direct_ direct_yaml direct-nativeafrimgsm_direct_native_direct_native_yaml native-cotrrafrimgsm_native_cot_)zhjaen-cotafrimgsm_en_cot_translate-directafrimgsm_translate_direct_translate_direct_yamlz.yaml/wxutf8)encodingz# Generated by utils.py z){% if answer is not none %}{{question+"\nz"}}{% else %}{{"z "+question+"\nz"}}{% endif %}z${% if answer is not none %}{{answer[z1:]}}{% else %}{{answer_number|string}}{% endif %})include dataset_nametask doc_to_text doc_to_targetgeneration_kwargszz <|im_end|>F)until do_sampletarget_delimiterTinf) allow_unicodewidthrzJFiles were not created because they already exist (use --overwrite flag): z, ) LANGUAGESkeysr#lenopenwriteyamldumpfloatFileExistsErrorappendjoin)r$r%r&errlang yaml_templater DELIMITERrrr task_name file_nameANSWER_TO_SKIPfr!r!r"gen_lang_yamlsms                   r^cCs`t}|jddddd|jdddd |jd d gd d d|}t|j|j|jddS)z9Parse CLI args and generate language-specific yaml files.z --overwriteF store_truez%Overwrite files if they already exist)defaultactionhelpz --output-dir.z Directory to write yaml files to)r`rbz--moder/)r)r,r/r4r6zMode of chain-of-thought)r`choicesrb)r$r%r&N)argparseArgumentParser add_argument parse_argsr^r$r%r&)parserargsr!r!r"mains$rk__main__)r'N) rerP languageslanguages_REGEXrKrWr#strboolr^rk__name__r!r!r!r"s         " V