o 6ti@s0dZddddddZgdZdd Zd d Zd S) zBThis is a {}. Select the correct answer! Question: {} {} Answer:zprimary schoolz middle schoolz high school university professional)PrimaryMiddleHighUnivProf)zA.zB.zC.zD.zE.c Cs|dsdndt|d}|dsdnd|d}|dd||}|ds-|d n |dd |d }g}tgd D]\}}||sJn|t|d ||q@t||d |}|S)z Refactoring `prepare_data_en` to fit with the lm harness framework. https://github.com/mbzuai-nlp/ArabicMMLU/blob/main/util_prompt.py Levelz for Countryz in Subjectz questionContextQuestionz )zOption 1zOption 2zOption 3zOption 4zOption 5  )level_en enumerateappendalpaPROMPTformatjoin) doclevelcountrymain_meta_dataquestionoptionsioptdoc_textr R/home/ubuntu/.local/lib/python3.10/site-packages/lm_eval/tasks/arabicmmlu/utils.py doc_to_texts   r"csfddtdDS)Ncs*g|]}d|drt|dqS)zOption )r).0rrr r! ,s*z!doc_to_choice..)ranger&r r&r! doc_to_choice+sr*N)rrrr"r*r r r r!s