o 6ti>@sddlZddZddZdS)NcCst|d}|S)Nchoices)ast literal_eval)docrrP/home/ubuntu/.local/lib/python3.10/site-packages/lm_eval/tasks/afrimmlu/utils.py doc_to_choicesrcCsDd}t|d}|j|d|d|d|d|d|dd }|S) NaYou are a highly knowledgeable and intelligent artificial intelligence model answers multiple-choice questions about '{subject}' Question: '''{question}''' Choices: A: ''{choice1}''' B: ''{choice2}''' C: ''{choice3}''' D: ''{choice4}''' Answer: rsubjectquestionr)r r choice1choice2choice3choice4)rrformat)routputrtextrrr doc_to_text s r)rrrrrrrs