o 6ti`@sddlZddZddZdS)NcCsR|dd}tt|dD]}|tj|d|d|d7}q|d7}|S)Nquestion optionsz. zAnswer:)rangelenstringascii_uppercase)doc doc_to_textir \/home/ubuntu/.local/lib/python3.10/site-packages/lm_eval/tasks/leaderboard/mmlu_pro/utils.pyr s $r cCsddtt|dDS)NcSsg|]}tj|qSr )rr).0r r r r sz!doc_to_choice..r)rr)r r r r doc_to_choicesr)rr rr r r r s