o 7t¾iLã@s<ddlZdd„Zdd„Zdd„Zdd „Zd d „Zd d „ZdS)éNcCs t |¡S)N)ÚastÚ literal_eval)Ústring©rúV/home/ubuntu/.local/lib/python3.10/site-packages/lm_eval/tasks/race/preprocess_race.pyÚ process_asts rcCst|dƒdS)NÚproblemséÿÿÿÿ)r)ÚdocrrrÚ last_problemsr cCs&dddddœ}||d}|d|S)Nrééé©ÚAÚBÚCÚDÚanswerÚoptionsr)ÚproblemÚ letter_to_numrrrrÚget_answer_option s  rcs"t|ƒ‰‡fdd„tdƒDƒ}|S)Ncsg|]}ˆd|‘qS)rr)Ú.0Úi©rrrÚ sz!doc_to_choice..é)r Úrange)r ÚchoicesrrrÚ doc_to_choicesr cCs d|dd}t|dƒdd…D]3}|ddd…dkr/||dd d…t|ƒd 7}qd |dd }d t|ƒd }|||7}q|t|ƒd7}|S) Nz Article: Úarticlez rr Úquestioniúÿÿÿz _ .éûÿÿÿÚ z Question: zAnswer: )rrr )r Útextrr"rrrrÚ doc_to_texts"r&cCs"dddddœ}|t|ƒd}|S)Nrr r rrr)r )r rrrrrÚ doc_to_target%sr')rrr rr r&r'rrrrÚs