o 6ti@s*ddlZddZdefddZddZdS) NcCs`t|d}|d|dg}ddg}||||d||dgt|ddkd}|S)Nactivitybaseliner) scenarioslabel)randomRandomshuffleintindex)docrndrorderingrX/home/ubuntu/.local/lib/python3.10/site-packages/lm_eval/tasks/hendrycks_ethics/utils.py _preproc_docs rreturncCs*t|}d|ddd|dddS)Nz Scenario 1: rrz Scenario 2: rz, Question: Is Scenario 1 preferable? Answer:rr rrr doc_to_texts"rcCst|}|dS)Nrrrrrr doc_to_targetsr)rrstrrrrrrrs