o 6ti^@s ddlmZddZddZdS))weighted_f1_scorecCsd}|j|d|dd}|S)NaPlease identify whether the premise entails or contradicts the hypothesis in the following premise and hypothesis. The answer should be exact entailment, contradiction, or neutral. Premise: {premise} Hypothesis: {hypothesis} Is it entailment, contradiction, or neutral?premise hypothesis)rr)format)docoutputtextr b/home/ubuntu/.local/lib/python3.10/site-packages/lm_eval/tasks/afrixnli/lai prompt/direct/utils.py doc_to_textsr cCsdddd}||dS)N entailmentneutral contradiction)rlabelr )r replacementsr r r doc_to_targets  rN) lm_eval.utilsrr rr r r r s