o 7t¾iŸã@sþddlmZddlZzddlZWn eyedƒ‚wdeededefdd„Z ddeededefd d „Z ddeededefd d„Z ddeededefdd„Z ddeededefdd„Z ddeededefdd„Zd deededefdd„ZdS)!é)ÚListNz—`tinyBenchmarks` is required for tinyBenchmarks task metric calculation, install via `pip install git+https://github.com/felipemaiapolo/tinyBenchmarks`ÚitemsÚ benchmarkÚreturncCó"t |¡}t ||¡}||dS)NÚpirt©ÚnpÚarrayÚtbÚevaluate©rrÚ predictions©rú^/home/ubuntu/.local/lib/python3.10/site-packages/lm_eval/tasks/tinyBenchmarks/agg_functions.pyÚagg_pirtó   rÚarccCr©NÚgpirtrr rrrÚ agg_gpirt_arcrrÚgsm8kcCrrrr rrrÚagg_gpirt_gsm8krrÚ hellaswagcCrrrr rrrÚagg_gpirt_hellaswag!rrÚmmlucCrrrr rrrÚagg_gpirt_mmlu'rrÚ truthfulqacCrrrr rrrÚagg_gpirt_truthfulqa-rrÚ winograndecCrrrr rrrÚagg_gpirt_winogrande3rr )r)r)r)r)r)r)ÚtypingrÚnumpyr ÚtinyBenchmarksr ÚModuleNotFoundErrorÚfloatÚstrrrrrrrr rrrrÚs   ÿÿ