o 6ti  @sdZddlmmZddlZddlmZeZdgZ e D]@Z eeD]9Z z)e de de dej de e dZe d e de ded e d [Wq$ey]ZzedZ[wwqdS) a A utility script that pushes all Bigbench subtasks from their form in the `bigbench` HF dataset into `{org name}/bigbench`. Prior to running, log into HF Hub for the target HF hub org via `huggingface-cli login`. Requires the installation of `pip install "bigbench @ https://storage.googleapis.com/public_research_data/bigbench/bigbench-0.0.1.tar.gz"` and is included so that the bigbench dependency can be avoided. N)tqdmz Loading 'z' with num_shots=z...bigbench)name num_shotsz Pushing 'zhails/bigbench _zero_shot)__doc__bigbench.api.utilapiutilbb_utilsdatasetsrget_all_json_task_namesall_task_namesrshots task_nameprint load_datasettask_ds push_to_hub Exceptionerr`/home/ubuntu/.local/lib/python3.10/site-packages/lm_eval/tasks/bigbench/push_bigbench_dataset.pys(