o 5ti@szddlZddlZddlZddlmZddlmZddlmZm Z m Z ddl m Z e e ZdZddZe d kr;edSdS) N)Path) cookiecutter)HfApi Repository create_repo) get_loggeraA new repository for your module "{module_name}" of type "{module_type}" has been created at {output_dir} and pushed to the Hugging Face Hub: {repo_url}. Here are the next steps: - implement the module logic in {module_slug}/{module_slug}.py - document your module in {module_slug}/README.md - add test cases for your module in {module_slug}/tests.py - if your module has any dependencies update them in {module_slug}/requirements.txt You can test your module's widget locally by running: ``` python {output_dir}/{module_slug}/app.py ``` When you are happy with your changes you can push your changes with the following commands to the Hugging Face Hub: ``` cd {output_dir}/{module_slug} git add . git commit -m "Updating module" git push ``` You should then see the update widget on the Hugging Face Hub: {repo_url} And you can load your module in Python with the following code: ``` from evaluate import load module = load("{namespace}/{module_slug}") ``` c Cstjddd}|}|jddd}|jdtdd |jd d td d |jddtdd |jdtdd |jdttdd |jddtdd |jddddt| }|ddvr`t dd|dvrjt dt|d }|d!}|d d"d#}|durt }|d$}n|}||d%<d&|d'|} zt|d'|d(d)|d*d+Wnty} ztd,|d'|d-| d} ~ wwtjd.| tjtjd/d0|tjd1t||d2} td3d4d/||d/d5| | d6| tt j!|d|d||| |d7dS)8NzHuggingFace Evaluate CLI toolzevaluate-cli [])usagecreatezCreate new evaluation module.)help module_namezEPretty name of new evaluation module, e.g. "Recall" or "Exact Match".)typer z --module_typemetriczAType of module, has to be one of [metric|comparison|measurement].)defaultr r z--dataset_namez9Name of dataset if evaluation module is dataset specific.z--module_descriptionz'Short description of evaluation module.z --output_dirzPath to output directory.z--organizationz5Organization on the Hub to push evaluation module to.z --private store_truez-Sets evaluation module repository to private.)actionr module_type)r comparison measurementzEThe module_type needs to be one of metric, comparison, or measurement-z.Hyphens ('-') are not allowed in module names. output_dir organization _name namespacezhttps://huggingface.co/spaces//spacegradioprivate) repo_type space_sdkrz2Could not create Space for module at hf.co/spaces/z.. Make sure this space does not exist already.z git clone Tzutf-8)stderrstdoutcheckencodingcwdenv) local_dirz(https://github.com/huggingface/evaluate/ templates) directoryno_input extra_contextroverwrite_if_existszadd module default template)r r module_slugrrepo_urlr)"argparseArgumentParseradd_subparsers add_parser add_argumentstrrr&vars parse_args ValueErrorlowerreplacerwhoamir Exceptionloggererror subprocessrunsplitPIPEosenvironcopyrrgit_add git_commitgit_pushprint INSTRUCTIONSformat) parser subparsers parser_createargsrrr.hfapirr/ exceptionreporSR/home/ubuntu/.local/lib/python3.10/site-packages/evaluate/commands/evaluate_cli.pymain0s        rU__main__)r0rCr?pathlibrcookiecutter.mainrhuggingface_hubrrrevaluate.utils.loggingr__name__r=rJrUrSrSrSrTs   "X