o 5tiR@sddlZddlZddlZddlZddlmZddlZddlm Z ddl m Z e e Z edZddZd d Zd d Zd dZddZddZdS)N)Path)Value) get_loggerz$---[\n\r]+([\S\s]*?)[\n\r]+---[\n\r]cCsVg}|D]$}d}t|tr#|jds|jdrd}n|jdkr#d}||q|S)a Maps metric feature types to input types for gradio Dataframes: - float/int -> numbers - string -> strings - any other -> json Note that json is not a native gradio type but will be treated as string that is then parsed as a json. jsonintfloatnumberstringstr) isinstancerdtype startswithappend) feature_types input_types feature_type input_typerI/home/ubuntu/.local/lib/python3.10/site-packages/evaluate/utils/gradio.pyinfer_gradio_input_typess    rcCsdd|DS)zMaps json input type to str.cSsg|] }|dkr dn|qS)rr r.0irrr )sz'json_to_string_type..r)rrrrjson_to_string_type'srcCsvtj|sdSt|d$}|}t|}|r)||d}Wd|SWd|S1s4wY|S)z(Parses a repositories README and removeszNo README.md found.rN)ospathexistsopenreadREGEX_YAML_BLOCKsearchend)filepathftextmatchrrr parse_readme,s     r)cCsi}|jdtjdd|jddt||D].\}}|dkr,dd||D||<q|dkr>dd||D||<q||||<q|S) z4Parses data from gradio Dataframe for use in metric.T)inplacercSsg|]}t|qSr)rloadsrdrrrr?z%parse_gradio_data..r cSsg|]}|dqS")stripr-rrrrAr/)replacenpnandropnazipto_list)datar metric_inputs feature_namerrrrparse_gradio_data8s r<cCst|dkrdSg}|D]C}g}t||D]-\}}|dkr*|dd||Dq|dkr;|dd||Dq|||q|ddt|Dq |S) z Parses test cases to be used in gradio Dataframe. Note that an apostrophe is added to strings to follow the format in json. rNrcSg|]}t|qSr)r relementrrrrSz$parse_test_cases..r cSsg|]}d|dqSr0rr>rrrrUscSr=r)listrrrrrXr@)lenr7r) test_cases feature_namesrexamples test_case parsed_casesfeatrrrrparse_test_casesGs rIc szddl}Wnty}ztd|d}~wwttjd}tjt r3t jd \}}n t j \}}t |fdd}|j ||jj|t|dtd|jjjdjjd d jt|d d }|dS) z%Launches `metric` widget with Gradio.rNzDTo create a metric widget with Gradio make sure gradio is installed.csjdit|S)Nr)computer<)r9gradio_input_typesmetricrrrJmsz%launch_gradio_widget..computer)headers col_count row_countdatatype)labelz If this is a text-based metric, make sure to wrap you input in double quotes. Alternatively you can use a JSON-formatted list as input.zMetric: z README.md)fninputsoutputs descriptiontitlearticle)gradio ImportErrorloggererrorrsysrr featuresrAr7itemsr InterfacerT DataframerBrrUTextboxnameinforVr)launch)rMgrr\ local_pathrDrrJifacerrKrlaunch_gradio_widget\s6       ri)rrrer]pathlibrnumpyr4datasetsrloggingr__name__r[compiler"rrr)r<rIrirrrrs