o 8wi- @sddlmZmZmZddlmZddlmZddlm Z ddl m Z ddl m Z e eZGd d d e Zd ed ed eeeefdeeeeffddZd ed ed eeeefdeeeeefffddZdS))AnyOptionalUnion) get_session)config) DatasetsError)"get_authentication_headers_for_url) get_loggerc@seZdZdZdS)DatasetViewerErrorzDataset viewer error. Raised when trying to use the dataset viewer HTTP API and when trying to access: - a missing dataset, or - a private/gated dataset and the user is not authenticated. - unavailable /parquet or /info responses N)__name__ __module__ __qualname____doc__rr[/home/ubuntu/sommelier/.venv/lib/python3.10/site-packages/datasets/utils/_dataset_viewer.pyr sr dataset commit_hashtokenreturnc CsDtjddd}zqtj||ttjd||ddd}|d|jvrq|jd|ks3|d ur]|}|d d urS|d d sS|dd sSd|vrS|dWSt d|dnt d|d|jddWtdWtdWtdt y}zt d|dt |j d|dWYd }~tdd }~ww)zn Get the dataset exported parquet files Docs: https://huggingface.co/docs/datasets-server/parquet ://://datasets-server.z/parquet?dataset= datasets/rY@urlheaderstimeout X-RevisionNpartialFpendingTfailed parquet_fileszParquet export for  is not completely ready yet.) is available but outdated (commit_hash='')zNo parquet export for available (: )z$No exported Parquet files available.r HF_ENDPOINTreplacergetr raise_for_statusrjsonloggerdebug Exceptiontyper r )rrrdataset_viewer_parquet_urlparquet_data_files_response parquet_data_files_response_jsonerrrget_exported_parquet_files@    .r9c CsDtjddd}zqtj||ttjd||ddd}|d|jvrq|jd|ks3|d ur]|}|d d urS|d d sS|dd sSd|vrS|dWSt d|dnt d|d|jddWtdWtdWtdt y}zt d|dt |j d|dWYd }~tdd }~ww)z Get the dataset information, can be useful to get e.g. the dataset features. Docs: https://huggingface.co/docs/datasets-server/info rrz/info?dataset=rrrrr Nr!Fr"Tr# dataset_infozDataset info for r%r&r'zNo dataset info for r(r)r*z$No exported dataset infos available.r+)rrrdataset_viewer_info_url info_responser8rrrget_exported_dataset_infos>r:r>N)typingrrrhuggingface_hub.utilsrr exceptionsr file_utilsr loggingr r r1r strboollistdictr9r>rrrrs4       $