o ò.Ðiˆã@s˜ddlZddlmZddlmZddlZddlmZGdd„deƒZGdd„deƒZ Gd d „d eƒZ Gd d „d eƒZ Gd d„deƒZ Gdd„deƒZ dS)éN)Úpartial)ÚOptional)ÚAbstractArchiveFileSystemcs¦eZdZUdZdZdZeed<dZeed<dZ eed< ddede ed e e f‡fd d „ Z e ‡fd d „ƒZdd„Zdefdd„Z    ddedefdd„Z‡ZS)ÚBaseCompressedFileFileSystemzFRead contents of compressed file as a filesystem with one file inside.ÚNÚprotocolÚ compressionÚ extensionÚfoÚtarget_protocolÚtarget_optionsc s¶tƒj|fi|¤Žt|dƒr| ¡n||_ttj|jfd||jdddœ|p'i  di¡¥dœ|p1i¤Ž|_ t j   |j d¡d ¡|_d |jvrR|jd |j d ¡…n|j|_d |_d S) aÞ The compressed file system can be instantiated from any compressed file. It reads the contents of compressed file as a filesystem with one file inside, as if it was an archive. The single file inside the filesystem is named after the compresssed file, without the compression extension at the end of the filename. Args: fo (:obj:``str``): Path to compressed file. Will fetch file using ``fsspec.open()`` mode (:obj:``str``): Currently, only 'rb' accepted target_protocol(:obj:``str``, optional): To override the FS protocol inferred from a URL. target_options (:obj:``dict``, optional): Kwargs passed when instantiating the target FS. Ú __fspath__ÚrbFT)Úrequote_redirect_urlÚ trust_envÚ client_kwargs)Úmoderrrz::rÚ.N)ÚsuperÚ__init__Úhasattrr r rÚfsspecÚopenrÚpopÚ_open_with_fsspecÚosÚpathÚbasenameÚsplitÚcompressed_nameÚrindexÚuncompressed_nameÚ dir_cache)Úselfr r r Úkwargs©Ú __class__©úT/home/ubuntu/.local/lib/python3.10/site-packages/datasets/filesystems/compression.pyrs.þþýú õ ÿý z%BaseCompressedFileFileSystem.__init__cstƒ |¡ d¡S)Nú/)rÚ_strip_protocolÚlstrip)Úclsrr%r'r(r*;sz,BaseCompressedFileFileSystem._strip_protocolcCs@|jduri| ¡j |j¡¥d|ji¥}|d|i|_dSdS)NÚname)r"rÚfsÚinfor r!)r#Úfr'r'r(Ú _get_dirs@s  þz&BaseCompressedFileFileSystem._get_dirsrcCs8| ¡ ¡ }| ¡WdƒS1swYdS)N)rrÚread)r#rr0r'r'r(ÚcatEs$ÿz BaseCompressedFileFileSystem.catrTrcKs6| |¡}|dkrtd|›d|j›dƒ‚| ¡ ¡S)NrzTried to read with mode z on file z opened with mode 'rb')r*Ú ValueErrorr rr)r#rrÚ block_sizeÚ autocommitÚ cache_optionsr$r'r'r(Ú_openIs  z"BaseCompressedFileFileSystem._open)rNN)rNTN)Ú__name__Ú __module__Ú __qualname__Ú__doc__Ú root_markerrÚstrÚ__annotations__rr rÚdictrÚ classmethodr*r1r3r8Ú __classcell__r'r'r%r(r s8  ÿ  ÿÿÿÿ(úþýrc@óeZdZdZdZdZdZdS)Ú Bz2FileSystemz?Read contents of BZ2 file as a filesystem with one file inside.Úbz2z.bz2N©r9r:r;r<rrr r'r'r'r(rDXó rDc@rC)ÚGzipFileSystemz@Read contents of GZIP file as a filesystem with one file inside.Úgzipz.gzNrFr'r'r'r(rH`rGrHc@rC)Ú Lz4FileSystemz?Read contents of LZ4 file as a filesystem with one file inside.Úlz4z.lz4NrFr'r'r'r(rJhrGrJc@rC)Ú XzFileSystemzFRead contents of .xz (LZMA) file as a filesystem with one file inside.Úxzz.xzNrFr'r'r'r(rLprGrLc@rC)ÚZstdFileSystemzK Read contents of .zstd file as a filesystem with one file inside. Úzstdz.zstNrFr'r'r'r(rNxs rN)rÚ functoolsrÚtypingrrÚfsspec.archiverrrDrHrJrLrNr'r'r'r(Ús   O