o i@sdZddlZddlZddlZeeZiZdZ dZ ddZ ddZ d d Z d d Zd dZddZddZddZddZe dfddZe dee dee dee dedS)z=Implements the compression layer of the `smart_open` library.Ndisableinfer_from_extensioncCsttgtS)z}Return the list of supported compression types available to open. See compression paratemeter to smart_open.open(). )NO_COMPRESSIONINFER_FROM_EXTENSIONget_supported_extensionsrrJ/home/ubuntu/.local/lib/python3.10/site-packages/smart_open/compression.pyget_supported_compression_typessr cCs ttS)zLReturn the list of file extensions for which we have registered compressors.)sorted_COMPRESSOR_REGISTRYkeysrrrrr"s rcCsD|r|ddkstd||}|tvrtd||t|<dS)alRegister a callback for transparently decompressing files with a specific extension. Parameters ---------- ext: str The extension. Must include the leading period, e.g. `.gz`. callback: callable The callback. It must accept two position arguments, file_obj and mode. This function will be called when `smart_open` is opening a file with the specified extension. Examples -------- Instruct smart_open to use the `lzma` module whenever opening a file with a .xz extension (see README.rst for the complete example showing I/O): >>> def _handle_xz(file_obj, mode): ... import lzma ... return lzma.LZMAFile(filename=file_obj, mode=mode) >>> >>> register_compressor('.xz', _handle_xz) This is just an example: `lzma` is in the standard library and is registered by default. r.z,ext must be a string starting with ., not %rz.overriding existing compression handler for %rN) ValueErrorlowerr loggerwarning)extcallbackrrrregister_compressor's    rcs|jfdd}||_dS)aEnsure that closing the `outer` stream closes the `inner` stream as well. Deprecated: `smart_open.open().__exit__` now always calls `__exit__` on the underlying filestream. Use this when your compression library's `close` method does not automatically close the underlying filestream. See https://github.com/piskvorky/smart_open/issues/630 for an explanation why that is a problem for smart_open. csBzWrd}|dSdSr d}|ww)Nclose)argsfpinner outer_closerr close_bothWs    ztweak_close..close_bothNr)outerrrrrr tweak_closeJs  rcCs@|}d|vrd|vrt|}|Sd|vrd|vrt|}|S)Nbwr)ioBufferedWriterBufferedReader)file_objmoderesultrrr_maybe_wrap_bufferedcs  r(cC ddl}|j||d}t||SNr)filenamer&)bz2openr()r%r&r,r'rrr _handle_bz2m r.cCr)r*)gzipr-r()r%r&r0r'rrr _handle_gzipsr/r1cCsDddl}|jdkrddlm}nddlm}|j||d}t||S)Nr))zstd)r&)sys version_info compressionr4 backportsr-r()r%r&r5r4r'rrr _handle_zstdys    r9cCr)r*)lzmar-r()r%r&r:r'rrr _handle_xzr/r;c Cs|tkr|S|tkr/z |p|j}Wnttfy&td||YSwtj |\}}|t vr>| dr>t d|zt |}Wn tyO|YSw|||S)a Wrap `file_obj` with an appropriate [de]compression mechanism based on its file extension. If the filename extension isn't recognized, simply return the original `file_obj` unchanged. `file_obj` must either be a filehandle object, or a class which behaves like one. If `filename` is specified, it will be used to extract the extension. If not, the `file_obj.name` attribute is used as the filename. zRunable to transparently decompress %r because it seems to lack a string-like .name+z3transparent (de)compression unsupported for mode %r)rrnamerAttributeError TypeErrorrrospathsplitextr endswithrKeyError)r%r&r7r+_rrrrcompression_wrappers*     rFz.bz2z.gzz.zstz.xz)__doc__r"loggingos.pathr@ getLogger__name__rr rrr rrrr(r.r1r9r;rFrrrrs0 #   '