o im@sddlmZddlZddlZddlmZmZddlmZddl m Z m Z m Z ddl mZmZddlmZddlmZd ZGd d d eZGd d d eZeZGdddeZGdddZGdddZGdddZdS)) annotationsN)ABCabstractmethod)Callable) InputFile InputStream OutputFile) TableMetadataTableMetadataUtil)UTF8)Configgzipc@s6eZdZedddZeddd Zedd d Zd S) CompressorlocationstrreturncCs|drtStS)Nz.gz.metadata.json)endswithGzipCompressorNOOP_COMPRESSORrrS/home/ubuntu/transcripts/venv/lib/python3.10/site-packages/pyiceberg/serializers.pyget_compressor!szCompressor.get_compressorinprcCdS)zReturn a stream decompressor. Args: inp: The input stream that needs decompressing. Returns: The wrapped stream Nrselfrrrrstream_decompressor%zCompressor.stream_decompressorCallable[[bytes], bytes]cCr)zzReturn a function to compress bytes. Returns: A function that can be used to compress bytes. Nrrrrrbytes_compressor0rzCompressor.bytes_compressorN)rrrrrrrrrr)__name__ __module__ __qualname__ staticmethodrrrr!rrrrr s   rc@ eZdZd ddZd ddZd S) NoopCompressorrrrcCs|SNrrrrrr:sz"NoopCompressor.stream_decompressorrcCsddS)NcSs|Sr*r)brrr>rz1NoopCompressor.bytes_compressor..rr rrrr!=szNoopCompressor.bytes_compressorNr"r#r$r%r&rr!rrrrr)9 r)c@r() rrrrcCs t|Sr*)r openrrrrrEs z"GzipCompressor.stream_decompressorrcCstjSr*)r compressr rrrr!HszGzipCompressor.bytes_compressorNr"r#r-rrrrrDr.rc@s$eZdZdZeeefd d d Zd S)FromByteStreamzKA collection of methods that deserialize dictionaries into Iceberg objects. byte_streamrencodingr compressionrrr cCsN||}t|}||}|}Wdn1swYt|S)a Instantiate a TableMetadata object from a byte stream. Args: byte_stream: A file-like byte stream object. encoding (default "utf-8"): The byte encoder to use for the reader. compression: Optional compression method N)rcodecs getreaderreadr parse_raw)r2r3r4reader json_bytesmetadatarrrtable_metadataOs   zFromByteStream.table_metadataN)r2rr3rr4rrr )r$r%r&__doc__r'r rr<rrrrr1Ls r1c@s"eZdZdZeefd dd Zd S) FromInputFilezIA collection of methods that deserialize InputFiles into Iceberg objects. input_filerr3rrr cCsF|}tj||tj|jddWdS1swYdS)aKCreate a TableMetadata instance from an input file. Args: input_file (InputFile): A custom implementation of the iceberg.io.file.InputFile abstract base class. encoding (str): Encoding to use when loading bytestream. Returns: TableMetadata: A table metadata instance. r)r2r3r4N)r/r1r<rrr)r?r3 input_streamrrrr<es $zFromInputFile.table_metadataN)r?rr3rrr )r$r%r&r=r'r r<rrrrr>bsr>c@s eZdZdZeddd d Zd S) ToOutputFilez_A collection of methods that serialize Iceberg objects into files given an OutputFile instance.Fr;r output_filer overwriteboolrNonecCsv|j|d+}tdrdnd}|j|dt}t|j |}| |WddS1s4wYdS)a#Write a TableMetadata instance to an output file. Args: output_file (OutputFile): A custom implementation of the iceberg.io.file.OutputFile abstract base class. overwrite (bool): Where to overwrite the file if it already exists. Defaults to `False`. )rCzlegacy-current-snapshot-idFT) exclude_noneN) creater get_boolmodel_dump_jsonencoder rrrr!write)r;rBrC output_streamrFr:rrrr<zs  "zToOutputFile.table_metadataN)F)r;r rBrrCrDrrE)r$r%r&r=r'r<rrrrrAwsrA) __future__rr5r abcrrcollections.abcr pyiceberg.iorrrpyiceberg.table.metadatar r pyiceberg.typedefr pyiceberg.utils.configr GZIPrr)rrr1r>rArrrrs"