o ˳iݛ@sUddlmZddlZddlZddlZddlZddlmZmZddl m Z ddl m Z ddl mZddlmZmZmZddlmZmZmZmZmZdd lmZmZdd lmZdd lmZm Z dd l!m"Z"dd l#m$Z$ddl%m&Z&m'Z'm(Z(m)Z)m*Z*m+Z+ddl,m-Z-ddl.m/Z/m0Z0m1Z1ddl2m3Z3m4Z4ddl5m6Z6m7Z7m8Z8ddl9m:Z:m;Z;mZ>ddl?m@Z@mAZAddlBmCZCerddlDZEeFeGZHe@ZIdZJdZKdZLdZMdZNdZOdZPdZQdZRdZSd ZTd!ZUd"ZVd#ZWd$ZXd%ZYeZd&ej[Z\Gd'd(d(eZ]d`d/d0Z^d`d1d2Z_d`d3d4Z`d`d5d6Zad`d7d8Zbd`d9d:Zcd`d;d<Zde]jee^e]jfe_e]jge`e]jheae]jiebe]jjece]jkediZld=emd><dadBdCZndbdcdFdGZodddIdJZpdedQdRZqdfdUdVZrdgdYdZZse Gd[d\d\ZtGd]d.d.eZuGd^d_d_eueZvdS)h) annotationsN)ABCabstractmethod)Callable) dataclass)Enum) TYPE_CHECKINGAnycast)NamespaceAlreadyExistsErrorNoSuchNamespaceErrorNoSuchTableErrorNotInstalledErrorTableAlreadyExistsError)FileIO load_file_io) ManifestFile)UNPARTITIONED_PARTITION_SPEC PartitionSpec)Schema) ToOutputFile)$DOWNCAST_NS_TIMESTAMP_TO_US_ON_WRITECommitTableResponseCreateTableTransaction StagedTableTableTableProperties)load_location_provider) TableMetadataTableMetadataV1new_table_metadata)UNSORTED_SORT_ORDER SortOrder)TableRequirement TableUpdateupdate_table_metadata) EMPTY_DICT Identifier Properties RecursiveDict TableVersion)Config merge_config)property_as_booltokentypezpy-catalog-impliceberg table_type warehousemetadata_locationprevious_metadata_locationmanifestz manifest listzprevious metadatametadataurilocationEXTERNAL_TABLEbotocore_sessionz (\d+) # version number - # separator ([\w-]{36}) # UUID (36 characters, including hyphens) (?:\.\w+)? # optional codec name \.metadata\.json # file extension c@s(eZdZdZdZdZdZdZdZdZ dS) CatalogTyperesthivegluedynamodbsqlz in-memorybigqueryN) __name__ __module__ __qualname__RESTHIVEGLUEDYNAMODBSQL IN_MEMORYBIGQUERYrLrLN/home/ubuntu/.local/lib/python3.10/site-packages/pyiceberg/catalog/__init__.pyr;lsr;namestrconfr(returnCatalogcCsddlm}||fi|S)Nr) RestCatalog)pyiceberg.catalog.restrS)rNrPrSrLrLrM load_restvs rUc CBzddlm}||fi|WSty }ztd|d}~ww)Nr) HiveCatalogz@Apache Hive support not installed: pip install 'pyiceberg[hive]')pyiceberg.catalog.hiverW ImportErrorr)rNrPrWexcrLrLrM load_hive|  r[c CrV)Nr) GlueCatalogz=AWS glue support not installed: pip install 'pyiceberg[glue]')pyiceberg.catalog.gluer]rYr)rNrPr]rZrLrLrM load_gluer\r_c CrV)Nr)DynamoDbCatalogzEAWS DynamoDB support not installed: pip install 'pyiceberg[dynamodb]')pyiceberg.catalog.dynamodbr`rYr)rNrPr`rZrLrLrM load_dynamodbr\rbc CrV)Nr) SqlCatalogznSQLAlchemy support not installed: pip install 'pyiceberg[sql-postgres]' or pip install 'pyiceberg[sql-sqlite]')pyiceberg.catalog.sqlrcrYr)rNrPrcrZrLrLrMload_sqls rec CrV)Nr)InMemoryCatalogzESQLAlchemy support not installed: pip install 'pyiceberg[sql-sqlite]')pyiceberg.catalog.memoryrfrYr)rNrPrfrZrLrLrMload_in_memoryr\rhc CrV)Nr)BigQueryMetastoreCatalogzABigQuery support not installed: pip install 'pyiceberg[bigquery]')$pyiceberg.catalog.bigquery_metastorerirYr)rNrPrirZrLrLrM load_bigqueryr\rkz7dict[CatalogType, Callable[[str, Properties], Catalog]]AVAILABLE_CATALOGScatalog_propertiesr)CatalogType | NonecCs||t}r4t|tr+|drtjS|drtjS|dr$tjSt d|t dt |t d| d)a=Try to infer the type based on the dict. Args: name: Name of the catalog. catalog_properties: Catalog properties. Returns: The inferred type based on the provided properties. Raises: ValueError: Raises a ValueError in case properties are missing, or the wrong type. httpthrift)sqlite postgresqlz/Could not infer the catalog type from the uri: z%Expects the URI to be a string, got: z_URI missing, please provide using --uri, the config or environment variable PYICEBERG_CATALOG____URI) getURI isinstancerO startswithr;rErFrI ValueErrorr/upper)rNrmr7rLrLrMinfer_catalog_types    rz str | None propertiescKs|durt}t|}t|pitt|}|t}|t}rF|r/t d|d|t |||}r?t d||St d|d}|rVt |trVt|}n|s]t||}|rmt||ttttf|St d|)aLoad the catalog based on the properties. Will look up the properties from the config, based on the name. Args: name: The name of the catalog. properties: The properties that are used next to the configuration. Returns: An initialized Catalog. Raises: ValueError: Raises a ValueError in case properties are missing or malformed, or if it could not determine the catalog based on the properties. NzRMust not set both catalog type and py-catalog-impl configurations, but found type z and py-catalog-impl zLoaded Catalog: %sCould not initialize Catalog: zd?ZeddAdBZedddDdEZeddFdGZeddHdIZede fddMdNZeddOdPZeddRdSZ eddTdUZ!eddVdWZ"ee#fddZd[Z$dd\d]Z%ee#fdd^d_Z&ee#fddbdcZ'e dfddedfZ(ee)j*fddjdkZ+eddpdqZ,ddrdsZ-ddtduZ.dd|d}Z/dd~dZ0dS)rRaTBase Catalog for table operations like - create, drop, load, list and others. The catalog table APIs accept a table identifier, which is fully classified table name. The identifier can be a string or tuple of strings. If the identifier is a string, it is split into a tuple on '.'. If it is a tuple, it is used as-is. The catalog namespace APIs follow a similar convention wherein they also accept a namespace identifier that can be a string or tuple of strings. Attributes: name (str): Name of the catalog. properties (Properties): Catalog properties. rOrNr(r|cKs||_||_dSr)rNr|selfrNr|rLrLrM__init___s zCatalog.__init__N identifierstr | IdentifierschemaSchema | pa.Schemar8r{partition_specr sort_orderr"rQrcCdS)abCreate a table. Args: identifier (str | Identifier): Table identifier. schema (Schema): Table's schema. location (str | None): Location for the table. Optional Argument. partition_spec (PartitionSpec): PartitionSpec for the table. sort_order (SortOrder): SortOrder for the table. properties (Properties): Table properties that can be a string based dictionary. Returns: Table: the created table instance. Raises: TableAlreadyExistsError: If a table with the name already exists. NrLrrrr8rrr|rLrLrM create_tableczCatalog.create_tablercCr)a*Create a CreateTableTransaction. Args: identifier (str | Identifier): Table identifier. schema (Schema): Table's schema. location (str | None): Location for the table. Optional Argument. partition_spec (PartitionSpec): PartitionSpec for the table. sort_order (SortOrder): SortOrder for the table. properties (Properties): Table properties that can be a string based dictionary. Returns: CreateTableTransaction: createTableTransaction instance. NrLrrLrLrMcreate_table_transaction~rz Catalog.create_table_transactioncCs4z |||||||WSty||YSw)abCreate a table if it does not exist. Args: identifier (str | Identifier): Table identifier. schema (Schema): Table's schema. location (str | None): Location for the table. Optional Argument. partition_spec (PartitionSpec): PartitionSpec for the table. sort_order (SortOrder): SortOrder for the table. properties (Properties): Table properties that can be a string based dictionary. Returns: Table: the created table instance if the table does not exist, else the existing table instance. )rr load_tablerrLrLrMcreate_table_if_not_existss  z"Catalog.create_table_if_not_existscCr)aLoad the table's metadata and returns the table instance. You can also use this method to check for table existence using 'try catalog.table() except NoSuchTableError'. Note: This method doesn't scan data stored in the table. Args: identifier (str | Identifier): Table identifier. Returns: Table: the table instance with its metadata. Raises: NoSuchTableError: If a table with the name does not exist. NrLrrrLrLrMrrzCatalog.load_tableboolcCr)zCheck if a table exists. Args: identifier (str | Identifier): Table identifier. Returns: bool: True if the table exists, False otherwise. NrLrrLrLrM table_existsrzCatalog.table_existscCr)zCheck if a view exists. Args: identifier (str | Identifier): View identifier. Returns: bool: True if the view exists, False otherwise. NrLrrLrLrM view_existsrzCatalog.view_exists namespacecCr)Check if a namespace exists. Args: namespace (str | Identifier): Namespace identifier. Returns: bool: True if the namespace exists, False otherwise. NrLrrrLrLrMnamespace_existsrzCatalog.namespace_existsr3cCr)aiRegister a new table using existing metadata. Args: identifier (Union[str, Identifier]): Table identifier for the table metadata_location (str): The location to the metadata Returns: Table: The newly registered table Raises: TableAlreadyExistsError: If the table already exists NrL)rrr3rLrLrMregister_tablerzCatalog.register_tablercCr)zDrop a table. Args: identifier (str | Identifier): Table identifier. Raises: NoSuchTableError: If a table with the name does not exist. NrLrrLrLrM drop_tablerzCatalog.drop_tablecCr)apDrop a table and purge all data and metadata files. Note: This method only logs warning rather than raise exception when encountering file deletion failure. Args: identifier (str | Identifier): Table identifier. Raises: NoSuchTableError: If a table with the name does not exist, or the identifier is invalid. NrLrrLrLrM purge_tablerzCatalog.purge_tablefrom_identifier to_identifiercCr)awRename a fully classified table name. Args: from_identifier (str | Identifier): Existing table identifier. to_identifier (str | Identifier): New table identifier. Returns: Table: the updated table instance with its metadata. Raises: NoSuchTableError: If a table with the name does not exist. NrL)rrrrLrLrM rename_table rzCatalog.rename_tabletable requirementstuple[TableRequirement, ...]updatestuple[TableUpdate, ...]rcCr)aiCommit updates to a table. Args: table (Table): The table to be updated. requirements: (Tuple[TableRequirement, ...]): Table requirements. updates: (Tuple[TableUpdate, ...]): Table updates. Returns: CommitTableResponse: The updated metadata. Raises: NoSuchTableError: If a table with the given identifier does not exist. CommitFailedException: Requirement not met, or a conflict with a concurrent commit. CommitStateUnknownException: Failed due to an internal exception on the side of the catalog. NrL)rrrrrLrLrM commit_tablerzCatalog.commit_tablecCr)aGCreate a namespace in the catalog. Args: namespace (str | Identifier): Namespace identifier. properties (Properties): A string dictionary of properties for the given namespace. Raises: NamespaceAlreadyExistsError: If a namespace with the given name already exists. NrLrrr|rLrLrMcreate_namespace.rzCatalog.create_namespacecCs(z |||WdStyYdSw)zCreate a namespace if it does not exist. Args: namespace (str | Identifier): Namespace identifier. properties (Properties): A string dictionary of properties for the given namespace. N)rr rrLrLrMcreate_namespace_if_not_exists:s  z&Catalog.create_namespace_if_not_existscCr)aDrop a namespace. Args: namespace (str | Identifier): Namespace identifier. Raises: NoSuchNamespaceError: If a namespace with the given name does not exist. NamespaceNotEmptyError: If the namespace is not empty. NrLrrLrLrMdrop_namespaceFrzCatalog.drop_namespacelist[Identifier]cCr)aHList tables under the given namespace in the catalog. Args: namespace (str | Identifier): Namespace identifier to search. Returns: List[Identifier]: list of table identifiers. Raises: NoSuchNamespaceError: If a namespace with the given name does not exist. NrLrrLrLrM list_tablesRrzCatalog.list_tablesrLcCr)a|List namespaces from the given namespace. If not given, list top-level namespaces from the catalog. Args: namespace (str | Identifier): Namespace identifier to search. Returns: List[Identifier]: a List of namespace identifiers. Raises: NoSuchNamespaceError: If a namespace with the given name does not exist. NrLrrLrLrMlist_namespaces`rzCatalog.list_namespacescCr)aGList views under the given namespace in the catalog. Args: namespace (str | Identifier): Namespace identifier to search. Returns: List[Identifier]: list of table identifiers. Raises: NoSuchNamespaceError: If a namespace with the given name does not exist. NrLrrLrLrM list_viewsnrzCatalog.list_viewscCr)a+Get properties for a namespace. Args: namespace (str | Identifier): Namespace identifier. Returns: Properties: Properties for the given namespace. Raises: NoSuchNamespaceError: If a namespace with the given name does not exist. NrLrrLrLrMload_namespace_properties|rz!Catalog.load_namespace_propertiesremovalsset[str] | NonercCr)aRemove provided property keys and updates properties for a namespace. Args: namespace (str | Identifier): Namespace identifier. removals (Set[str]): Set of property keys that need to be removed. Optional Argument. updates (Properties): Properties to be updated for the given namespace. Raises: NoSuchNamespaceError: If a namespace with the given name does not exist. ValueError: If removals and updates have overlapping keys. NrL)rrrrrLrLrMupdate_namespace_propertiesrz#Catalog.update_namespace_propertiescCr)zDrop a view. Args: identifier (str | Identifier): View identifier. Raises: NoSuchViewError: If a view with the given name does not exist. NrLrrLrLrM drop_viewrzCatalog.drop_viewr'cCst|tr|Stt|dS)aAParse an identifier to a tuple. If the identifier is a string, it is split into a tuple on '.'. If it is a tuple, it is used as-is. Args: identifier (str | Identifier): an identifier, either a string or tuple of strings. Returns: Identifier: a tuple of strings. r)rvtuplerOrrrLrLrMidentifier_to_tuples zCatalog.identifier_to_tuplecCst|dS)zExtract table name from a table identifier. Args: identifier (str | Identifier): a table identifier. Returns: str: Table name. rrRrrrLrLrMtable_name_froms zCatalog.table_name_fromcCst|ddS)zExtract table namespace from a table identifier. Args: identifier (Union[str, Identifier]): a table identifier. Returns: Identifier: Namespace identifier. NrrrrLrLrMnamespace_froms zCatalog.namespace_fromerr-type[ValueError] | type[NoSuchNamespaceError]cCsLt|}t|dkr|dtdd|Dr|dddd|DS)aITransform a namespace identifier into a string. Args: identifier (Union[str, Identifier]): a namespace identifier. err (Union[Type[ValueError], Type[NoSuchNamespaceError]]): the error type to raise when identifier is empty. Returns: Identifier: Namespace identifier. zEmpty namespace identifiercss|] }|dkVqdS)Nstrip.0segmentrLrLrM sz.Catalog.namespace_to_string..zPNamespace identifier contains an empty segment or a segment with only whitespacercss|]}|VqdSrrrrLrLrMrs)rRrranyrrrtuple_identifierrLrLrMnamespace_to_strings zCatalog.namespace_to_stringcCr)z8Check if the catalog supports server-side scan planning.FrLrrLrLrMsupports_server_side_planningsz%Catalog.supports_server_side_planningcCs,t|}t|dkr|d||dS)Nrz=Invalid database, hierarchical namespaces are not supported: rrRrrrrLrLrMidentifier_to_databases  zCatalog.identifier_to_databaseFtype[ValueError] | type[NoSuchTableError] | type[NoSuchNamespaceError]tuple[str, str]cCs4t|}t|dkr|d||d|dfS)Nrz9Invalid path, hierarchical namespaces are not supported: rrrrrLrLrM identifier_to_database_and_tables  z(Catalog.identifier_to_database_and_tablercCsti|j||Sr)rr|)rr|r8rLrLrM _load_file_ioszCatalog._load_file_ioformat_versionr*rcCst|tr|Sz(ddl}ddlm}m}ttpd}t||jr.|||||d}|WSWn t y8Ynwt dt |d)Nr)_ConvertToIcebergWithoutIDs visit_pyarrowF)downcast_ns_timestamp_to_usrz type(schema)=z:, but it must be pyiceberg.schema.Schema or pyarrow.Schema) rvrpyarrowpyiceberg.io.pyarrowrrr+get_boolrrrxr/)rrparrrrLrLrM_convert_schema_if_neededs&   z!Catalog._convert_schema_if_neededrbaserr6cCsTt|jtjtj}|r(dd|jD}dd|jD}||t||tdSdS)z0Delete oldest metadata if config is set to true.cSh|]}|jqSrL metadata_filerlogrLrLrM z/Catalog._delete_old_metadata..cSrrLrrrLrLrMrrN) r-r|r$METADATA_DELETE_AFTER_COMMIT_ENABLED,METADATA_DELETE_AFTER_COMMIT_ENABLED_DEFAULT metadata_logdifference_updaterMETADATA)rrr6delete_after_commitremoved_previous_metadata_filescurrent_metadata_filesrLrLrM_delete_old_metadatas zCatalog._delete_old_metadatacCr)a4Close the catalog and release any resources. This method should be called when the catalog is no longer needed to ensure proper cleanup of resources like database connections, file handles, etc. Default implementation does nothing. Override in subclasses that need cleanup. NrLrrLrLrMclose#rz Catalog.closecCs|S)z`Enter the context manager. Returns: Catalog: The catalog instance. rLrrLrLrM __enter__,szCatalog.__enter__exc_type type | Noneexc_valBaseException | Noneexc_tb Any | NonecCs |dS)aExit the context manager and close the catalog. Args: exc_type: Exception type if an exception occurred. exc_val: Exception value if an exception occurred. exc_tb: Exception traceback if an exception occurred. N)r()rr*r,r.rLrLrM__exit__4s zCatalog.__exit__cCs|jd|jdS)z6Return the string representation of the Catalog class.z ())rN __class__rrLrLrM__repr__>szCatalog.__repr__rNrOr|rO)rrrrr8r{rrrr"r|r(rQrrrrrr8r{rrrr"r|r(rQr)rrrQrrrrQrrrrQr)rrr3rOrQrrrrQr)rrrrrQr)rrrrrrrQr)rrr|r(rQr)rrrQr)rrrQr)rL)rrrQr()rrrrrr(rQr)rrrQr')rrrQrO)rrrrrQrO)rQr)rrrr rQr )r|r(r8r{rQr)rrrr*rQr)rrrrr6rrQr)rQr)rQrR)r*r+r,r-r.r/rQr)rQrO)1rBrCrD__doc__rrrrr!r&rrrrrrrrrrrrrrrrrrrrr staticmethodrrrrxrrr r r rDEFAULT_FORMAT_VERSIONrr'r(r)r0r3rLrLrLrMrRNs                                cseZdZdIfdd ZdeeefdJddZdKddZdLddZ dMddZ deeefdNd d!Z dOd*d+Z dPd0d1Z dQd4d5ZdRd6d7ZdRd8d9ZedSd?d@ZedTdCdDZedUdEdFZedVdGdHZZS)WMetastoreCatalogrNrOr|c stj|fi|dSr)superrrr2rLrMrDszMetastoreCatalog.__init__Nrrrrr8r{rrrr"r(rQrc Cst|||||||Sr)r_create_staged_tablerrLrLrMrGs z)MetastoreCatalog.create_table_transactionrcC&z||WdStyYdSw)NTF)rr rrLrLrMrTs   zMetastoreCatalog.table_existsrcCr@)rTF)rr rrLrLrMr[s   z!MetastoreCatalog.namespace_existsrc Cs||}||t|j|j}|j}t}g}|jD]}|||7}| |j qdd|D}dd|j D} t ||t ||tt ||tt || tt ||jhtdS)NcSrrL) manifest_path)rr5rLrLrMrurz/MetastoreCatalog.purge_table..cSrrLrrrLrLrMrvr)rrrr|r3r6set snapshots manifestsadd manifest_listr!rrMANIFEST MANIFEST_LISTPREVIOUS_METADATAr#) rrrrr6manifest_lists_to_deletersnapshotmanifest_paths_to_deleteprev_metadata_filesrLrLrMrjs       zMetastoreCatalog.purge_tablerc Cs||t|tjtj}||\}}||||}t||} | } t |||||d} |j || d} t ||f| | | |dS)aMCreate a table and return the table instance without committing the changes. Args: identifier (str | Identifier): Table identifier. schema (Schema): Table's schema. location (str | None): Location for the table. Optional Argument. partition_spec (PartitionSpec): PartitionSpec for the table. sort_order (SortOrder): SortOrder for the table. properties (Properties): Table properties that can be a string based dictionary. Returns: StagedTable: the created staged table instance. )r8rrrr|r|r8rr6r3rr) rintrtrFORMAT_VERSIONr;r _resolve_table_locationr new_table_metadata_file_locationr r r) rrrr8rrr| database_name table_nameproviderr3r6rrLrLrMr?~s&  z%MetastoreCatalog._create_staged_table current_table Table | Nonetable_identifierr'rrrrc Cs|D] }||r |jndqt|r|jn|||du|r!|jndd}|r/||jdnd}t|j|j}| |} t ||| |j |j| d|dS)N) base_metadatarenforce_validationr3rrrNrO) validater6r%_empty_table_metadatar3_parse_metadata_versionrr8r|rSrr ) rrWrYrr requirementupdated_metadatanew_metadata_versionrVnew_metadata_locationrLrLrM_update_and_stage_tables$  z(MetastoreCatalog._update_and_stage_tablecurrent_propertiesrr*tuple[PropertiesUpdateSummary, Properties]c Cs|j||dt|}t}t}|r&|D]}||vr%||||q|r:|D] \}}|||<||q,|p>t|} tt|pGgt|pLgt| d} | |fS)N)rr)rrr) _check_for_overlaprrBpoprEitems differencerlist) rrdrrupdated_propertiesrrkeyvalueexpected_to_changeproperties_update_summaryrLrLrM%_get_updated_props_and_update_summarys&   z6MetastoreCatalog._get_updated_props_and_update_summaryrTrUcCs|s|||S|dS)N/)_get_default_warehouse_locationrstrip)rr8rTrUrLrLrMrRs  z(MetastoreCatalog._resolve_table_locationcCsf||}|t}r|d}|d|S|jt}r/|d}|d|d|Std)zeReturn the default warehouse location using the convention of `warehousePath/databaseName/tableName`.rqGNo default path is set, please specify a location when creating a tablerrtLOCATIONrsr|WAREHOUSE_LOCATIONrxrrTrUdatabase_propertiesdatabase_locationwarehouse_pathrLrLrMrr   z0MetastoreCatalog._get_default_warehouse_locationcCsf||}|t}r|d}|d|S|jt}r/|d}|d|d|Std)zqReturn the default warehouse location following the Hive convention of `warehousePath/databaseName.db/tableName`.rqz.db/rtrurxrLrLrM"_get_hive_style_warehouse_locationr|z3MetastoreCatalog._get_hive_style_warehouse_locationr6rrr metadata_pathcCst|||dSr)rtable_metadata new_output)r6rr~rLrLrM_write_metadatasz MetastoreCatalog._write_metadatar3rPcCsX|dd}t|}r*z t|dWn ty"YdSwt|dSdS)aParse the version from the metadata location. The version is the first part of the file name, before the first dash. For example, the version of the metadata file `s3://bucket/db/tb/metadata/00001-6c97e413-d51b-4538-ac70-12fe2a85cb83.metadata.json` is 1. If the path does not comply with the pattern, the version is defaulted to be -1, ensuring that the next metadata file is treated as having version 0. Args: metadata_location (str): The location of the metadata file. Returns: int: The version of the metadata file. -1 if the file name does not have valid version string rqrrr)rTABLE_METADATA_FILE_NAME_REGEX fullmatchuuidUUIDgrouprxrP)r3 file_namefile_name_matchrLrLrMr^s z(MetastoreCatalog._parse_metadata_versioncCs:|r|rt|t|@}|rtd|dSdSdS)Nz%Updates and deletes have an overlap: )rBkeysrx)rroverlaprLrLrMrfs z#MetastoreCatalog._check_for_overlapcCstjdtdS)aoReturn an empty TableMetadata instance. It is used to build a TableMetadata from a sequence of initial TableUpdates. It is a V1 TableMetadata because there will be a UpgradeFormatVersionUpdate in initial changes to bump the metadata to the target version. Returns: TableMetadata: An empty TableMetadata instance. r)last_column_idr)rmodel_constructrrLrLrLrMr]&s z&MetastoreCatalog._empty_table_metadatar4r5r6r7r8)rrrrr8r{rrrr"r|r(rQr) rWrXrYr'rrrrrQr)rdr(rrrr(rQre)r8r{rTrOrUrOrQrO)rTrOrUrOrQrO)r6rrrr~rOrQr)r3rOrQrP)rrrr(rQr)rQr)rBrCrDrrr!r&rrrrr?rcrprRrrr}r:rr^rfr] __classcell__rLrLr>rMr<Cs8   ,       r<)rNrOrPr(rQrR)rNrOrmr)rQrnr)rNr{r|r{rQrR)rQr)rrrrrrOrQr)rrrrrQr)rNrOrrOr|r(rQr)w __future__rrrrerabcrrcollections.abcr dataclassesrenumrtypingrr r pyiceberg.exceptionsr r r rr pyiceberg.iorrpyiceberg.manifestrpyiceberg.partitioningrrpyiceberg.schemarpyiceberg.serializersrpyiceberg.tablerrrrrrpyiceberg.table.locationsrpyiceberg.table.metadatarrr pyiceberg.table.sortingr!r"pyiceberg.table.updater#r$r%pyiceberg.typedefr&r'r(r)r*pyiceberg.utils.configr+r,pyiceberg.utils.propertiesr-rr getLoggerrBrr~TOKENrrICEBERG TABLE_TYPErwMETADATA_LOCATIONPREVIOUS_METADATA_LOCATIONrGrHrIr#rurvr9BOTOCORE_SESSIONcompileXrr;rUr[r_rbrerhrkrErFrGrHrIrJrKrlrrzrrrrrrrRr<rLrLrLrMs               2   x