o i<@s dZddlmZddlZddlmZmZddlmZddl m Z ddl m Z m Z ddlmZmZmZdd lmZmZmZmZdd lmZmZmZmZmZmZmZdd lm Z m!Z!dd l"m#Z#m$Z$m%Z%m&Z&m'Z'm(Z(Gd dde Z)Gddde!e*e)Z+edZ,edZ-Gdddee,e-feZ.Gddde.e/e0e)fe/e0e)ffZ1e d=ddZ2e23e+d>ddZ4e23e*d?d"dZ4d@d%d&Z5Gd'd(d(ee*e)Z6Gd)d*d*e.e*e)e)fZ7dAd-d.Z8dBd3d4Z9Gd5d6d6ee)Z:Gd7d8d8ee)e#fZ;dCd;d<ZSet custom serializer to leave out the field when it is empty.r$Nr rr')r$r#lenr')self serializedr-r-r/ ser_model2s    zMappedField.ser_modelintcC t|jS)zReturn the number of fields.)r3r'r4r-r-r/__len__< zMappedField.__len__strcCsfddd|jDp d}|rd|nd}|jdurdnt|jp"d}dd|jd ||d S) z8Convert the mapped-field into a nicely formatted string.z, cSg|]}t|qSr-r<.0er-r-r/ Cz'MappedField.__str__.. N?z([z] -> ))joinr'r#r<r$)r4 fields_strr#r-r-r/__str__@s zMappedField.__str__)r*r r+r )r+r2r+r7r+r<)__name__ __module__ __qualname__r r#__annotations__r r<r$listr'r classmethodr0rr6r:rJr-r-r-r/r(s    rc@sBeZdZUded<edddZddd Zdd d ZdddZdS) NameMappingr&rootr+dict[str, MappedField]cCs t|tSr,)visit_name_mapping _IndexByNamer9r-r-r/_field_by_nameLs zNameMapping._field_by_namer7cCr8)zReturn the number of mappings.)r3rTr9r-r-r/r:Pr;zNameMapping.__len__Iterator[MappedField]cCr8)zIterate over the mapped fields.)iterrTr9r-r-r/__iter__Tr;zNameMapping.__iter__r<cCs0t|jdkr dSdddd|jDdS)z8Convert the name-mapping into a nicely formatted string.rz[]z[ z cSr=r-r>r?r-r-r/rB]rCz'NameMapping.__str__..z ])r3rTrHr9r-r-r/rJXszNameMapping.__str__N)r+rUrK)r+rYrL) rMrNrOrPrrXr:r[rJr-r-r-r/rSIs    rSSTc@s6eZdZedddZedd d ZedddZdS)NameMappingVisitornmrS field_resultsr\r+cCdS)zVisit a NameMapping.Nr-r4r_r`r-r-r/mappingezNameMappingVisitor.mappingstructr&list[T]cCra)zVisit a List[MappedField].Nr-r4rer`r-r-r/r'irdzNameMappingVisitor.fieldsfieldr field_resultr]cCra)zVisit a MappedField.Nr-r4rhrir-r-r/rhmrdzNameMappingVisitor.fieldN)r_rSr`r\r+r\)rer&r`rfr+r\)rhrrir\r+r])rMrNrOrrcr'rhr-r-r-r/r^ds  r^c@s*eZdZdddZdd d ZdddZdS)rWr_rSr`rUr+cC|Sr,r-rbr-r-r/rcsz_IndexByName.mappingrer&list[dict[str, MappedField]]cCs tt|Sr,)dictrrgr-r-r/r'v z_IndexByName.fieldsrhrrics.fdd|D}jD]}||<q|S)Ncs,i|]\}}jD] }|d||q qS).r$)r@key result_field field_namerhr-r/ zs  z&_IndexByName.field..)itemsr$)r4rhriresultnamer-rur/rhys   z_IndexByName.fieldN)r_rSr`rUr+rU)rer&r`rmr+rU)rhrrirUr+rU)rMrNrOrcr'rhr-r-r-r/rWrs  rWobj-NameMapping | list[MappedField] | MappedFieldvisitorNameMappingVisitor[S, T]r+cCstd|)z2Traverse the name mapping in post-order traversal.zCannot visit non-type: )NotImplementedErrorrzr|r-r-r/rVsrVcCs||t|j|Sr,)rcrVrTrr-r-r/_srr'r&csfdd|D}||S)Ncs g|] }|t|jqSr-)rhrVr'r@rhr|r-r/rBs z_..)r')r'r|resultsr-rr/rs rcr<cCs t|Sr,)rSmodel_validate_json)rcr-r-r/parse_mapping_from_jsons rc@sHeZdZd#ddZd$d d Zd%ddZd&ddZd'ddZd(d d!Zd"S))_CreateMappingschemar struct_resultbuiltins.list[MappedField]r+cCrkr,r-)r4rrr-r-r/rrlz_CreateMapping.schemarerr`)builtins.list[builtins.list[MappedField]]cCsddt|j|ddDS)NcSs$g|]\}}t|j|jg|dqS)r#r$r')rr#ry)r@rhrxr-r-r/rBsz)_CreateMapping.struct..T)strict)zipr'rgr-r-r/resz_CreateMapping.structrhrricCrkr,r-rjr-r-r/rhrlz_CreateMapping.field list_typerelement_resultcCst|jdg|dgS)Nelementr)r element_id)r4rrr-r-r/rQz_CreateMapping.listmap_typer key_result value_resultcCs$t|jdg|dt|jdg|dgS)Nrrrvalue)rkey_idvalue_id)r4rrrr-r-r/mapsz_CreateMapping.map primitivercCsgSr,r-)r4rr-r-r/rrlz_CreateMapping.primitiveN)rrrrr+r)rerr`rr+r)rhrrirr+r)rrrrr+r)rrrrrrr+r)rrr+r) rMrNrOrrerhrQrrr-r-r-r/rs     rc@s^eZdZUded<ded<d#ddZed$ddZd%ddZd&ddZd'ddZ d(d d!Z d"S))_UpdateMappingdict[int, NestedField]_updatesdict[int, list[NestedField]]_addsupdatesaddscCs||_||_dSr,)rr)r4rrr-r-r/__init__s z_UpdateMapping.__init__rhr assignmentsdict[str, int]r+MappedField | Nonecsbt|jD]}||}r||jkr|qfdd|jD}|r/t|j||jdSdS)Ncsg|]}|vr|qSr-r-r@f removed_namesr-r/rBsz;_UpdateMapping._remove_reassigned_names..r)setr$getr#addrr')rhrry assigned_idremaining_namesr-rr/_remove_reassigned_namess  z'_UpdateMapping._remove_reassigned_names mapped_fieldsr& parent_idr7c svj|}r9g}g}|D]}|t|j|jgt|jtdqdd|Dfdd|D|}|S|S)NrcSsi|]}|j|jqSr-)ryr#rr-r-r/rvsz2_UpdateMapping._add_new_fields..c$g|]}|durqSr,rr reassignmentsr4 updated_fieldr-r/rB z2_UpdateMapping._add_new_fields..) rrappendrr#ryr field_typer)r4rr fields_to_addr' new_fieldsrr-rr/_add_new_fieldssz_UpdateMapping._add_new_fieldsr_rSr`cCs ||dS)N)rrbr-r-r/rcroz_UpdateMapping.mappingrecs*fdd|Dfdd|DS)Ncs2i|]}|jdurj|jrjjqSr,)r#rrryr)r4updater-r/rvs z)_UpdateMapping.fields..crr,rrrr-r/rBrz)_UpdateMapping.fields..r-rgr-)rr4rrr/r's z_UpdateMapping.fieldsricCsZ|jdur|S|j}|j|j}dur |j|vr ||jt|j||||jdS)Nr)r#r$rrryrrr)r4rhri field_namesrr-r-r/rhs   z_UpdateMapping.fieldN)rrrr)rhrrrr+r)rr&rr7r+r&)r_rSr`r&r+r&)rer&r`r&r+r&)rhrrir&r+r) rMrNrOrPr staticmethodrrrcr'rhr-r-r-r/rs      rrrcCstt|tSr,)rSrr)rr-r-r/create_mapping_from_schemarrrrrcCstt|t||Sr,)rSrVr)rcrrr-r-r/update_mappingrrc@s>eZdZdddZdd d ZdddZdddZdddZdS)NameMappingAccessorpartnerrr+cCs|Sr,r-)r4rr-r-r/schema_partnerrlz"NameMappingAccessor.schema_partnerpartner_struct&list[MappedField] | MappedField | Nonerr7rtr<cCs8|durt|tr |j}|D] }||jvr|SqdSr,) isinstancerr'r$)r4rrrtrhr-r-r/ field_partners  z!NameMappingAccessor.field_partner partner_listcC*|dur|jD] }d|jvr|SqdSNrr'r$)r4rrhr-r-r/list_element_partner   z(NameMappingAccessor.list_element_partner partner_mapcCrNrrrr4rrhr-r-r/map_key_partnerrz#NameMappingAccessor.map_key_partnercCrNrrrr-r-r/map_value_partnerrz%NameMappingAccessor.map_value_partnerN)rrr+r)rrrr7rtr<r+r)rrr+r)rrr+r)rMrNrOrrrrrr-r-r-r/rs    rc@seZdZUded<dFddZdGd d ZdGd dZdHddZdHddZdIddZ dIddZ dJddZ dJdd Z dKd(d)Z dLd.d/ZdMd1d2ZdNd7d8ZdOd>d?ZdPdCdDZdES)QNameMappingProjectionVisitorzbuiltins.list[str] current_pathr+NonecCs g|_dSr,)rr9r-r-r/r)r;z%NameMappingProjectionVisitor.__init__rhrrP | NonecCs|j|jdSr,)rrryr4rhrr-r-r/ before_field-z)NameMappingProjectionVisitor.before_fieldcC|jdSr,rpoprr-r-r/ after_field0z(NameMappingProjectionVisitor.after_fieldrelement_partnercC|jddSrrrr4rrr-r-r/before_list_element3rz0NameMappingProjectionVisitor.before_list_elementcCrr,rrr-r-r/after_list_element6rz/NameMappingProjectionVisitor.after_list_elementrr key_partnercCrrrr4rrrr-r-r/before_map_key9rz+NameMappingProjectionVisitor.before_map_keycCrr,rrr-r-r/ after_map_key<rz*NameMappingProjectionVisitor.after_map_keyr value_partnercCrrrr4rrr-r-r/before_map_value?rz-NameMappingProjectionVisitor.before_map_valuecCrr,rrr-r-r/after_map_valueBrz,NameMappingProjectionVisitor.after_map_valuerrrrrrrcCst|jd|jiS)N schema_id)rr'r)r4rrrr-r-r/rErz#NameMappingProjectionVisitor.schemarestruct_partnerr`builtins.list[NestedField]cCst|Sr,)r)r4rerr`r-r-r/reHr1z#NameMappingProjectionVisitor.structric CsJ|dus |jdurtdd|jt|j|j||j|j|j|j dS)Nz,Field or field ID missing from NameMapping: rp)r#ryrrequireddocinitial_default initial_write) r# ValueErrorrHrrryrrr write_default)r4rhrrir-r-r/rhMsz"NameMappingProjectionVisitor.fieldrr list_partnerrcCsD|durtdd|jtdd|jDj}t|||jdS)N Could not find field with name: rpcs|] }d|jvr|VqdS)rNrqrr-r-r/ _z4NameMappingProjectionVisitor.list..)rrelement_required)rrHrnextr'r#rr)r4rrrrr-r-r/rQ[sz!NameMappingProjectionVisitor.listrr map_partnerrrcCs^|durtdd|jtdd|jDj}tdd|jDj}t|||||jdS)Nrrpcsr)rrNrqrr-r-r/rhrz3NameMappingProjectionVisitor.map..csr)rNrqrr-r-r/rir)rkey_typer value_typevalue_required)rrHrrr'r#rr)r4rrrrrrr-r-r/rbsz NameMappingProjectionVisitor.maprrprimitive_partnercCs"|durtdd|j|S)Nrrp)rrHr)r4rrr-r-r/rrsz&NameMappingProjectionVisitor.primitiveN)r+r)rhrrrr+r)rrrrr+r)rrrrrr+r)rrrrr+r)rrrrrrr+r)rerrrr`rr+r)rhrrrrirr+r)rrrrrrr+r) rrrrrrrrr+r)rrrrr+r)rMrNrOrPrrrrrrrrrrrerhrQrrr-r-r-r/r&s"               rschema_without_ids name_mappingcCst||ttSr,)rrr)rrr-r-r/apply_name_mappingyrr)rzr{r|r}r+r\)rzrSr|r}r+r\)r'r&r|r}r+r\)rcr<r+rS)rrr+rS)rcrSrrrrr+rS)rrrrSr+r)=__doc__ __future__rbuiltinsabcrr collectionsrcollections.abcr functoolsrrtypingr r r pydanticr r rrpyiceberg.schemarrrrrrrpyiceberg.typedefrrpyiceberg.typesrrrrrrrrQrSr\r]r^rnr<rWrVregisterrrrrrrrrrr-r-r-r/s@   $ !(     B 'S