o oif@sddlZddlmZmZddlmZmZmZmZm Z m Z m Z m Z m Z ddlmZddlmZddlmZddlmZddlmZmZddlmZdd lmZd d lmZe ee eeefZ e e ee e ee ee efZ!e d Z"Gd ddee"edZ#GdddZ$edZ%dddee%effddZ&ddde ede efddZ'Gddde#eZ(Gddde#eZ)Gdd d e#eZ*Gd!d"d"e#eZ+Gd#d$d$e#eZ,dS)%N)ABCMetaabstractmethod) AnyCallableDictGenericListOptionalTypeTypeVarUnion) ParamSpec)_AugmentationBase)DataKey)ModuleTensor)Boxes) Keypoints) ParamItemTc@seZdZdZededeeeffddZ edede efddZ ee dd e d eded eeeefde f d d Zee dd e d eded eeeefde f ddZdS)SequentialOpsInterfacez>Abstract interface for applying and inversing transformations.paramreturncC0t|trt|jtr|j}|Std|d)Nz8Expected param (ParamItem.data) be a dictionary. Gotcha .) isinstancerdatadict TypeErrorclsr_paramsr#U/home/ubuntu/.local/lib/python3.10/site-packages/kornia/augmentation/container/ops.pyget_instance_module_param,z0SequentialOpsInterface.get_instance_module_paramcCr)Nz2Expected param (ParamItem.data) be a list. Gotcha r)rrrlistrr r#r#r$get_sequential_module_param4r&z2SequentialOpsInterface.get_sequential_module_paramNinputmodule extra_argscCt)Apply a transformation with respect to the parameters. Args: input: the input tensor. module: any torch Module but only kornia augmentation modules will count to apply transformations. param: the corresponding parameters to the module. extra_args: Optional dictionary of extra arguments with specific options for different input types. NotImplementedErrorr!r)r*rr+r#r#r$ transform< z SequentialOpsInterface.transformcCr,)Inverse a transformation with respect to the parameters. Args: input: the input tensor. module: any torch Module but only kornia augmentation modules will count to apply transformations. param: the corresponding parameters to the module. extra_args: Optional dictionary of extra arguments with specific options for different input types. r.r0r#r#r$inverseJr2zSequentialOpsInterface.inverseN)__name__ __module__ __qualname____doc__ classmethodrrstrrr%rr(rrrr rr1r4r#r#r#r$r)s0 4r) metaclassc@sreZdZdeeeddfddZedeeefddZej dee eeee ee fddfddZddee ee ee eefdeefd d Z d edeeefd d Zdddedededeeee effdee ee ee eefde eeff ddZdddedededeeee effdee ee ee eefde eeff ddZdS)AugmentationSequentialOps data_keysrNcCs ||_dSr5 _data_keysselfr>r#r#r$__init__Zs z"AugmentationSequentialOps.__init__cCs|jSr5r?)rBr#r#r$r>]sz#AugmentationSequentialOps.data_keyscCs"|r dd|D|_dSd|_dS)NcSg|]}t|qSr#rget.0inpr#r#r$ dz7AugmentationSequentialOps.data_keys..r?rAr#r#r$r>as cCs0|durt|jtr |jStddd|DS)Nz5Sequential ops needs data keys to be able to process.cSrDr#rErGr#r#r$rJnrKz>AugmentationSequentialOps.preproc_datakeys..)rr>r' ValueErrorrAr#r#r$preproc_datakeyshs  z*AugmentationSequentialOps.preproc_datakeysdata_keycCsb|tjkrtS|tjkrtS|tjtjtjhvrtS|tj kr!t S|tj kr(t St d|jd)z4Return the corresponding operation given a data key.zOperation for `z` is not found.)rINPUTInputSequentialOpsMASKMaskSequentialOpsBBOX BBOX_XYWH BBOX_XYXYBoxSequentialOps KEYPOINTSKeypointSequentialOpsCLASSClassSequentialOps RuntimeErrorname)rBrNr#r#r$_get_opps    z!AugmentationSequentialOps._get_op)r>argr*rr+c Gs||}t|tjrt|j|j|||j|dd}g}t||D]2\}} | | } | | i} | jdkrHt|t rH| t j|||| dq"| | j|||| dq"t|dkrft|t tfrf|dS|S)N)r>paramsr+)r\rrQrr+rr)rMrKRandomTransplantationrr\params_from_inputrzipr]rFr'appendrRtransform_listr1lentuple rBr*rr+r>r^r@outputsrIdcateop extra_argr#r#r$r1~s*     z#AugmentationSequentialOps.transformc Gs~||}g}t||D]\}} || } | |vr|| ni} || j|||| dq t|dkr=t|ttfr=|dS|S)Nr`rr) rMrdr]rer4rgrr'rhrir#r#r$r4s  z!AugmentationSequentialOps.inverser5)r6r7r8r rrrCpropertyr>setterr r;intrMr rrr]DataTyperrrSequenceDataTyper1r4r#r#r#r$r=YsH.2  ( r=Pr*zK.container.ImageSequentialBasercs"dtjdtjdtffdd }|S)z@Disable all other additional inputs (e.g. ) for ImageSequential.argskwargsrcs|i|Sr5r#)rtrur*r#r$fsz%make_input_only_sequential..f)rsrtrur)r*rwr#rvr$make_input_only_sequentialsrxrcCsF||}g}t||D]\\}}}t|tjtjfr ||q |S)zReturn geometry param.)get_forward_sequencerdrraGeometricAugmentationBase2DGeometricAugmentationBase3Dre)r*r named_modulesres_modpr#r#r$get_geometric_only_params  rc @speZdZe d dedededeee e fdef ddZ e d dedededeee e fdef d d Z dS) rPNr)r*rr+rcCs|duri}t|ttjfr ||f||tjgd|}|St|tjjfr5|j || ||d}|St|tj j j frI||||d}|S|jdurZtd|jd|d||}|S)Nr_r>r_r+)r_zNon-augmentaion operation z require empty parameters. Got r)rrraMixAugmentationBaseV2r%rrO containerImageSequentialBasetransform_inputsr(auto operations OperationBaserAssertionErrorr\r0r#r#r$r1s   zInputSequentialOps.transformcCs|duri}t|tjr|j|fd||i|}|St|tjfr'tdt|tjjj fr:t j||j ||dSt|tj rQ| sQ|j||||d}|St|tjjrc|j||||d}|S)Nr_zfThe support for 3d inverse operations are not yet supported. You are welcome to file a PR in our repo.r*rr+r)rrarzr4r%r{r/rrrrPrlImageSequentialis_intensity_onlyinverse_inputsr(rrr0r#r#r$r4s"  zInputSequentialOps.inverser5) r6r7r8r:rrrr rr;rr1r4r#r#r#r$rPs6 rPc @teZdZdZe d dedededee e e fdef dd Z e d dedededee e e fdef d d Z dS) rZz=Apply and inverse transformations for class labels if needed.Nr)r*rr+rcCst|tjr td|S)NzdThe support for class labels for mix augmentations that change the class label is not yet supported.)rrarr/r0r#r#r$r1s zClassSequentialOps.transformcCs|Sr5r#r0r#r#r$r4szClassSequentialOps.inverser5)r6r7r8r9r:rrrr rr;rr1r4r#r#r#r$rZs8  rZc @seZdZdZe ddedededee e e fdef dd Z e dde edededee e e fde ef d d Ze ddedededee e e fdef d d ZdS)rRz3Apply and inverse transformations for mask tensors.Nr)r*rr+rcCs6|duri}t|tjfr!|j|f|||j|jd|}|St|tjfr,tdt|tj rD||f||t j gd|}|St|t r[|j|f|||jd|}|St|tj rr|sr|j||||d}|St|tjjr|j||||d}|St|tjjjfrtj||j||d}|S)r-Nr_flagsr1cThe support for 3d mask operations are not yet supported. You are welcome to file a PR in our repo.rr_rrr)rrarztransform_masksr%rtransform_matrixr{r/rbrrQrrrr(rrrrrrRr1rlr0r#r#r$r1 sL      zMaskSequentialOps.transformc Cs|duri}t|tjfrBg}||}t|}t|D] \}} |d||d<|j| f||j|j d|} | | q|}|St|tj frMt dt|t rg}||}t|}t|D]\}} |d||d<|j| f||jd|} | | qb|}|St|tjr|sg}||} |D]} |j| | |d} | | q|}|St|tjjrg}||} |D]} |j| | |d} | | q|}|St|tjjjfrt d|S)aApply a transformation with respect to the parameters. Args: input: list of input tensors. module: any torch Module but only kornia augmentation modules will count to apply transformations. param: the corresponding parameters to the module. extra_args: Optional dictionary of extra arguments with specific options for different input types. N batch_probrrrrztThe support for list of masks under auto operations are not yet supported. You are welcome to file a PR in our repo.)rrarzr%copydeepcopy enumeraterrrrer{r/rrrr(rrrrr) r!r)r*rr+ tfm_inputr_params_iirItfm_inp seq_paramsr#r#r$rf:sj     &        z MaskSequentialOps.transform_listcCs|duri}t|tjfr4|jdurtd|jd||j}|j|f|||j |d|}|St|tj fr?t dt|tj j rS|j||||d}|St|tjjjfrftj||j||d}|S)r3N(No valid transformation matrix found in rrrrr)rrarzrrL __class__compute_inverse_transformation inverse_masksr%rr{r/rrr(rrrrRr4rl)r!r)r*rr+r1r#r#r$r4{s4   zMaskSequentialOps.inverser5)r6r7r8r9r:rrrr rr;rr1rrfr4r#r#r#r$rRsR 0 @rRc @r) rVz}Apply and inverse transformations for bounding box tensors. This is for transform boxes in the format (B, N, 4, 2). Nr)r*rr+rcC|duri}|}t|tjfr%|j||||jfd|ji|}|St|tjfr0t dt|tj rG| sG|j|| ||d}|St|tj jr[|j|| ||d}|St|tjjjfrntj||j||dS|S)Apply a transformation with respect to the parameters. Args: input: the input tensor, (B, N, 4, 2) or (B, 4, 2). module: any torch Module but only kornia augmentation modules will count to apply transformations. param: the corresponding parameters to the module. extra_args: Optional dictionary of extra arguments with specific options for different input types. Nr1bThe support for 3d box operations are not yet supported. You are welcome to file a PR in our repo.rr)clonerrarztransform_boxesr%rrr{r/rrr(rrrrrrVr1rlr!r)r*rr+_inputr#r#r$r1s>    zBoxSequentialOps.transformcCs|duri}|}t|tjfr6|jdurtd|jd||j}|j||j |j fd|i|}|St|tj frAt dt|tj rX|sX|j||||d}|St|tjjrl|j||||d}|St|tjjjfrtj||j||dS|S)r3Nrrr1rrr)rrrarzrrLrr inverse_boxesrrr{r/rrr(rrrrrrVr4rlr!r)r*rr+rr1r#r#r$r4s<   zBoxSequentialOps.inverser5)r6r7r8r9r:rrrr rr;rr1r4r#r#r#r$rVs8 -rVc @r) rXz{Apply and inverse transformations for keypoints tensors. This is for transform keypoints in the format (B, N, 2). Nr)r*rr+rcCr)rNr1gThe support for 3d keypoint operations are not yet supported. You are welcome to file a PR in our repo.rr)rrrarztransform_keypointsr%rrr{r/rrr(rrrrrrXr1rlrr#r#r$r1 s>    zKeypointSequentialOps.transformcCs|duri}|}t|tjfr8|jdurtd|jd||j}|j|| ||j fd|i|}|St|tj frCt dt|tj rZ|sZ|j||||d}|St|tjjrn|j||||d}|St|tjjjfrtj||j||dS|S)r3Nrrr1rrr)rrrarzrrLrrinverse_keypointsr%rr{r/rrr(rrrrrrXr4rlrr#r#r$r4;s@      zKeypointSequentialOps.inverser5)r6r7r8r9r:rrrr rr;rr1r4r#r#r#r$rXs8 .rX)-rabcrrtypingrrrrrr r r r typing_extensionsr kornia.augmentation augmentationrakornia.augmentation.baserkornia.constantsr kornia.corerrkornia.geometry.boxesrkornia.geometry.keypointsrr_rrqrrrrr=rsrxrrPrZrRrVrXr#r#r#r$s2,       $0Z  ( a