o iO@sdZddlZddlmZmZddlZddlmZddlmZddl m Z m Z m Z ddl mZdd lmZmZd d lmZeeZd ed efddZd.deeefdefddZGdddejZGdddejZGdddejZ GdddejZ!GdddejZ"Gdd d ejZ#Gd!d"d"ejZ$Gd#d$d$ejZ%eGd%d&d&eZ&eGd'd(d(e&Z'ed)d*Gd+d,d,e&Z(gd-Z)dS)/zPyTorch EfficientNet model.N)OptionalUnion)nn)ACT2FN)BaseModelOutputWithNoAttention(BaseModelOutputWithPoolingAndNoAttention$ImageClassifierOutputWithNoAttention)PreTrainedModel)auto_docstringlogging)EfficientNetConfigconfig num_channelscCsJ|j}||j9}t|t||d||}|d|kr!||7}t|S)z< Round number of filters based on depth multiplier. g?) depth_divisorwidth_coefficientmaxint)rrdivisornew_dimrj/home/ubuntu/.local/lib/python3.10/site-packages/transformers/models/efficientnet/modeling_efficientnet.py round_filters%s   rT kernel_sizeadjustcCsnt|tr ||f}|dd|ddf}|r)|dd|d|dd|dfS|d|d|d|dfS)aJ Utility function to get the tuple padding value for the depthwise convolution. Args: kernel_size (`int` or `tuple`): Kernel size of the convolution layers. adjust (`bool`, *optional*, defaults to `True`): Adjusts padding value to apply to right and bottom sides of the input. rrr ) isinstancer)rrcorrectrrr correct_pad4s $rcs<eZdZdZdeffdd ZdejdejfddZZ S) EfficientNetEmbeddingszL A module that corresponds to the stem module of the original work. rcshtt|d|_tjdd|_tj|j|jddddd|_ tj |j|j |j d |_ t|j|_dS) N )rr rr paddingrrvalidFrstrider#bias)epsmomentum)super__init__rout_dimr ZeroPad2dr#Conv2dr convolution BatchNorm2dbatch_norm_epsbatch_norm_momentum batchnormr hidden_act activationselfr __class__rrr+Ms  zEfficientNetEmbeddings.__init__ pixel_valuesreturncCs,||}||}||}||}|SN)r#r/r3r5)r7r:featuresrrrforwardXs    zEfficientNetEmbeddings.forward) __name__ __module__ __qualname____doc__rr+torchTensorr> __classcell__rrr8rr Hs r cs,eZdZ       dfdd ZZS) EfficientNetDepthwiseConv2dr rrTzerosc s*||} tj|| |||||||d dS)N) in_channels out_channelsrr&r#dilationgroupsr' padding_mode)r*r+) r7rHdepth_multiplierrr&r#rJr'rLrIr8rrr+bs  z$EfficientNetDepthwiseConv2d.__init__)r rr rr TrG)r?r@rAr+rErrr8rrFasrFcsHeZdZdZdedededeffdd Zdejd ej fd d Z Z S) EfficientNetExpansionLayerz_ This corresponds to the expansion phase of each block in the original implementation. rin_dimr,r&csBttj||dddd|_tj||jd|_t|j |_ dS)Nr sameFrHrIrr#r') num_featuresr() r*r+rr. expand_convr0r1 expand_bnrr4 expand_act)r7rrOr,r&r8rrr+s z#EfficientNetExpansionLayer.__init__ hidden_statesr;cCs"||}||}||}|Sr<)rSrTrUr7rVrrrr>s   z"EfficientNetExpansionLayer.forward) r?r@rArBrrr+rC FloatTensorrDr>rErrr8rrN{s rNc sLeZdZdZdededededef fdd Zd ej d ej fd d Z Z S) EfficientNetDepthwiseLayerzk This corresponds to the depthwise convolution phase of each block in the original implementation. rrOr&radjust_paddingcsvt||_|jdkrdnd}t||d}tj|d|_t||||dd|_tj ||j |j d|_ t |j|_dS) Nrr$rP)rr"Fr%rRr(r))r*r+r&rrr-depthwise_conv_padrFdepthwise_convr0r1r2depthwise_normrr4 depthwise_act)r7rrOr&rrZconv_padr#r8rrr+s    z#EfficientNetDepthwiseLayer.__init__rVr;cCs6|jdkr ||}||}||}||}|S)Nr)r&r\r]r^r_rWrrrr>s     z"EfficientNetDepthwiseLayer.forward r?r@rArBrrboolr+rCrXrDr>rErrr8rrYsrYc sJeZdZdZd dedededeffdd Zd ej d ej fd d Z Z S)EfficientNetSqueezeExciteLayerzl This corresponds to the Squeeze and Excitement phase of each block in the original implementation. FrrO expand_dimexpandcst|r |n||_tdt||j|_tjdd|_ tj |j|jddd|_ tj |j|jddd|_ t |j|_t|_dS)Nr ) output_sizerP)rHrIrr#)r*r+dimrrsqueeze_expansion_ratiodim_serAdaptiveAvgPool2dsqueezer.reducererr4 act_reduceSigmoid act_expand)r7rrOrdrer8rrr+s$  z'EfficientNetSqueezeExciteLayer.__init__rVr;cCsF|}||}||}||}||}||}t||}|Sr<)rkrlrmrerorCmul)r7rVinputsrrrr>s      z&EfficientNetSqueezeExciteLayer.forward)Frarrr8rrcs rcc sVeZdZdZdedededededef fdd Zd e j d e j d e j fd dZ Z S)EfficientNetFinalBlockLayerz[ This corresponds to the final phase of each block in the original implementation. rrOr,r& drop_rateid_skipcsXt|dko | |_tj||dddd|_tj||j|jd|_ tj |d|_ dS)Nr rPFrQr[p) r*r+ apply_dropoutrr. project_convr0r1r2 project_bnDropoutdropout)r7rrOr,r&rsrtr8rrr+s  z$EfficientNetFinalBlockLayer.__init__ embeddingsrVr;cCs0||}||}|jr||}||}|Sr<)rxryrwr{)r7r|rVrrrr>s   z#EfficientNetFinalBlockLayer.forwardr?r@rArBrrfloatrbr+rCrXrDr>rErrr8rrrs $rrcs\eZdZdZdededededededed ed effd d Zd e j de j fddZ Z S)EfficientNetBlocka This corresponds to the expansion and depthwise convolution phase of each block in the original implementation. Args: config ([`EfficientNetConfig`]): Model configuration class. in_dim (`int`): Number of input channels. out_dim (`int`): Number of output channels. stride (`int`): Stride size to be used in convolution layers. expand_ratio (`int`): Expand ratio to set the output dimensions for the expansion and squeeze-excite layers. kernel_size (`int`): Kernel size for the depthwise convolution layer. drop_rate (`float`): Dropout rate to be used in the final phase of each block. id_skip (`bool`): Whether to apply dropout and sum the final hidden states with the input embeddings during the final phase of each block. Set to `True` for the first block of each stage. adjust_padding (`bool`): Whether to apply padding to only right and bottom side of the input kernel before the depthwise convolution operation, set to `True` for inputs with odd input sizes. rrOr,r& expand_ratiorrsrtrZc st||_|jdk|_||} |jrt||| |d|_t||jr%| n|||| d|_t||| |jd|_ t ||jr>| n|||||d|_ dS)Nr )rrOr,r&)rrOr&rrZ)rrOrdre)rrOr,r&rsrt) r*r+rrerN expansionrYr]rcsqueeze_exciterr projection) r7rrOr,r&rrrsrtrZ expand_in_dimr8rrr+s4      zEfficientNetBlock.__init__rVr;cCs<|}|jdkr ||}||}||}|||}|S)Nr )rrr]rr)r7rVr|rrrr>Hs     zEfficientNetBlock.forwardr}rrr8rrs,  )rc sPeZdZdZdeffdd Z  d dejdee d ee d e fd d Z Z S)EfficientNetEncoderz Forward propagates the embeddings through each EfficientNet block. Args: config ([`EfficientNetConfig`]): Model configuration class. rc snt|_|j_fddt|j}tfdd|jD}d}g}t|D]c}t ||j|}t ||j |}|j |} |j |} |j |} t|j|D]8} | dk} | dkradn| } | dkri|n|}||jv}|j||}t|||| | | || |d }|||d7}qUq+t|_tj|t |ddd d d _tj|j|j|jd _t|j_dS) Ncsttj|Sr<)rmathceildepth_coefficient)repeats)r7rr round_repeatscsz3EfficientNetEncoder.__init__..round_repeatsc3s|]}|VqdSr<r).0n)rrr hsz/EfficientNetEncoder.__init__..rr ) rrOr,r&rrrsrtrZirPFrQr[)r*r+rrlenrHsumnum_block_repeatsrangerrIstrides kernel_sizes expand_ratiosdepthwise_paddingdrop_connect_raterappendr ModuleListblocksr.top_convr0 hidden_dimr1r2top_bnrr4top_activation)r7rnum_base_blocks num_blockscurr_block_numrirOr,r&rrjrtrZrsblockr8)rr7rr+^s\           zEfficientNetEncoder.__init__FTrVoutput_hidden_states return_dictr;cCst|r|fnd}|jD] }||}|r||f7}q ||}||}||}|s4tdd||fDSt||dS)Ncss|] }|dur|VqdSr<r)rvrrrrsz.EfficientNetEncoder.forward..)last_hidden_staterV)rrrrtupler)r7rVrrall_hidden_statesrrrrr>s     zEfficientNetEncoder.forward)FT) r?r@rArBrr+rCrXrrbrr>rErrr8rrUs:rc@s2eZdZUeed<dZdZgZdej fddZ dS)EfficientNetPreTrainedModelr efficientnetr:modulecCsNt|tjtjtjfr#|jjjd|jj d|j dur%|j j dSdSdS)zInitialize the weightsg)meanstdN) rrLinearr.r0weightdatanormal_rinitializer_ranger'zero_)r7rrrr _init_weightss  z)EfficientNetPreTrainedModel._init_weightsN) r?r@rAr__annotations__base_model_prefixmain_input_name_no_split_modulesrModulerrrrrrs rc s^eZdZdeffdd Ze   d deejdee dee de e e ffd d Z ZS) EfficientNetModelrcs~t|||_t||_t||_|jdkr"tj |j dd|_ n|jdkr1tj |j dd|_ nt d|j|dS)NrT) ceil_moderz2config.pooling must be one of ['mean', 'max'] got )r*r+rr r|rencoder pooling_typer AvgPool2drpooler MaxPool2d ValueErrorpooling post_initr6r8rrr+s      zEfficientNetModel.__init__Nr:rrr;cCs|dur|n|jj}|dur|n|jj}|durtd||}|j|||d}|d}||}||jdd}|sH||f|ddSt |||j dS)Nz You have to specify pixel_valuesrrrrr )r pooler_outputrV) rruse_return_dictrr|rrreshapeshaperrV)r7r:rrembedding_outputencoder_outputsr pooled_outputrrrr>s*  zEfficientNetModel.forward)NNN)r?r@rArr+r rrCrXrbrrrr>rErrr8rrs rz EfficientNet Model with an image classification head on top (a linear layer on top of the pooled features), e.g. for ImageNet. ) custom_introcsdeZdZfddZe    d deejdeejdee dee de e e ff d d Z ZS) "EfficientNetForImageClassificationcsdt||j|_||_t||_tj|jd|_ |jdkr't |j |jnt |_ |dS)Nrur)r*r+ num_labelsrrrrrz dropout_rater{rrIdentity classifierrr6r8rrr+s  $ z+EfficientNetForImageClassification.__init__Nr:labelsrrr;c Cs|dur|n|jj}|j|||d}|r|jn|d}||}||}d}|dur3||||j}|sI|f|dd} |durG|f| S| St|||jdS)a labels (`torch.LongTensor` of shape `(batch_size,)`, *optional*): Labels for computing the image classification/regression loss. Indices should be in `[0, ..., config.num_labels - 1]`. If `config.num_labels == 1` a regression loss is computed (Mean-Square loss), If `config.num_labels > 1` a classification loss is computed (Cross-Entropy). Nrr r)losslogitsrV) rrrrr{r loss_functionr rV) r7r:rrroutputsrrroutputrrrr> s   z*EfficientNetForImageClassification.forward)NNNN)r?r@rAr+r rrCrX LongTensorrbrrr r>rErrr8rrs$   r)rrr)T)*rBrtypingrrrCr activationsrmodeling_outputsrrr modeling_utilsr utilsr r configuration_efficientnetr get_loggerr?loggerrrrrbrrr r.rFrNrYrcrrrrrrr__all__rrrrs<     ''!QZ8 2