o ߥi'>@s|ddlZddlmZddlmZddlmZmZmZm Z m Z m Z m Z m Z mZmZdZGdddejZGd d d ejZdS) N)nn) functional) MemoryEfficientSwishSwishcalculate_output_image_size drop_connectefficientnet_paramsget_model_paramsget_same_padding_conv2dload_pretrained_weights round_filters round_repeats) zefficientnet-b0zefficientnet-b1zefficientnet-b2zefficientnet-b3zefficientnet-b4zefficientnet-b5zefficientnet-b6zefficientnet-b7zefficientnet-b8zefficientnet-l2cs2eZdZd fdd Zd ddZd ddZZS) MBConvBlockNc st||_d|j|_|j|_|jjduo%d|jjko#dkn|_|j |_ |jj }|jj |jj }|jj dkrVt |d}|||ddd|_ tj||j|jd|_|jj}|jj}t |d}||||||dd|_tj||j|jd|_t||}|jrt dd}tdt|jj |jj} ||| dd |_|| |dd |_|jj} t |d}||| ddd|_tj| |j|jd|_t|_dS) Nrr image_sizeF) in_channels out_channels kernel_sizebias num_featuresmomentumeps)rrgroupsrstrider)rr)rrr)super__init__ _block_argsbatch_norm_momentum_bn_mombatch_norm_epsilon_bn_epsse_ratiohas_seid_skip input_filters expand_ratior _expand_convr BatchNorm2d_bn0rr_depthwise_conv_bn1rmaxint _se_reduce _se_expandoutput_filters _project_conv_bn2r_swish) self block_args global_paramsrinpoupConv2dksnum_squeezed_channels final_oup __class__e/home/ubuntu/.local/lib/python3.10/site-packages/modelscope/models/cv/face_emotion/efficient/model.pyrs|            zMBConvBlock.__init__cCs|}|jjdkr||}||}||}||}||}||}|jrEt |d}| |}||}| |}t ||}||}||}|jj|jj}}|jrs|jjdkrs||krs|rot|||jd}||}|S)zMBConvBlock's forward function. Args: inputs (tensor): Input tensor. drop_connect_rate (bool): Drop connect rate (float, between 0 and 1). Returns: Output of this block after processing. r)ptraining)rr'r(r*r4r+r,r$Fadaptive_avg_pool2dr/r0torchsigmoidr2r3r&r1r%rrrD)r5inputsdrop_connect_ratex x_squeezedr&r1rArArBforwardLs0             zMBConvBlock.forwardTcCs|rt|_dSt|_dSzSets swish function as memory efficient (for training) or standard (for export). Args: memory_efficient (bool): Whether to use memory-efficient version of swish. N)rrr4)r5memory_efficientrArArB set_swishqszMBConvBlock.set_swish)NT)__name__ __module__ __qualname__rrMrP __classcell__rArAr?rBrs 7%rcseZdZdZdfdd ZdddZdd Zd d Zd d Ze dddZ e    dddZ e ddZ e ddZ ddZZS) EfficientNetajEfficientNet model. Most easily loaded with the .from_name or .from_pretrained methods. Args: blocks_args (list[namedtuple]): A list of BlockArgs to construct blocks. global_params (namedtuple): A set of GlobalParams shared between blocks. References: [1] https://arxiv.org/abs/1905.11946 (EfficientNet) Example: >>> import torch >>> from efficientnet.model import EfficientNet >>> inputs = torch.rand(1, 3, 224, 224) >>> model = EfficientNet.from_pretrained('efficientnet-b0') >>> model.eval() >>> outputs = model(inputs) Nc stt|tsJdt|dksJd||_||_d|jj}|jj}|j }t |d}d}t d|j}|||ddd d |_ t j|||d |_t|d}t g|_|jD]N} | jt | j|jt | j|jt| j|jd } |jt| |j|dt|| j}| jdkr| j| jdd } t| jdD]} |jt| |j|dqqY| j}t d|j}t |d}|||dd d|_t j|||d |_t d|_|jj rt !|jj"|_#t $||jj%|_&t'|_(dS)Nzblocks_args should be a listrz!block args must be greater than 0rr Frrrr)r&r1 num_repeat)r&ri)rr))rr isinstancelistlen_global_params _blocks_argsrr!rr r _conv_stemrr)r*r ModuleList_blocks_replacer&r1rr[appendrrrange _conv_headr,AdaptiveAvgPool2d _avg_pooling include_topDropout dropout_rate_dropoutLinear num_classes_fcrr4) r5 blocks_argsr7bn_mombn_epsrr:rrr6_r?rArBrs             zEfficientNet.__init__TcCs,|rtnt|_|jD]}||q dSrN)rrr4rcrP)r5rOblockrArArBrPs  zEfficientNet.set_swishcCst}||||}|}t|jD]G\}}|jj}|r*|t|t |j9}|||d}| d| dkrF||d t |d<n|t |jdkrZ||d t |d<|}q|| | |}||d t |d<|S)a?Use convolution layer to extract features from reduction levels i in [1, 2, 3, 4, 5]. Args: inputs (tensor): Input tensor. Returns: Dictionary of last intermediate features with reduction levels i in [1, 2, 3, 4, 5]. Example: >>> import torch >>> from efficientnet.model import EfficientNet >>> inputs = torch.rand(1, 3, 224, 224) >>> model = EfficientNet.from_pretrained('efficientnet-b0') >>> endpoints = model.extract_endpoints(inputs) >>> print(endpoints['reduction_1'].shape) # torch.Size([1, 16, 112, 112]) >>> print(endpoints['reduction_2'].shape) # torch.Size([1, 24, 56, 56]) >>> print(endpoints['reduction_3'].shape) # torch.Size([1, 40, 28, 28]) >>> print(endpoints['reduction_4'].shape) # torch.Size([1, 112, 14, 14]) >>> print(endpoints['reduction_5'].shape) # torch.Size([1, 320, 7, 7]) >>> print(endpoints['reduction_6'].shape) # torch.Size([1, 1280, 7, 7]) rJrYz reduction_{}r)dictr4r*ra enumeratercr_rJfloatr^sizeformatr,rg)r5rI endpointsrKprev_xidxrurJrArArBextract_endpointss$  zEfficientNet.extract_endpointscCsr||||}t|jD]\}}|jj}|r%|t|t|j9}|||d}q|| | |}|S)zuse convolution layer to extract feature . Args: inputs (tensor): Input tensor. Returns: Output of the final convolution layer in the efficientnet model. rv) r4r*rarxrcr_rJryr^r,rg)r5rIrKr~rurJrArArBextract_featuresszEfficientNet.extract_featurescCs@||}||}|jjr|jdd}||}||}|S)a EfficientNet's forward function. Calls extract_features to extract features, applies final linear layer, and returns logits. Args: inputs (tensor): Input tensor. Returns: Output of this model after processing. r) start_dim)rrir_rjflattenrmrp)r5rIrKrArArBrM s     zEfficientNet.forwardrWcKs0||t||\}}|||}|||S)aCreate an efficientnet model according to name. Args: model_name (str): Name for efficientnet. in_channels (int): Input data's channel number. override_params (other key word params): Params to override model's global_params. Optional key: 'width_coefficient', 'depth_coefficient', 'image_size', 'dropout_rate', 'num_classes', 'batch_norm_momentum', 'batch_norm_epsilon', 'drop_connect_rate', 'depth_divisor', 'min_depth' Returns: An efficientnet model. )_check_model_name_is_validr _change_in_channels)cls model_nameroverride_paramsrqr7modelrArArB from_names   zEfficientNet.from_nameFcKs$|j|fd|i|}|||S)a{Create an efficientnet model according to name. Args: model_name (str): Name for efficientnet. weights_path (None or str): str: path to pretrained weights file on the local disk. None: use pretrained weights downloaded from the Internet. advprop (bool): Whether to load pretrained weights trained with advprop (valid when weights_path is None). in_channels (int): Input data's channel number. num_classes (int): Number of categories for classification. It controls the output size for final linear layer. override_params (other key word params): Params to override model's global_params. Optional key: 'width_coefficient', 'depth_coefficient', 'image_size', 'dropout_rate', 'batch_norm_momentum', 'batch_norm_epsilon', 'drop_connect_rate', 'depth_divisor', 'min_depth' Returns: A pretrained efficientnet model. ro)rr)rr weights_pathadvproprrorrrArArBfrom_pretrained5s  zEfficientNet.from_pretrainedcCs||t|\}}}}|S)zGet the input image size for a given efficientnet model. Args: model_name (str): Name for efficientnet. Returns: Input image size (resolution). )rr )rrrtresrArArBget_image_sizeZs zEfficientNet.get_image_sizecCs|tvr tddtdS)zValidates model name. Args: model_name (str): Name for efficientnet. Returns: bool: Is a valid name or not. zmodel_name should be one of: z, N) VALID_MODELS ValueErrorjoin)rrrArArBrfs z'EfficientNet._check_model_name_is_validcCs>|dkrt|jjd}td|j}|||dddd|_dSdS)zAdjust model's first convolution layer to in_channels, if in_channels not equals 3. Args: in_channels (int): Input data's channel number. rWrrXrYFrZN)r r_rr ra)r5rr:rrArArBrrs   z EfficientNet._change_in_channels)NNrQ)rW)NFrWr)rRrSrT__doc__rrPrrrM classmethodrrrrrrUrArAr?rBrVys( < +  $   rV)rGrtorch.nnrrEutilsrrrrr r r r r rrModulerrVrArArArBs  0f