o پi]< @sdZddlmZddlmZmZmZmZddlZddl m Z ddl m Z m Z ddlmZmZmZmZmZmZddlmZdd lmZdd lmZdd lmZmZd gZGd dde jZ Gddde jZ!Gddde jZ"Gddde jZ#Gdd d e jZ$d,ddZ%d-ddZ&ee&ddde&dde&dde&dde&ddde&dddd Z'ed,d!e$fd"d#Z(ed,d!e$fd$d%Z)ed,d!e$fd&d'Z*ed,d!e$fd(d)Z+ed,d!e$fd*d+Z,dS).aPytorch impl of Aligned Xception 41, 65, 71 This is a correct, from scratch impl of Aligned Xception (Deeplab) models compatible with TF weights at https://github.com/tensorflow/models/blob/master/research/deeplab/g3doc/model_zoo.md Hacked together by / Copyright 2020 Ross Wightman )partial)ListDictTypeOptionalNIMAGENET_INCEPTION_MEANIMAGENET_INCEPTION_STD)ClassifierHead ConvNormActDropPathPadType create_conv2dget_norm_act_layer) to_3tuple)build_model_with_cfg)checkpoint_seq)register_modelgenerate_default_cfgsXceptionAlignedcsdeZdZddddejejfdededededed ed eej d eej ffd d Z ddZ Z S)SeparableConv2drin_chsout_chs kernel_sizestridedilationpadding act_layer norm_layerc stt|||_||_t||||||dd|_|||_|dur'|ddnt |_ t||dd|_ |||_ |durE|dd|_ dSt |_ dS)NTrrr depthwiseinplacerr)superr__init__rrrconv_dwbn_dwnnIdentityact_dwconv_pwbn_pwact_pw) selfrrrrrrr r! __class__P/home/ubuntu/.local/lib/python3.10/site-packages/timm/models/xception_aligned.pyr(s   &zSeparableConv2d.__init__cCs@||}||}||}||}||}||}|SN)r)r*r-r.r/r0r1xr4r4r5forward4s      zSeparableConv2d.forward) __name__ __module__ __qualname__r+ReLU BatchNorm2dintr rModuler(r9 __classcell__r4r4r2r5rs2 rcsjeZdZddddejejdfdedededed ed ed eej d eej d e ffdd Z ddZ Z S)PreSeparableConv2drrrTrrrrrrr r! first_actc sltt|t||d} ||_||_| r| |ddnt|_t ||||||dd|_ t ||dd|_ dS)Nr Tr$r"rr&) r'rBr(rrrr+r,normrr)r.) r1rrrrrrr r!rCnorm_act_layerr2r4r5r(?s zPreSeparableConv2d.__init__cCs"||}||}||}|Sr6)rEr)r.r7r4r4r5r9Ys   zPreSeparableConv2d.forward)r:r;r<r+r=r>r?r rr@boolr(r9rAr4r4r2r5rB>s8  rBcsxeZdZdddddejddfdededed ed ed ed ed eej de eej de ej ffdd Z ddZ Z S)XceptionModulerrTFNrrrrpad_typestart_with_reluno_skipr r! drop_pathc stt|t|}||_|d|_||_|s/|j|jks"|dkr/t||jd|| dd|_nd|_|r6dn|} t |_ t dD]7} |rV|j d| d|| dkd|j d | dt||| d| d krk|nd||| | d || }qA| |_dS) NrF)rr! apply_actractrr$conv)rrrr r!)r'rHr(r in_channels out_channelsrKr shortcutr+ Sequentialstackrange add_modulerrL) r1rrrrrIrJrKr r!rLseparable_act_layerir2r4r5r(as*      "  zXceptionModule.__init__cCsH|}||}|jdur||}|js"|jdur||}||}|Sr6)rVrTrKrLr1r8skipr4r4r5r9s     zXceptionModule.forwardr:r;r<r+r=r?r rGrr@rr(r9rAr4r4r2r5rH`s>   $rHcsreZdZddddejddfdedededed ed ed eej d e eej d e ej ffdd Z ddZ Z S)PreXceptionModulerrFNrrrrrIrKr r!rLc stt|t|}||_|d|_||_|s-|j|jks"|dkr-t||jd|d|_nt |_t ||d|dd|_ t |_tdD]'} |jd| dt||| d| d kr]|nd||||| d kd || }qF| |_dS) NrMr)rrDTr$rrPrQr)rrrr r!rC)r'r^r(rrRrSrKrrTr+r,rrErUrVrWrXrBrL) r1rrrrrIrKr r!rLrZr2r4r5r(s0      zPreXceptionModule.__init__cCsD||}|}||}|js |jdur||}|||}|Sr6)rErVrKrLrTr[r4r4r5r9s    zPreXceptionModule.forwardr]r4r4r2r5r^s8  (r^cseZdZdZddddejejdddf deed e d e d e d e d e ej de ej de de deffdd Zejjd&ddZejjd'ddZejjdej fddZd(d e deefddZdd Zd&d!e fd"d#Zd$d%ZZS))rzModified Aligned Xception r Favg block_cfg num_classesin_chans output_stridepreactr r! drop_ratedrop_path_rate global_poolc  s tt||dvs J||_||_d|_t||d} tjt |dfddd| |r3t dddd dn t ddd d| g|_ d } d} g|_ t|_ |rPtnt}t|}d }t|D]u\}}| ||d }|d krpt|nd|d <| |d <|dd kr|rd|dnd|d}|j tt|dd| |dg7_ | |d}||kr| |d9} d |d<n|} |j t||di|| |j dj|_|d 7}q\|j t|j| dtt|j d dg7_ |r|ddnt|_|j|_t|j|| |d|_dS)N)r`F)r r!r`rrQ)rr@rrrarLrrzblocks.z .stack.conv2z .stack.act3r)num_chs reductionmodulerMTr$) in_featuresrd pool_typerh)r`rmr4)r'rr(rdrhgrad_checkpointingdictr+rUr rstem feature_infoblocksr^rHlen enumerater rrXstrrS num_featuresr,rOhead_hidden_sizer head)r1rcrdrerfrgr r!rhrirj layer_args curr_dilation curr_stride module_fnnet_num_blocks net_block_idxrZb block_dprname next_strider2r4r5r(sX     &       zXceptionAligned.__init__cCs tdddS)Nz^stemz^blocks\.(\d+))rvrx)ru)r1coarser4r4r5 group_matcherszXceptionAligned.group_matcherTcCs ||_dSr6)rt)r1enabler4r4r5set_grad_checkpointing s z&XceptionAligned.set_grad_checkpointingreturncCs|jjSr6)r~fc)r1r4r4r5get_classifierszXceptionAligned.get_classifierNcCs||_|jj||ddS)N)rs)rdr~reset)r1rdrjr4r4r5reset_classifiersz XceptionAligned.reset_classifiercCs@||}|jrtjst|j|}n||}||}|Sr6)rvrttorchjit is_scriptingrrxrOr7r4r4r5forward_featuress   z XceptionAligned.forward_features pre_logitscCs|r |j||dS||S)N)r)r~)r1r8rr4r4r5 forward_head"szXceptionAligned.forward_headcCs||}||}|Sr6)rrr7r4r4r5r9%s  zXceptionAligned.forwardF)Tr6)r:r;r<__doc__r+r=r>rrr?rGrr@floatr{r(rrignorerrrrrrrr9rAr4r4r2r5rsT   =   FcKs tt||fdtdddi|S)N feature_cfgThook)flatten_sequential feature_cls)rrru)variant pretrainedkwargsr4r4r5 _xception+s rrc Ks|dddddttddd |S) Nr_)r+r) rgL7A`?bicubicz stem.0.convzhead.fc) urlrd input_size pool_sizecrop_pct interpolationmeanstd first_conv classifierr)rrr4r4r5_cfg5srztimm/gGz?) hf_hub_idr)r)zxception65.ra3_in1kzxception41.tf_in1kzxception65.tf_in1kzxception71.tf_in1kzxception41p.ra3_in1kzxception65p.ra3_in1krcKtddddtddddtddddgtddddgdtdd ddtd d dd d d}t|ttjdddd}tdd|it|fi|S)z" Modified Aligned Xception-41 rmrQrrrrrkrrrriTFrrrrKrJMbP?皙?epsmomentumrcr! xception41rN)rrurr+r>rrrrc model_argsr4r4r5rU      rcKr)z" Modified Aligned Xception-65 rmrrQrrrrrlrrrTFrrrrr xception65rN)rrrr4r4r5rhrrc Kstddddtddddtddddtddddtddddgtddddgdtdd ddtd d dd d d}t|ttjdddd}tdd|it|fi|S)z" Modified Aligned Xception-71 rmrrQrrrrrlrrrTFrrrrr xception71rN)rrrr4r4r5r{s        rcKstddddtddddtddddgtddddgdtdd ddtd d d dd }t|d tjd}tdd|it|fi|S)z- Modified Aligned Xception-41 w/ Pre-Act rmrrQrrrrrkrrrT)rrrKrrcrgr! xception41prN)r)rur+r>rrr4r4r5rs      rcKstddddtddddtddddgtddddgdtdd ddtd d dd d }t|d ttjdddd}tdd|it|fi|S)z- Modified Aligned Xception-65 w/ Pre-Act rmrrQrrrrrlrrrT)rrrrKrrrr xception65prN)rrrr4r4r5rs      rr)r)-r functoolsrtypingrrrrrtorch.nnr+ timm.datarr timm.layersr r r r rrtimm.layers.helpersr_builderr _manipulater _registryrr__all__r@rrBrHr^rrr default_cfgsrrrrrr4r4r4r5s\      &"14 f