o پi@s>ddlmZmZmZddlZddlmZGdddejZdS))OptionalTupleUnionNc sveZdZUdZejjeed<    dde de dedeffd d Z d e ej eej eej fffd d ZZS) PatchDropoutzO https://arxiv.org/abs/2212.00794 and https://arxiv.org/pdf/2208.07220 return_indices?Fprobnum_prefix_tokensorderedcsBtd|krdksJJ||_||_||_||_dS)Nr?)super__init__r r r r)selfr r r r __class__M/home/ubuntu/.local/lib/python3.10/site-packages/timm/layers/patch_dropout.pyr s  zPatchDropout.__init__returnc Cs|jr|jdkr|jr|dfS|S|jr,|ddd|jf|dd|jdf}}nd}|jd}|jd}tdt|d|j}tjtj |||j dddddd|f}|j re|j ddd}| d|dd|jd d}|durtj||fdd}|jr||fS|S) Ngrrr )device)dim)rr)trainingr rr shapemaxinttorchargsortrandnrr sortgather unsqueezeexpandcat)rx prefix_tokensBLnum_keep keep_indicesrrrforwards&0  ,&zPatchDropout.forward)rrFF)__name__ __module__ __qualname____doc__rjitFinalbool__annotations__floatrrrTensorrrr+ __classcell__rrrrrs" 0r) typingrrrrtorch.nnnnModulerrrrrs