o ÓÙ¾iýã@s<ddlZddlmZGdd„dejƒZGdd„dejƒZdS)éN)Únnc sNeZdZdZ  ddedededdf‡fd d „ Zd ej dej fd d „Z ‡Z S)Ú LayerScalez6 LayerScale on tensors with channels in last-dim. çñh㈵øä>FÚdimÚ init_valuesÚinplaceÚreturnNcó*tƒ ¡||_t |t |¡¡|_dS©N©ÚsuperÚ__init__rrÚ ParameterÚtorchÚonesÚgamma©Úselfrrr©Ú __class__©úK/home/ubuntu/.local/lib/python3.10/site-packages/timm/layers/layer_scale.pyr ó zLayerScale.__init__ÚxcCs|jr | |j¡S||jSr )rÚmul_r)rrrrrÚforwardszLayerScale.forward©rF) Ú__name__Ú __module__Ú __qualname__Ú__doc__ÚintÚfloatÚboolr rÚTensorrÚ __classcell__rrrrrsüþýüû rcs<eZdZdZ  d dededef‡fdd„ Zd d „Z‡Z S) Ú LayerScale2dz7 LayerScale for tensors with torch 2D NCHW layout. rFrrrcr r r rrrrr rzLayerScale2d.__init__cCs*|j dddd¡}|jr| |¡S||S)Nééÿÿÿÿ)rÚviewrr)rrrrrrr#szLayerScale2d.forwardr) rrrr r!r"r#r rr%rrrrr&süþýü r&)rrÚModulerr&rrrrÚs