o ©Ì³iâã@s*ddlZddlmZGdd„dejƒZdS)éN)Únncs8eZdZdZd ‡fdd„ Zdejdejfdd„Z‡ZS) ÚTanhGatez8Implements a basic learnable gate to scale layer outputsÚreturnNcs tƒ ¡t t d¡¡|_dS)Né)ÚsuperÚ__init__rÚ ParameterÚtorchÚzerosÚscale)Úself©Ú __class__©úO/home/ubuntu/.local/lib/python3.10/site-packages/torchtune/modules/tanh_gate.pyrs zTanhGate.__init__ÚxcCs||j ¡S)z³ Args: x (torch.Tensor): input tensor to gate Returns: torch.Tensor: The output tensor after gating. Has the same shape as ``x``. )r Útanh)r rrrrÚforwardszTanhGate.forward)rN) Ú__name__Ú __module__Ú __qualname__Ú__doc__rr ÚTensorrÚ __classcell__rrr rr sr)r rÚModulerrrrrÚs