o þϯi@ã@s>ddlZddlmZGdd„dejƒZGdd„dejjƒZdS)éNc@seZdZdZdd„ZdS)ÚSwishz4 Wrapper for the Swish activation function. cCs t |¡S©N)Ú SwishFunctionÚapply)ÚselfÚx©rúM/home/ubuntu/.local/lib/python3.10/site-packages/pytorchvideo/layers/swish.pyÚforward s z Swish.forwardN)Ú__name__Ú __module__Ú __qualname__Ú__doc__r rrrr rs rc@s(eZdZdZedd„ƒZedd„ƒZdS)rz² Implementation of the Swish activation function: x * sigmoid(x). Searching for activation functions. Ramachandran, Prajit and Zoph, Barret and Le, Quoc V. 2017 cCs|t |¡}| |¡|Sr)ÚtorchÚsigmoidÚsave_for_backward)ÚctxrÚresultrrr r s zSwishFunction.forwardcCs,|jd}t |¡}||d|d|S)Nré)Úsaved_variablesrr)rÚ grad_outputrÚ sigmoid_xrrr Úbackwards  zSwishFunction.backwardN)r r r rÚ staticmethodr rrrrr rs  r)rÚtorch.nnÚnnÚModulerÚautogradÚFunctionrrrrr Ús