o si@sddlmZddlZddlmZddlmZGdddejZdd Zd d Z d d Z ddZ ddZ d ddZ ddZddZddZddZddZddZdS)!)partialN)nn) complex_nncs$eZdZfddZddZZS)Swishcstt|dSN)superr__init__)self __class__O/home/ubuntu/.local/lib/python3.10/site-packages/asteroid/masknn/activations.pyr szSwish.__init__cCs|t|Sr)torchsigmoid)r xr r rforward sz Swish.forward)__name__ __module__ __qualname__r r __classcell__r r r rrs rcCtSr)rIdentityr r r rlinearrcCrr)rReLUr r r rrelurrcCrr)rPReLUr r r rprelurrcCrr)r LeakyReLUr r r r leaky_relurr cCrr)rSigmoidr r r rrrrcCs tj|dS)Ndim)rSoftmaxr"r r rsoftmax#s r%cCrr)rTanhr r r rtanh'rr'cCrr)rGELUr r r rgelu+rr)cCstSr)rr r r rswish/sr*cCsL|jtvs|jtvrtd|jdt|j|idS)zRegister a custom activation, gettable with `activation.get`. Args: custom_act: Custom activation function to register. z Activation z% already exists. Choose another name.N)rglobalskeyslower ValueErrorupdate) custom_actr r rregister_activation3s$r1cCsZ|durdSt|r |St|tr%t|}|dur#tdt||Stdt|)aReturns an activation function from a string. Returns its input if it is callable (already an activation for example). Args: identifier (str or Callable or None): the activation identifier. Returns: :class:`nn.Module` or None Nz+Could not interpret activation identifier: )callable isinstancestrr+getr.) identifierclsr r rr5?s   r5cCs t|}|dur dSttj|S)zWLike `.get` but returns a complex activation created with `asteroid.complex_nn.OnReIm`.N)r5rrOnReIm)r6 activationr r r get_complexVs r:r) functoolsrrrrModulerrrrr rr%r'r)r*r1r5r:r r r rs"