o پi@sBdZddlmZmZmZddlTddlTddlmZm Z de e j j vZde e j j vZde e j j vZd e e j j vZed$iderEejned erMejned erUejned ejd ejd ejdejdejdejdededede de!derej"ne#derej$ne%de&Z'eerejne(erejne(erejne)erej"ne*erej$ne+e,dZ-e-e'fZ.e.D]Z/e/0de/1de/0de/1dqed$idere j2ne3d ere j2ne3d ere j4ne4d e j5d e j6d e j7de j8de9de j:de j;de<de=de>de?de@dere jAneBder&e jCneDdeEde jFZGeer8e j2neHer?e j2neHerFe j4neIerMe jAneJerTe jCneKeLdZMeMeGfZNeND]Z/e/0de/1de/0de/1dq_d%deeeOffddZPd%deee jQeOffdd ZRd&deee jQeOffd"d#ZSd!S)'zF Activation Factory Hacked together by / Copyright 2020 Ross Wightman )UnionCallableType)*) is_exportable is_scriptablesilu hardswish hardsigmoidmishswishrelurelu6 leaky_relueluceluselugelu gelu_tanh quick_gelusigmoidtanh hard_sigmoid hard_swish hard_mish)r r r rrrpreluidentitynamecCsB|sdSt|tr |S|}tsts|tvrt|St|S)z Activation Function Factory Fetching activation fns by name with this function allows export or torch script friendly functions to be returned dynamically based on current config. N) isinstancerlowerrr _ACT_FN_ME_ACT_FN_DEFAULTrr$J/home/ubuntu/.local/lib/python3.10/site-packages/timm/layers/create_act.py get_act_fn[s  r&cCsN|durdSt|ts |S|sdS|}ts#ts#|tvr#t|St|S)z Activation Layer Factory Fetching activation layers by name with this function allows export or torch script friendly functions to be returned dynamically based on current config. N)rstrr rr _ACT_LAYER_ME_ACT_LAYER_DEFAULTr#r$r$r% get_act_layerms  r*NcKs`t|}|dur dS|dur|di|Sz |dd|i|WSty/|di|YSw)Ninplacer$)r* TypeError)rr+kwargs act_layerr$r$r%create_act_layers r/r$)r)N)T__doc__typingrrr activationsactivations_meconfigrrdirtorchnn functional _has_silu_has_hardswish_has_hardsigmoid _has_mishdictFr r r rrrrrrrrrrrr rr rrr"swish_memish_mehard_sigmoid_me hard_swish_me hard_mish_mer!_ACT_FNSa setdefaultgetSiLUSwishMishReLUReLU6 LeakyReLUELUPReLUCELUSELUGELUGELUTanh QuickGELUSigmoidTanh Hardsigmoid HardSigmoid Hardswish HardSwishHardMishIdentityr)SwishMeMishMe HardSigmoidMe HardSwishMe HardMishMer( _ACT_LAYERSr'r&Moduler*r/r$r$r$r%s                         "