o }oit@sddlmZmZddlmZddlZddZddZejej fdd Z ejej fd d Z Gd d d ej j ZGdddej j ZeddZdededefddZdS))contextmanager nullcontext)AnyNcCs.trttjkrtjjdtjdStS)zM If the current autocast context is bfloat16, cast it to float32 cudadtype)torchis_autocast_enabledget_autocast_gpu_dtypebfloat16ampautocastfloat32rrrI/home/ubuntu/.local/lib/python3.10/site-packages/nemo/utils/cast_utils.pyavoid_bfloat16_autocast_contextsrcCsptr5ttjkr5tjstjrtjjdtj dStj r,tjjdtj dStjjdtj dSt S)z{ If the current autocast context is float16, cast it to bfloat16 if available (unless we're in jit) or float32 rr)rr r float16jit is_scripting is_tracingr r rris_bf16_supportedr rrrrravoid_float16_autocast_context!s rcCs|j|kr |j|dS|S)Nr)rto)x from_dtypeto_dtyperrr cast_tensor3srcsvt|tjr t|dSt|tr(i}|D] }t||d||<q|St|tr9tfdd|DSdS)Nrrc3s|] }t|dVqdS)rN)cast_all).0yrrr Aszcast_all..) isinstancerTensorrdictkeysrtuple)rrrnew_dictkrrrr7s    rc$eZdZfddZddZZS) CastToFloatctt|||_dSN)superr*__init__modselfr/ __class__rrr.E zCastToFloat.__init__cCsztr5|jtjkr5tjj|jjdd|j | tj |j}Wd|S1s.wY|S|j |}|S)NFenabled) rr rrr r devicetyper/forwardr)r1rretrrrr9Is  zCastToFloat.forward__name__ __module__ __qualname__r.r9 __classcell__rrr2rr*D r*cr))CastToFloatAllcr+r,)r-rAr.r/r0r2rrr.Sr4zCastToFloatAll.__init__cGs~tr9|dj}tjj|jjdd|jjt ||tj d}t |tj |dWdS1s2wYdS|jj|S)NrFr5r) rr rr r r7r8r/r9rr)r1argsrr:rrrr9Ws $ zCastToFloatAll.forwardr;rrr2rrARr@rAccs.t||}t||||Vt|||dS)z$Temporarily monkeypatches an object.N)getattrsetattr)objectnamepatchpre_patched_valuerrr monkeypatchedas   rIrtype_returncCs"z||WSty|YSw)aTry to cast a value to int, if it fails, return the original value. Args: x (Any): The value to be casted. type_ (type): The type to cast to, must be a callable. Returns: Any: The casted value or the original value if casting fails. ) Exception)rrJrrrmaybe_cast_to_typejs   rM) contextlibrrtypingrrrrrrrrnnModuler*rArIr8rMrrrrs