o …wÖi=ć@s$ddlmZddlZedd„ƒZdS)é)ŚcontextmanagerNc csŠt ”}t tj”z3tjjtj ”rdndtjd dVWdƒn1s*wYWt |”dSWt |”dSt |”w)aR Workaround for precision related issues when training with bf16-true PyTorch Lightning precision setting. In bf16-true, PTL changes PyTorch's default dtype, which may break implicit assumptions for some models. This context manager restores default float32 precision and runs the computation in float32 autocast context. ŚcudaŚcpu)Ś device_typeŚdtypeN)ŚtorchŚget_default_dtypeŚset_default_dtypeŚfloat32ŚampŚautocastrŚ is_available)Ś default_dtype©rśg/home/ubuntu/sommelier/.venv/lib/python3.10/site-packages/nemo/collections/speechlm2/parts/precision.pyŚfp32_precisions€ "’żr)Ś contextlibrrrrrrrŚs